really happy to be here with Sophie. I think she has some encouraging things to share with everybody watching this. We're all working on growing our own authentic business, solopreneurs, and Sophie has some great experiences to share. Sophie is part of my group coaching mentoring program called Master Hard ABC. And, well, let me just, Sophie, let me have you do your introduction first and then we'll get into your experiences. So, I'm Sophie Messager, as you can hear from my ex, and I'm French, but I live in Cambridge, UK, where I work as a paying neutral educator and healer. And whilst I seem to have specialized in blending scientific and traditional knowledge and helping people acquire those skills to help their clients, really at the heart of everything I do, it's about helping both professionals and families having babies, listen to their intuitive knowledge and trust themselves. That's really the essence of everything I do. That's wonderful. And you have a science background. Maybe you could tell us a little bit about that. Just so. Before I, so 10 years ago, I changed career to become a birth worker, paying neutral educator. But before that, I spent 20 years in biological research. I have a PhD in physiology of reproduction. And I worked in academia and I worked in the biotech and big pharma context. And then I went back to academia before I had my son who was 17 years old, turned 17 years old, two weeks ago. It's his birth. His birth was what led me to, I started retraining two years after he was born. Like almost instantly after he was born, I had a birth that I went from being really scared of birth thinking it's horribly painful. I want all the drugs to having a really, really empowering birth at home thanks to having higher the doula. And almost instantly I thought, oh, I don't want to, what am I doing now? Cause I want to do this. And I remember sitting in a meeting, even pregnant and thinking I'm bald. Wow. Work, do you see what I mean? Because my passion had already shifted. Right, yeah, exactly. And I remember thinking, oh, what now? And I've spent a couple of years soul searching and I eventually spent four years retraining while still working as a scientist. And I had an interesting period of teaching and the other classes in the evening was still working as a scientist during the day. And then eventually what happened is in the summer of 2012, a doula asked me to be a backup for last minute birth. And I ended up attending the birth on my day off on a Friday. And when I went back to work on the Monday, I thought, what am I doing here? Because this is so much more interesting. That dress you did and I just basically gave my resignation three months later. That was amazing. And what's unique about what you do is I wanted you to share your scientific background because you also have the spiritual side. Indeed. And you integrate the two. So tell us about that a little bit.  Yeah. But of course, you also have the maybe more traditional birth people that you know, maybe. And then you have holistic birth people and then you have the spiritual side to you. Like how... Yeah. And I'm emphasizing this point because there are so many people watching this who are also struggling with bringing more of their, well, authenticity or their spirituality, their woo-woo background or woo-woo interests into their work. Maybe they even work in a more traditional sense but they want to bring more of the spiritual out. So how do you take courage? You know, because what are they going to say? The people who know me for my, you know, credible professional person. So yeah, talk to us about that. So I think this is very interesting. I'm really glad you asked that because I've come so far from my, from my almost, at some stage I almost had shame about my woo side. But to go back to just give you a next, just sort of give whoever's listening and knew it and a, you know, a real extent of my woo-ness is that, you know, I'm as well as a PhD and very into where you get or I have, trying to become a Reiki practitioner and a Reiki practitioner, a teacher. So I've trained birth workers in doing Reiki. In fact, I specialize in doing it for birth, mostly because when I started attending births, you can't be in the room where a baby's just been born and not feel the phenomenal energy change in the room. It kind of blew my mind. I had trained in Reiki quite a long time ago in 2003. So way before I became a birth worker, there was always a part of me that felt really attracted to the esoteric. And I think I've always felt things like that. I've been like that since I was born. But I very quickly found myself, you know, doing a lot more of this training very, very fast. Like I went from like Reiki to Reiki master six months later because I was like, I want to do more of this. And then I eventually strain into something called Reiki drum where your channel Reiki drum. And I started using my drum in healing a lot. And that's from someone who the first time I was exposed to the idea of drum healing. I thought, what's that BS? You know, I thought, I used to sing all these things at no, at no rational, that no, that made no sense. But it was a case of I was exposed to these things. I felt what they did. And then I was like, this is amazing. Well, and it's indeed, it has thousands of years of history, it's, you know, science hasn't caught up yet with the healing power of that. Yeah. And in fact, I have a theory that every culture in the world does drumming, singing and dancing, and that in a Western world is seen as something only special people can do. And, you know, there's always been an element of using that for healing. But so in 2016, when I, so, sorry, when I started training to do Reiki, I had this really weird, difficult time because people kept hiring me because of my background of science.  And for a while, I even considered having a separate website for my healing work, almost that because I was worried those people were put off. And then luckily, I talked to a lot of people about that and I became very aware of the fact that trying to please everybody and trying to almost small yourself down to fit people's wishes wasn't a way to go about it. And so in 2016, I wrote a blog post called Confessions of a Hippie Scientist where I came out. And it felt very vulnerable because I'd only started blogging in 2015 and I was blogging very rarely. So this blog was a big deal for me. And I remember feeling very worried about how we would be received. But what I got was almost everyone who reacted was like, thank you so much. I feel exactly the same. And today I look back on this George and I think I can't believe I felt I had to like return that part of me wasn't there. And of course his client who didn't want the hippie stuff, I didn't give them the hippie stuff. It's like a buffet of things that you have. I was scared you're never gonna force them onto someone. But I started being much more upfront in my messaging online and about what I did. And then suddenly I got a lot more interesting clients. So one of my bucket list things which I achieved many times was to drum at a bus. And a couple of years later, I got hired by a woman who hired me for that purpose. So she got me to drum in the hospital. Wow. I drummed at a bus in the hospital. Oh my goodness, that is so, that's mind blowing. I mean, just to think about the baby coming into the world with that kind of sacredness of spirit instead of the typical hospital environment of that kind of sterile and traumatic, but anyway, this is really cool. Thank you. Thank you. And you know, fast forward to like, I think the last time I drum at a bus, which might have been in towards the end of 2021, I think, I drummed in the delivery unit and like the obstetric unit because I first started at home, then I went to the bus center and then that time I actually brought my drum in the obstetric unit. And by then it felt like, what's a big deal? You know, that come full circle. Wow. That's so interesting. I'm worrying about what the midwives and doctors might think, you know, because... Okay, okay. So now I found also George that I've written a lot more about those things and I feel, you know, what I learned back then when I decided to write this blog. In fact, a coach I've been working with challenged me to write this blog. Yes. And it was a pivotal moment for me because after that I started to say to all my friends, but if you try to please everyone, you end up pleasing no one, but also the people who find that off-putting they're not the people you want to work with. So, you know, I suddenly got a lot more like holistic clients, people who got all energy work. Yes. I got much more exciting families to work with because, and then of course then came with the fact that people started asking me to teach them how to do that. You know, the whole energy work during the bus, in the bus room I started blogging about it and I told a group of bus workers, several groups of bus workers about a specializing basically making a recce course that was uniquely for people who worked in the bus world, which as far as I know didn't exist. I often pioneer things, George, it's almost in my makeup. Even when I was in science, I would within two or three years in the new field establish myself as a name in my specialty because what I've come to realize by working with a coach who is specializing in supporting neurodivergent families is I am, she was the first person to speak to me that I'm not just neurodivergent, but I am gifted. And I never understood what she meant by gifted because for me giftedness meant mathematical genius. But she suggested a book called The Rainforest Mine and I read this book and I really recognized myself. And one of the thing I have is meta thinking. So when I get into a field like healing or birth or anything, I consume information like in a very, like rather than going into a rabbit hole, I go a very broad and I start to look at the connections. The connections, so for instance, when I published a book about postnatal recovery in 2020, I did away from talking about any of the, this is my husband's from Hong Kong. So I never did, oh, you should do the postpartum like people do in Hong Kong because in Hong Kong, the main postpartum dish is pig's trotters in black vinegar.  So I just distilled it down to the main for what I saw as a main for categories that postpartum KFL into. And whilst I gave lots of examples by interviewing people for the book, what did you have in your culture? I never said you should do it like this culture. I was like the principle like this. Here are some examples, but they are four principles. And now I look back on everything I've always done. It's always been something I do without thinking. So a thing I talk a lot about in my blogs is how we tend to take for granted what comes to us easily. So I never used to think there was something special about my way of thinking. Until I realized that people, like not everybody thinks like that. Not everybody thinks like that. I so appreciate this because I know there are others watching this who probably can appreciate more how they operate differently than others. And to see it as a gift as you were gifted with that perspective to say, oh, okay. This is a gift that if I emphasize it can actually bring value to other people and to my own life more rather than seeing it as something strange or different and therefore to be oppressed. So please those watching this, feel free to comment below if you wanna share your own example. So thank you for inspiring us with your example of merging your integrating more of your spirituality and your authentic essence into your work and seeing how that brings you alive. And I think that that liveliness. And I still do the science. I will just say that the science is a big part of my work. I bring a lot of nothing more than finding scientific reference to back up. So I like to, you know, bridge the, bridge act as a bridge between those two things. The best of both. Why not? Yeah. So I'm still, often people, when I meet people, they like, how can you do this weird energy healing thing even though you've got a PhD? And you know what? Today I don't feel the need to justify myself. So I said, because I can. Great answer. Because I can. And I bring the benefit of both worlds. And if you don't know that benefit, I'm happy to share it with you. If you're interested in hearing about it. If not, that's okay too. Yeah, that's it. I'm not, the other thing that's very liberating in this really embracing my full self is, which by the way, self employment has really made me blossom compared to like when I was an employee who didn't even realize how much I'd been boxed in until I started stepping out of, you know, one of the things I loved about doula work is you meet people. You get very into the details of people's lives and you meet people, many of which did jobs I never even knew existed. You meet such a breadth and variety of people and you get to know that very, very well because you're in that context of one-to-one work with a family. And when I was a scientist, I only hung out with scientists. But now I've hung out, like I keep thinking when you're just doing one area of work, you've done, you have a very narrow view of the world. And as I started, the more I worked in this field, the more I was like, whoa, I just didn't know. And my old self blossomed into my own uniqueness, which means I love science, but I also don't love getting like lost into just one area. I never really did when I look back on things, I always felt I want to like a bird's eye view of the whole topic and often make links, like I said, between things where even in my PhD, I remember saying to my boss, well, why do we have to do it like that? And how about this? And people who look at me like, you know, often I went to conference and I would say, am I the only one who thinks that's not going to work? Wow, yeah. And people would be very upset. Yeah, you're challenging. Even in fields of science, I knew nothing about, I would go and say, Matt, you're talking about something that just didn't work and you're gonna do the same thing. To give a specific example, you know, I went to a conference last year, I worked in science and they talked about how they tried to eliminate malaria using anti-mosquito drugs and anti-malaria agents in the 1980s and the mosquitoes became resistant to the drug and so did the malaria agent. And they said, we're gonna do it again with new drugs. And I was like, hello, did you just hear what he said? Yeah, they just have to say, well, let's just do it harder and stronger, then therefore it will work. What you're saying is that you have a natural ability to do systems thinking, which allows you to gather the principles of having a more holistic view allows you to see the principles that then it can be applied more widely to create new solutions, better solutions. And yeah, it's wonderful. So yeah, I wanna encourage everybody to look, if you think differently from your industry, if you have critiques of your industry, share them, you know? And I mean, this is kind of, I love this conversation because that's kind of how I have operated in my industry is I'm like, why are you doing that way? Why don't we try this way? And I try to bring in sort of, so this is great. So self-employment. So now that you are fully into the self-employment and of course you've been in for a while, tell us, how do you express, how do you find the courage or practice the courage to keep on putting yourself out there with your ideas and with offers that might not work? Maybe you have all this practice in your scientific background, but it's like, what is the lesson you've learned from all that, that others can benefit from? Like to keep putting the content out there, the offers out there that might be unique, that might be against the mainstream? Oh, so such a great, such a deep profound question. I mean, you know, as you know, George, I've worked with you over the last couple of years and one of the big things I've learned is not to put a lot of effort in what I think my audience what I think is right for my audience. And you know, today is really interesting because today I was doing a market research interview. Well, I was basically doing a mentoring session with somebody, but in that I was also asking questions. And what was really interesting is the measure of, this is somebody who's just starting in the field and has majoring in postal syndrome, which is something I've written a lot about and I've had to like overcome myself. And I certainly said to this woman, I really wish I could go back to my beginning of my self-employed business with what I know today because nobody tells you when you start a self-employed business how to run your business. You know, in the field of caring profession like doula and until I tell educators, people just think, oh, I want to help people, but there's none of that. So I, for instance, I've planned to write a blog this week about how to avoid burnout when inspired by what you shared on the call earlier this week. How do you avoid burnout? And I'm going to tell stories of how I've experienced burnout over and over and over again until I started to put myself first and understand that I used to let my clients run my diary, which is what I said to this woman today. You have to think, how do I want to work? And not just let your client dictate your working hours. So that's one aspect, so the how to have a balanced life. And then I would say I've only really been starting to work with that for the last two or three years. And then the other aspect was, I used to just produce courses based on what I thought people would enjoy was not pulling people, not asking anything. And one of those course, I took probably the most hours to produce has been one of the least successful courses because I did all that before I started working with you. And I didn't occur to me to think that people would not necessarily be as interested in that. And one of the big aspect of starting to gently do, because I'm not like you, except spreadsheet is something I have quite a lot of resistance to. So tracking gently what has been most successful. So a few weeks ago, I tracked last year's income and it was very clear that one of my five online courses is the third of my entire income. And then the course then go down in different order based on which one has been the most successful. And I thought, okay, clearly I need to do my next webinar on that course. And that's the webinar I've just ran last week that had 162. It had 246 sign up, 162 attendees. Out of this 162 attendees, I got 93 feedback forms. That is just so encouraging to hear. People bought 22 courses. Wow. Wow. And it's the biggest course sale. Usually in my webinars in the past, this is the seventh one running in two years. I usually had about 10 course purchases. So this is, you know, for me it still costs slightly mind blowing. Of course. I still don't quite, I'm trying to capture now how people find that about me have not quite, you know, I've introduced like a non-boarding form in that course to try and understand, you know, and I'm running like, I've started running interviews on the people doing the course. Like I said to them, come on have a half an hour call with me and I will ask you a question for 10, 15 years. And then you can just pick my brains and I've had two of those over the last week. And it's really, one last night was absolutely fascinating because this woman said to me, I had seen your course and it was in my consciousness. But then when I came to your webinar and I heard you speak, then I signed up straight away. She did the course in three days. Wow. And it's a long course, you know, she basically came to have this call with me on Monday and said, yeah, I think your course was fantastic.  Yeah, yeah, yeah, yeah. This is ready. So that process now, and I did the same before coming to talk to you today. I went and looked at and made you'd be very proud of me and extra spreadsheet with all my webinars to see the progress. Because when I started, I didn't do the free to attend paid recording. I just did free to attend. So my attendance rate has gone from 40 to 65%. Just to, just to, just for those who don't know, that's one of the strategies I teach is called the FTA webinar, free to attend paid recording webinar. So it's the recordings are free. Anyway, I talk about this more in my authentic outreach course if anyone's interested.  You've stayed, I mean, a lot of people take my courses, not everyone implements and you implement and you actually do stuff. I mean, you do the market research, you do the free to attend webinars. And that's not a shock to me that you're getting progress. You're seeing the progress happen.  And so given that this is the first of, you know, we're gonna talk again later in the year for sure, what are you looking forward to doing this year that when we check in in a couple of months, hopefully we can celebrate? So tell us about your intention. I love the idea of doing more net caring. So I'm investing in that. And one of the new things I'm trying out this month for the first time is to have a bonus. So I decided to have a bonus like live call with another professional. So I scratched my head to like, because I've just promoted this one course. I said, okay, let's look at the next course, the one then next one that's more successful out of the five. And I scratched my head thinking, who can I invite to do something that would really add value when I'm really excited because it's adding value to me as well. So I have invited a woman I met at the course last year who is an asteropath as well as a doodler and was gonna explain all the anatomy and biomechanics of using those Mexican scarf I had teach about doing massage and during labor to help when the baby is not in quite an ideal position when the birth is taking longer than expected. And so what's really interesting is I'm just as excited I expect that the people, you know, I have no idea whether it will be successful or not to like a still and to attend some slight, well, what if nobody turned up, but it's gonna be if people buy the course this month then they will get, and I will get this free, you know, live class. And I will also refer it to everybody who's already enrolled in the course, which hopefully will also sort of, you know, invite people who have kind of been involved in the course to like reignite and maybe share about it. And the idea was to then put that class inside the course as a recording that people have never done this before. That's great. And I'm hoping to like, if it's successful to carry on doing that. But you know, before I met you, George, I used to do all these things anyway, but I never thought they counted as marketing. I used to, I've always loved connecting with people. I've always found that delightful and much easier than trying to hard sell anything. And you know, I'm also really delighted I'm able to pass this on like the women I did a mentoring session with today. I said to her, you don't have to do all these things. And she said, oh, I've only got four to five students in my baby massage course. And I was like, when did you start? And she said in January and said, this is pretty amazing that you, because when I started before I knew you, I thought, oh, 30% of people open my newsletter is really bad. I must be really terrible at writing newsletters. And I had no idea that it was normal. No, yeah. It's not better than normal, 30% would be better than normal. But this is, thank you. I'm looking forward to, you know, next time we get together hearing more about the progress and your lessons. So I will put the links below this video for anyone who wants to follow up with your offerings, your journey. So thank you so much, Sophie, for sharing your story inspiring with us. Yeah, thank you so much. Thank you.


it does seem, to me at least, is that I do believe that there was multiple people that brought Kush from Florida to California. I think that's factual. Because obviously people know about Cornbread Ricky and TK, he sent that out before he came out physically himself to the state. People know about Matt Bubba and Bubba Kush and Josh D.  Because he comes off like a little bit of a used car salesman when you talk to him. He's very friendly, but it's like his nature. So I didn't believe him, but everything that I've ever researched and found is he has not been wrong once.


If you open the graph x plus half x, we have done a silly substitute A x square, easy to solve. Alright. In this term, if it says t, this along with tx will become dt, so it will be just like under root t dt. Into under root t dt. And this you can complete the square example, that will be more clear to you. This is half. So, instead of x plus 3, I will write half to x plus 2 plus 2 into under root plus the same term which is x squared, rational functions using partial fractions, and irrational functions. Thank you so much.


Okay, I've got two decimal numbers here, and I'm just going to walk through the process for forming each of these operations on the pair of numbers, just to remind us of how these operations work. So if I start with addition, I've got 52, 39, and I'm going to add 38, 56 to this. So, I start from the right, and I've got 9 plus 6. 9 plus 6 is 15, so I'll write down a 5, and I'm going to carry the 1. Now, I've got 1 plus 3 plus 5, which gives me 9. So, I'll write down the 9. There's nothing left to carry. Now, I have 2 plus 8, which gives me 10. So, I write down a 0, carry a 1. Now, I have 1 plus 5 plus 3, which again gives me 9. So, my result is 9,095. So, anytime I had a number that's larger than 10, I'm writing down the last digit, and I'm carrying a 1. Since I've only got two numbers to add together, I can only ever carry a 1. But otherwise, I'm looking at one pair of numbers at a time, and just moving from right to left doing the subtraction as normal. If I do subtraction, I'll start with the 52, 39, and I'm going to subtract 38, 56 from that. So, 9 minus 6 is simple. That gives me 3. But I can't subtract a 5 from a 3. 5 is larger than 3. So, I really need something larger than 5. I'm going to go borrow a 1 from this 2 over here. So, if I subtract 1 from my 2, it becomes a 1. But now, I have a 10 over here that I can add to my 3. So, I have 13. Now, I can subtract 5 from 13. That leaves me with 8. Now, I'll go over here. I've got 1 minus 8. I want a smaller than 8. So, I'm going to need to borrow something from my next position. 5 will become a 4, and the 1 will become an 11. Now, I can do 11 minus 8, leaves me with 3, and 4 minus 3 leaves me with 1. So, 52, 39 minus 38, 56 gives me 13, 83. Multiplication and division are going to be a little bit longer and harder, and we're going to do a lot of addition or subtraction in the process. So, if I start with 52, 39, and I want to multiply that by 38, 56, I'm going to start with the rightmost digit in my, the number on the bottom, and I'm going to multiply that by everything in the top number. So, 6 times 9 is 54. So, I write down the 4 and I'm carrying the 5. 6 times 3 is 18, and now I'll add in the 5. That will give me 23. 6 times 2 is 12, plus 2 is 14. 6 times 5 is 30, plus 1 is 31. Now, we'll do the same process again, but this time I'll be looking at the 5, multiplying it by everything on top. So, 5 times 9 is 45. So, I don't need this 5 anymore. I'm going to have a 4 that I carried. 5 times 3 is 15, plus 4 is 19. 5 times 2 is 10, plus 1 is 11. 5 times 5 is 25, plus 1 is 26. And again, with the 8. So, 8 times 9 is 72. Down the 2, carry a 7. 8 times 3 is 24, plus 7 gives me 31. 8 times 2 is 16, plus 3 is 19. And then, 8 times 5 is 40, plus 1 is 41. And finally, I'll repeat the process again for the 3. So, 3 times 9 is 27. Write down the 7, carry a 2. 3 times 3 is 9, plus 2 is 11. 1, carry a 1. 3 times 2 is 6, plus 1 is 7. 3 times 5 is 15. Now, I just have to add up all of these numbers that I've got. 4, 3 plus 5 is 8. 4 plus 9 is 13, plus 2 is 15. 5 carry a 1. 2, 3, 4, plus 7 is 11. So, 4, 10, 20. 2 plus 2 is 4, plus 1 is 5. Plus 7 gives me 12. Then, 1 plus 4 is 5, plus 5 is 10. And then, 1 plus 1 is 2. So, I get the number 20,201,584. If you're wondering why this algorithm works, think back to what these numbers meant when we were looking at base changes. Each of these positions actually has some meaning and carries a magnitude term with it. And when we're multiplying a couple of those magnitude terms together, each of them, it ends up shifting our number over. So, the shifting that we see here is actually an effect of the magnitude terms that we have attached to the larger numbers in the bottom number. So, if we go on and do this again for the division, I will start with 52, 39. And we're going to divide 38, 56 into this number. So, obviously this is not going to divide cleanly. We're going to have a long fraction attached to it. But we should be able to do this as well. So, 38, 56 is not going to go into 5. So, I can put a 0 there. It's also not going to divide into 52. Still not going to divide into 523. But it is less than 5239. So, it looks like it will go in about once. Twice would be 7,600 something. So, we should be able to subtract 38, 56 from this. And since we actually already did that arithmetic, we know that it's 1,383. So, if I wanted to do integer division, I would say that 52, 39 divided by 38, 56 goes in once with a remainder of 1,383.  So, first thing I'll do is I'm going to see, going to say that there's a whole bunch of zeros after this number, infinite number. So, I can go on calculating my fraction as long as I'd like. And I'm going to pull down one of those zeros. Now, my 38, 56 should go into 13,830 several times. And I'm going to guess that it goes in about four times. So, I'll start by figuring out what is 38, 56 times 4. So, I get 24, 22, 34, 12 plus 3 is 15. So, 15, 4, 24 was too large. I need to go back to this again with the multiple of 3. So, 3 times 6 is 18, 15 plus 1 is 16, 24 plus 1 is 25, and 9 plus 2 is 11. So, 11,568 is less than 13,000. So, I can write down a 3 as my next digit, and I will subtract 11,568.  So, this will be a 2. This will be a 10, giving me a remainder of 2, 2 minus 6. Now, I need to go borrow something. So, my 8 will turn into a 7, my 2 is now a 12. So, 12 minus 6 is 6, 7 minus 5 is 2, 3 minus 1 is 2, and 1 minus 1 is 0. So, now I have 22, 62, which is less than 38, 56, which is good. So, I'm, so I will pull down another 0. Now, I need to know how many times 38, 56 goes into 22,620, and should be at least 5 times. So, we'll try calculating for 5. So, 38, 56 times 5. 6 times 5 is 30, 5 times 5 is 25, plus 3 is 28, 5 times 8 is 40, plus 2 is 42, 5 times 3 is 15, plus 4 is 19. So, 19,280 is less than 22,000, and it looks like it should be enough less. If I added 3800 to this, I would get something around 23,000, which would be larger than this. So, I'm going to write down 5 as my next digit, and I'm going to subtract the 19,280. 0 minus 0 is 0, 2 minus 8, and I'll borrow something from my 6, turns into a 5, now I have a 12. 12 minus 8 gives me 4, 5 minus 2 is 3, and 22 minus 19 will also give me 3. So, 33, 40 is less than 38, 56, which is good, and I can pull down another 0. But since 33, 40 was pretty close to 38, 56, I'm going to guess that 38, 56 goes into this about 8 or 9 times. So, 10 times would be 38,560. If I subtract 4,000 off of that, that would leave me with about 34,000, so I'm going to guess that 8 times is about right. But I still have to do the arithmetic to find out just how large that actually is. So, 38, 56 times 8, 6 times 8 is 48, 8 times 5 is 40, plus 4 is 44, 8 times 8 is 64, plus 4 is 68, 3 times 8 is 24, plus 6 will give me 30. So, I would write down 30,848, and I'd put an 8 up here. So, this will become a 3, this turns into a 9, then I have a 1 subtract from. So, 10 minus 8 is 2, 9 minus 4 is 5, 3 minus 8, I need to go borrow some things again. 2, now I have a 13. 13 minus 8 will give me 5, 2 minus 0 is 2. So, I can continue doing this until either I have 0 left over, in which case any more division would be pointless, or until I get bored. This point I'm pretty much bored. We can say that 3,856 goes into 5,239, about 1.358 times, and some more change.


It's July and it's getting hot, just like the deals at Appalachian Wireless. All months get the Samsung Galaxy S8 for just a penny with a two-year agreement. But don't wait because the deal ends soon. Better service, bigger savings. That's today's Appalachian Wireless. As the 4th of July holiday approaches, officials are reminding those partaking in firework festivities to have fun, but be safe. The American Pyrotechnics Safety and Education Foundation says even legal fireworks can cause injury if not used properly. It is also a good idea to steer clear of homemade fireworks. Where eye protection, have the water hose handy.   You worry about your protection. Always have an adult present.  Remember that alcohol and fireworks do not mix. And it's always important to read and follow the instructions on the labels. Officials also remind those shooting fireworks to be mindful of neighbors and animals.  Scares pets as well. Dogs, cats, just make sure that they have identification tags. Make sure that you do have the pets either inside, they are outside. Then make sure that you have a hold of them so that they're not around the fireworks whenever they are being lit. We do have the potential for veterans with PTSD. Safety being in mind is making certain that they know what's getting ready to happen. For more information and safety tips, log on to Celebratesafely.org. In Pikeville, Shelby Porter, EKB News.


All right, well, I think that's about as good as it's going to get. So good morning or good afternoon to all of us who are here. My name's Lee Ping Wong. I'm one of the Open Force Field Consortium academic members. I'm an assistant professor at UC Davis and really glad to be talking in front of such an expert crowd of scientists from academia and industry today. And mainly what I'm going to cover today is the Near Term Parameter Optimization Strategy, which uses a software I developed called Force Balance. And this slide simply refers us back to the roadmap slide that Michael Shirtz had in his roadmap presentation because Force Balance is an instance of the parameter optimizer that we are going to use. By having this talk as one of the early science talks, we'll get an opportunity to see how all of the components of the Open Force Field project are linked together. So first of all, what is Force Balance at a very high level? It is a force field optimization tool. The software is written in Python and it has a main executable called Force Balance that you run on the command line for carrying out parameter optimizations. And Force Balance has a few design goals that were decided from the outset when it was initially developed about seven years ago. Force Balance is designed for flexibility, which means that users should be able to optimize force fields using a wide variety of functional forms and reference data, which means from quantum mechanical calculations or experimental measurements, as well as the molecular mechanics simulation software that actually runs the simulation and does the force field calculations. Force Balance is also designed for reproducibility. And we all know that force field development has kind of a reproducibility problem if the process of force field development involves changing parameters manually and then running again and see how things have changed because the next person who might want to reproduce the work might not make the exact same choices as the first person. So Force Balance sets up your parameterization calculation as a single run of a command, which really allows you to systematically improve on previous work by adding more data or more physical detail to your previous runs. Force Balance was originally written using a copy, was originally licensed under a copy left license. This has now changed. It's freely available for commercial use under the three clause BSE license. And if you download the software distribution, it comes with 18 example calculations, parameter optimizations, some of which have been published in the literature, and all of the calculations come with all of the data that is needed to reproduce the results. So to begin with, I'll give you some previous example applications of Force Balance. One of the things that the software is known for is that we've developed a series of water models. And the water model that is most familiar to all of us is TIP3P, right, by the venerable model that Bill Dorgensen came up with in the early 80s. And since then, because simulation methods have changed, we've gone from Monte Carlo to molecular dynamics, and we've gone from cut-offs to particle mesh eWald, we've found that TIP3P doesn't really reproduce the thermodynamic properties of water all that accurately. And so it becomes a possible testing ground for the Force Balance method to fit the parameters of TIP3P to more closely reproduce the experimental results. And you can see in the top three slides here, this is the result of fitting all of the parameters of the TIP3P model using Force Balance to fitting the parameters to a set of experimental thermodynamic properties. I'm showing you three, but in the whole optimization, there are six of them. You can see by the curves that the TIP3P FB model, the optimized model shown in the blue, is able to more closely reproduce the experimental data shown in the black compared to the original TIP3P model, which is shown in the gray. But we also know that being able to fit the data is not the only hallmark of a good force field. You also need to be able to predict things, right? And so the standard validation of a force field is to predict the things that we already know. And some other well-known properties of water are the radial distribution function and the self-diffusion coefficient and the shear viscosity. And if you look at these properties, which were ones that we did not fit using Force Balance, we calculated these outside of Force Balance after the optimization, you can see that the validation properties are also in much improved agreement with experiment as well. And perhaps one remarkable feature is that after the parameter optimization, you can see that the parameters only changed by just a few percent. I think the parameter that changed the most was by maybe five percent, but you can see a very dramatic difference in the properties. So you can see that very small changes in the parameters give you dramatic changes in the properties. So this might not be something that you want to tweak by hand. If the computer can do it for you in a numerical optimization, well, that's a, well, why not take advantage of that? Here's another example application. So Amber FB15 is a protein force field that we actually published in 2017. And this is a protein force field that builds on the Amber 99 SB model with all of the bonded angle and dihedral parameters optimized to fit high accuracy quantum mechanical potential energy surfaces. And even though our fit was purely to quantum mechanical data, we ran some validation studies on the temperature dependence of protein structure and found some improved agreement with experiment. And perhaps this could be rationalized by comparing our optimized molecular mechanics potential energy surfaces to the quantum mechanical surfaces, which is the upper left here. So if you compare the quantum mechanical surface with the original molecular mechanics surface, which is the top middle, you can see that the original M.M. model will overestimate the energy away from the minima, which and the difference in the energies is represented in the right panel here. And this plays into the narrative that the previous generation force fields are able to reproduce your equilibrium structures, but outside of equilibrium, the performance is not as guaranteed. Whereas if you fit the parameters to a comprehensive potential energy surface, you get more accurate energies that are farther away from the minima. And that might be an explanation for better temperature dependent behavior. So in a subsequent publication, in a subsequent publication, three different protein force fields were tested to look at the free energy along a folding coordinate of a small peptide. And at the experimental melting temperature, Ambr-FB15 correctly predicts a 50-50 ratio between the folded and unfolded states. Whereas two of the previous generation force fields overestimated the population of the native state. So those two examples of a force field that force balance was used to build. And here are some more examples from the literature, updated with a few publications from this year. So the projects that force balance has been used for are now extending past my research group. So a group in the UK led by David Huggins implemented some code into force balance to fit radial distribution function data. And they used it to develop a model of water that uses the Buckingham potential. That was exciting to see. And more recently, we also developed a model for polarizable nanoporous graphene. This is a post-doc at Udong working in my group. And I'm also excited about a submitted work where force balance was used to develop a coarse-grain model that uses a hydration-free energy target. And this is, again, a collaboration with Jonathan Essex based in the UK. And in particular, force balance has been used to develop a long series of water models. And perhaps that's because it includes the data set that was initially compiled to parametrize the first of these models. I and Eba, which I'm a co-author on with John Kedura, who's also in this room. Yeah, question. I was struck by how much tip 3PFB looks like sort of a hybrid of SPCE and SPCEB, which are both very laboriously not hand-fitted, but laboriously fitted models, also which they take some different thermodynamic assumptions the way they work. Do you see any similarities between tip 4PFB and, say, tip 4P2005, tip 4PEWALT? The tip 4PFB model was optimized starting from tip 4PEWALT. And it makes the same thermodynamic assumptions as tip 4PEWALT, actually. So we add a polarization correction onto the energy of every molecule when it's in the liquid in keeping with their example. And I think the main difference between tip 4PFB and tip 4PEWALT is that tip 4PFB will give you a dielectric constant that's a little bit higher, more consistent with the experimental number because we directly fitted that number. But I should also bring up that a lot of people don't necessarily think that you should be fitting directly to the dielectric constant. So we haven't completely closed the book on that question either. OK, so and here are the characteristics of the data sets that we use to fit the parameters using force balance. And this is just to show you that the data sets are rather large and diverse according to our desire to fit the force field parameters to different kinds of data. So the water data set includes thermodynamic properties of liquids, but also experimental gas phase properties, as well as properties calculated from using ab initio methods. And the protein data set mainly involves a large number of ab initio calculations. And all of this data is available for download with the force balance distribution. And I'm going back to this figure again. I want to briefly go over the optimization workflow, which will provide context for what's about to follow. So to start a force balance optimization, you start with a force field file that contains the initial values of your parameters. And you also specify which parameters you want to optimize, which means the force field file has to be labeled in some way. So I'll get into more specifics soon. And then as you go from the bottom, you follow the cycle up to the very top. Now you use the force field to calculate properties. And the properties are calculated by automatically calling molecular simulation engines. So in our collaboration, we're going to use the open force field toolkit to set up the parametri system, followed by open MM to carry out the calculations. And then this is going to allow us to compute the objective function, which is a least squares quantity calculated from the differences between your simulated values and the reference values that you have prepared before the calculation. And the way force balance does this in a general way is that force balance will allow you to calculate the properties using different values of force field parameters simply by writing out a separate force field file with the numbers changed and reading it back in and setting up a new parametri system and re-evaluating the properties. Later on, I'm going to go on to talk about how we're going to more tightly integrate force field updates with the open force field toolkit. After you evaluate the properties, you're able to evaluate the objective function, which includes a regularization term. And regularization is another word for a penalty function that keeps your parameters from going too far away from their physically motivated initial guesses. And along with the objective function, we also have the gradient of the objective function and an approximate Hessian matrix, which allows force balance to take more efficient optimization steps. And this cycle repeats until the convergence criteria are met. OK, so a few slides on the theory. So I'm going to talk about force field parameter updates followed by the objective function of the optimization. So when you're optimizing force field parameters, one of the very first challenges we'll run into is that the numbers are all different sizes. And it depends on what molecular mechanics software you're using. So a bond force constant is maybe 100,000 or 500,000 if you're using the kilojoule per mole and nanometer system of units, whereas a bond length is on the order of 1 tenth of a nanometer. And if you just carry out the optimization directly in these numbers, it leads to a very badly conditioned Hessian matrix. So the way and furthermore, parameters will often obey complex functional relationships and constraints. The easiest example of this is that you want the charges on a molecule to sum up to the same number. You don't want the optimization to actually change the sum of the charges. And in other cases, you might want your parameters to obey certain constraints, like stay within a desired range. And how do we handle all of the different scales and the relationships between parameters that a user might want when doing a parameter optimization? This is handled in force balance by having a separation between the parameters that we actually optimize and the parameters that are written to the force field. So the parameters that are optimized are called mathematical parameters. These are the ones that the optimization algorithm actually sees. And they are fully unconstrained. And they are all designed so that they are all of the same order of magnitude, like order 1. So at least we don't expect these to be changing by 7 or 8 orders of magnitude. But 3 or 4 orders of magnitude should be 5. And the physical parameters, the ones that are closer to being actually written to the force field, these are related to the mathematical parameters by a shifting and a scaling. And what this equation here says is that in order to write out the values of the physical parameters at a given optimization step, you start with your initial physical parameters and you add on your mathematical parameters times a rescaling factor. And an example of the rescaling matrix is shown to the right here. And this rescaling matrix is a diagonal matrix where the entries are hyperparameters. These are parameters that you set at the start of the optimization. And we call these prior widths. And the reason why we call them prior widths is that if you think about this kind of optimization as finding the peak of a probability distribution, the prior width is like your prior expectation of the distribution of the probability of that parameter. So it corresponds to the size of expected changes of the parameter over the optimization or over parameters of the same type. So if you look at the top left prior width, this corresponds to a bond length because we expect it to vary by perhaps no more than 0.01 nanometers. Whereas a bond force constant might have a much larger prior width corresponding to the variation of maybe 10 to the fifth kilojoules per mole nanometer. And because the prior widths also play the role with the scaling factors, that means the mathematical parameters are all varying on order one. And then the matrix P takes care of the different scales of all of these different scales of parameter values. And typically you need to specify one prior width for each parameter type that you have. Meaning that even if you have hundreds of parameters in an optimization, you need to specify fewer than 10 prior widths because we want the number of hyper parameters to be as low as possible. Okay, so even though we now have the shifting and the scaling, that is insufficient to take care of all of the different mathematical relationships that you want your parameters to have. So how do we handle these mathematical relationships? We do it with so-called evaluated parameters, okay? Evaluated parameters are just mathematical functions of your physical parameters, but they can also be functions of each other. So I can, so the independent variables that I optimize can be shifted and scaled into these physical parameters and they can be further processed into evaluated parameters. They can be even processed more deeply in multiple layers of functions if you want to. So that ultimately the number that you actually write into the force field file that your molecular mechanics program is using can obey pretty much any mathematical relationship that you want. And that includes things like summing up to a constant restricted to within a range or even like obeying the law of cosines. So this allows you to, so I think this affords us a very high degree of flexibility to like how much we want to control the parameters that we are optimizing. Okay, so moving on to the theory of the objective function. The objective function in force balance really is a hierarchical least squares quantity. So at the root it's a least squares quantity, but there are multiple levels of sums and weights and normalizations so that at the very, so that at the end of the day you end up with a single number that you are optimizing. So at the top level you have your objective function which I call L-Tote and it's a function of your mathematical parameters K math. And you can see here that it is given by a sum over the targets where every target has it's comes with its weight plus the regularization term that also comes with its weight. Okay, in many cases it's simply sufficient to use weights of one here. And if you go a little bit deeper into a given target a target will often involve a sum over properties. So for example, one target in force balance is thermodynamic properties of liquids and there are six properties that you can calculate and fit to the experiment. So this sum will run over six properties and each property has a weight that is specific to it. Okay, and then going deeper into the individual property here is where you see the least squares objective function appear. So you now have a weighted and normalized sum over the individual data points. So for example, I may be fitting the density of a liquid over a range of temperatures and this will be a sum over maybe like 20 or 30 different temperature points. And here there's so many weights that go into the individual data points that the user pretty much never has to set these but very often there are reasonable algorithms that we need to procedurally set these weights. So I'll talk about these a little bit later. And once you have the objective function then you need an algorithm to efficiently minimize it. And because this is a least squares objective function there's a trick called the Gauss-Newton approximation that we are able to make. And that's shown in this equation here. So if you want to estimate the matrix of second derivatives or the Hessian of an objective function with respect to your force field parameters, you can first take a general second derivative and you will find that it consists of a product of the first derivatives of your properties and another term consisting of the second derivatives of your properties and the Gauss-Newton approximation simply just omits this term and that's going to give you this approximate Hessian that you can use in a Newton-Raphson type of minimization and that is what force boundless uses. So this is the equation for a parameter update where the mathematical parameters in iteration I plus one is given by the current value of the parameters times the inverse of the Hessian where we add a multiple of the identity matrix to the Hessian before inverting it. And the larger a multiple you add the smaller step you take in the closest and the closer it is to steepest descent. So the value of lambda that we choose is often is such that if you have a specified trust radius lambda is chosen so the step is within that trust radius or you can do a line search minimization over lambda in order to minimize the objective function along this curve of all of the possible regularized Newton-Raphson steps. Force boundless also implements the BFGS Hessian updating algorithm but we don't use it because this Gauss-Newton method is already quite efficient. So I'm just going to go briefly into the theory for the two most important targets that we use. So one target is the liquid thermodynamic properties. And this allows the simultaneous fitting of up to six thermodynamic properties. This includes density, heat of vaporization. They're all listed up there over a range of temperatures and pressures. And the way this objective function is evaluated is that one constant pressure simulation is run for every thermodynamic phase point. And when the simulation is run we save the trajectory frames at intervals. So you can imagine you might save 1,000 trajectory frames at picosecond intervals for a one nanosecond simulation. And for these safe trajectory frames we calculate the potential energy derivatives with respect to force field parameters using a finite difference approximation. And if you have your potential energy derivatives then you can calculate your thermodynamic property derivatives without having to run a separate simulation. So this is an important cost-saving tool which allows us to estimate the variation of the density with respect to all of our force field parameters without having to run a separate simulation for each parameter that we want to optimize. Okay, so force balance implements this fluctuation formula allowing these properties to be optimized more efficiently. And this is the other kind of target that I want to talk about. This is the ab initio energies and forces. And this really just allows the fitting of single point energies and forces to pre-computed quantum mechanical data for a set of configurations. So in this talk I'm not going to make specific comments on which level of theory or basis set is the most appropriate that will come later. It is something I've thought about very much but force balance is going to assume that you've pre-computed these values and you're just fitting the force field to reproduce these values. And when we are fitting ab initio energies there are a few special configurations. Dave Saroudi taught me a lot of this a few years ago when we talked on the phone. And so the weighting scheme that we employ here emphasizes configurations that have a low quantum mechanical energy under the hypothesis that they're going to be more thermodynamically favorable in the simulation. And also, even though what you're seeing here is a scatter plot of QM energies of x-axis and MM energies on the y-axis you can see that the scatter plots are not very symmetric. And that is because we want to avoid at all costs molecular mechanics energies actually underestimating the quantum mechanical energies because if you have that situation then your simulation is going to give you the wrong equilibrium structure which is in a sense the zeroth order or most serious error that you can run into when developing a force field. So in this scatter plot here I'm showing you a bunch of energies calculated at different configurations. The blue dots correspond to the original values of the parameters and then the orange dots correspond to the quality of fit with the current parameters. Okay, and you can see that not only are we closer to the diagonal line but we have a very small number of points that are below the diagonal line. And I think this asymmetry is important when fitting quantum mechanical single point properties. Yeah, okay. And just to briefly describe the broader capabilities there is a wide range of targets and simulation software that are supported such as binding energies, vibrational frequencies more recently we implemented surface tension and there are also multiple simulation software packages that are supported such as Amber, OpenMM, Girlmax and Tinker. More recently as of last month we have an early version of Smirnoff force field support in force balance. So you're actually able to optimize the Smirnoff parameters by running a force balance calculation now. At the moment the open eye commercial toolkit is still required until the open force field toolkit implements the RD kit support as we talked about earlier. And most of the codes that force balance implements are specific only to the target or only to the engine. So if you want to fit a particular target using a particular engine and force balance doesn't support it yet only a minimal amount of code is needed in order to enable that particular optimization in the matrix. Okay, and as a last note because these calculations can be very computationally intense they have a big cluster you might wonder, you know you don't want to just run it on your laptop you want to use the cluster resources, right? So force balance has an interface to a library called work queue which supports computationally intensive optimization jobs by evaluating individual targets or individual simulations within a target of remote computer resources. And the full disclosure here, work queue is not BST license because I didn't develop it but because this component is optional the copy left license does not infect force balance and I've actually spoken that length with the author of this package and he's happy for us to use it in this way. Okay, so that's the situation that we currently have but it's fully possible to use force balance without using work queue. And now I want to just very briefly go over some more concrete details if concrete details are helpful to wrap your head around this kind of abstract calculation. So first, this is the installation procedure if you are starting from a clean environment, okay? And this would not have been possible if I were not instructed on good packaging practices as part of this collaboration. So you can see that force balance can be installed through Conda and all of the dependencies of force balance including the open force view toolkit can be installed through Conda as well. And the last two lines here, I've asked you to clone the force balance repository from where it lives on GitHub because the code contains example calculations that you can then run, okay? So force balance is runnable without too much legwork out of the box but if you want to say use force balance with Gromax or Tinker or Amber you need to install that associated software as well. So these instructions include installing OpenMM along with the open force field toolkit. And to set up a calculation I mentioned in the very beginning that you need to specify which parameters are to be optimized. And here I'm showing you five lines that come out of a Smirnoff force field parameter file. This, the line in quotes here is a smirk string. So this is a pattern match for atoms within molecules and the values of the parameters are defined in red here. And the parts that force balance adds are in blue. So if you add an attribute called parametrize then force balance is going to recognize arm in half and epsilon are numbers that need to be optimized, okay? So parametrize is the part that force balance reads and there is something else called parameter eval which allows a parameter to be evaluated as a function of another parameter. And this is a brief overview of the directory structure of a calculation. So to run force balance you need to have two main folders the force field folder which contains your force field file and your target folders which contain your, which contain your individual data sets and associated simulation files. And I thought that for my very first Smirnoff optimization I will optimize a model of ethanol, okay? And here we have the liquid properties of ethanol. I have the, I guess I should have included water as well, right, because it's not pure ethanol. But this includes the density and heat of vaporization of ethanol for two different temperatures. I've also included a one-dimensional torsional energy profile for the ethanol molecule as I rotate the bond between the carbon and the oxygen. And then there is also an input file that force balance reads in order to read the settings of the optimization. And the setting up of the targets is always the most time-consuming part of setting up a force balance calculation. But the good part is that once a target is set up they pretty much don't need to be modified anymore as is evidenced by all of the water models that we published using basically the same set of targets. So, and this is kind of a snippet of the output of force balance as a text file. You can see that it's printing out the, it's printing out the density and the heat of vaporization. The reference values from experiment are in the third column here. The calculated values of density and heat of vaporization are in this fourth column here. It's also going to print out information about the quality of fit for the one-dimensional torsional energy profile, as well as the objective function value. Okay, so this is at the end of the, this is like before we've taken any optimization steps. And after we take the first optimization step, you get some updated property numbers that I've shown in purple here. And you don't need to stare very long at these numbers because I'm going to show you graphically that the values of the computed observables are now much closer to their reference values. And the next slide I want to show you, this is the graphic summary of that example optimization that I ran where the black curves are the reference data. So we have the density at two different temperatures experimentally measured shown in black here. And the iterations of force balance are shown in red, orange, green and blue for the initial parameters and then the first step and the second step and the third step. And you can see that the initial values of the parameters predicted density that is close to, but still has some distance from the experimental numbers. And after the first optimization step, we're already much closer to the experiment. You can see the same story in the heat of vaporization that pretty much one optimization step is all it takes to bring the agreement, to get close enough agreement to experiment to within the error of the simulation. We have about eight parameters in what we are optimizing here, including the Leonard Jones parameters. And here you can see the results for the one dimensional torsion drive that the initial Smirnoff parameters are giving the red curve compared to the black curve. And by the time you have two optimization steps, there's no more improvement in the quality of fit there. And this last here is a plot of objective function and the gradient norm showing you that both of these values have decreased significantly by the time you've taken the first optimization step. So here, this quasi Newton approach really is able to get us to a pretty decent looking minimum after just one optimization step. Okay, so in order to, I'm sorry for the strange audio, it might be the jacket that I'm wearing. Oh, sure, sure, for anyone listening in through Zoom, I'm not sure if your microphone is on. If you could turn it off, that'd be very helpful. Right, okay, yeah, I think it's better. Okay, so thanks. So, and this here is just a very short summary of the files that force balance produces. So force balance is going to produce a folder that contains all of the intermediate calculations and results. So if you really want to dive into the results of the optimization, you go into this folder and you can look at all of the associated simulation files. There is also a folder called result that contains the force field with the optimized parameter values. And there's the output file that contains all of the results that I showed you graphically as well as the, as well as a checkpoint file for restarting your optimization from where you left off. For example, you might add an extra target and see what happens to your parameters there. So for what I'm about to show you, I would like you to sort of appreciate that setting up these target folders is not very easy. And also trying to make sense of these optimization results is also not very easy. It took me about two hours to make this slide by messing with Excel, it was pretty frustrating. And so you might think that you might want to look at your optimization results more at a glance and maybe have something a little bit more interactive for setting up and running your calculations. And that was the motivation for a sub project that we started about six months ago supported by, supported by MOLSI, the Molecular Simulation Software Institute. And so my postdoc, Dr. Yudong Chiu, really led this project with support from the MOLSI fellowship. And he did basically develop the web interface for running force balance calculations. And this web interface, I just use it running locally on my laptop so you can think of it as a Jupyter notebook, although you can also imagine deploying that on a server and also connecting it to the server, okay? And so thinking about this web interface, mainly as a graphical user interface, it gives you an interactive wizard for setting up targets, which is going to make the workflow a little bit simpler because you can validate step by step to see if there's any problems with your files. It will also give you real time feedback and visualization of optimization results. But once you have a web interface, it's now difficult to reproduce the sequence of clicks and choices that a user made in setting up their calculation. So really what the web interface does is that it's still going to produce that force balance input file and directory structure and run the same optimization that the command line program is running. Okay, so and really our main, our goal over the six month project period is to get all of the fundamental components in place so that somebody not very skilled in web development like me can fill in additional features by following the examples of the existing ones. So with the help of the technology working, I would like to do a little interactive demo of this. So I'm currently in the folder containing the code that runs the force balance web server on the back end. And I'm going to run, I'm going to do run.py. And then when this runs, it's going to give me, it's gonna give me a URL to go to. So I'm going to copy it and go back to my web browser. And now I'm going to paste this URL in here. And now it brings me to the force balance manager web page which is currently blank, okay? So and it says, no project exists. Please click create projects. I'm going to click the create project button here. Let's see here. Okay, and now I can choose a name for my project. So basically a force balance optimization. I'm going to keep the default name and then press the create button. That's a, and now this brings me to the setup of the force field and the target and the optimization. And when I input a force field file, I can do this simply by navigating to the file location, going to force field. And this right now only supports a Gromax force field file. I'm going to fill in the Smirnoff support later. But once the force field file is loaded in, you can see that it is parsed. And then the values of the parameters to be optimized are displayed there for you. And next I'm going to set up a single target. So I click this create new target button and that's going to launch the wizard for creating the target.  And this is going to be fitting ab initial properties using Gromax as the simulation engine. So I'm going to launch the target wizard now. Okay, so the target wizard is launched and it's going to bring me through a series of steps to upload the files that are needed for building the target. So if I go into the target folder here, navigate to the correct folder. And if I provide the grow file, it can check that the grow file is valid and visualize the molecules. Okay. And going to the next stage, we have to upload the quantum mechanical data which force balance requires in a format called qdata.txt. So let me try clicking on this button here. Let's see, I have a little bit of trouble clicking the button. Okay, click next here. Okay, and now it's time to upload the qdata.txt. I'll hit, I'll click this button, navigate to qdata.txt and upload it, go to the next step. And by now you've gotten the idea. So I'll go through this as quickly as possible. I'll upload the mdp file which is the Gromax to run parameter file as well as the Gromax topology file. So now that these are all uploaded, we click the validate button which tests that the target has been set up correctly. And then now I've hit the create button which means that the target is created. And next I can change the settings of the optimizer. This is similar to just editing the input file but with a web interface, you have the flexibility that it can show you which parameters are relevant for you to edit without you having to go through all of the parameters that are available. So I make some simple modifications. And then now I run the launch optimizer, okay? And then, now if I, and now if you look at the status icon on the right, the optimizer is now running. And if you click on output, you can see that the force balance output is being produced as it takes the optimization steps. So now we are on iteration two and then iteration three is going to be produced as it runs. And I think that I've set up the optimization so that it's going to converge after three iterations. So if we click on results, you can see there's a plot of the objective function there. So the basic idea here is that we just have the basic functionality of the web interface in place. And it shouldn't take a lot of expertise in web design or development to just put in the other targets that are needed and to add some extra cool visualizations and so on. So I think that will be a helpful tool for anybody who is interested in using force balance in the future. And in the time that is left, I pretty much only want to have a short discussion of the future plans, okay? So this slide is very detailed. You don't need to read all of it. And a lot of it is there just for me to basically remind myself, okay? But the way the force balance is going to be involved in this open force field effort is that it's our near-term plan for creating the next generation of the Smirnoff force field where the parameter types are all the same, but we are going to optimize the parameters themselves, okay? So the Bayesian optimization, which John Kedera is going to talk about next, that's going to be phased in as it comes online. And then the next bullet point is that in order to optimize Smirnoff, we're going to need a lot of quantum mechanical and experimental data, and managing all of this data is going to be a big challenge, okay? So the quantum mechanical and experimental data generation and organization is going to come from, like for example, the QC archive sub-project, the torsion drive sub-project and the curation of experimental data from thermal ML. And these are things that they're going to hear about in the rest of this meeting today. And parameter fitting will initially proceed in a piecewise fashion as parts of this infrastructure come online, but once we have all of the data in place, then we can carry out a fully coupled optimization fitting all of the parameters to all of the data. And the rest are some detailed descriptions of what are the remaining tasks for force balance in the next 12 months. So one part, which you're going to hear about more in tomorrow's talk, is that we need to develop a procedure for generating data to fit the bond and angle and improper dihedral parameters, okay? And the tasks specific to force balance would be, for example, the calculation and storage of optimized geometries and vibrational modes in an online database. The online database that we're using is called QC archive, which was created by Molsi, mainly Daniel Smith, who is here. And for many molecules, perhaps a vibrational analysis is not enough. You need to scan along the degrees of freedom where you expect larger displacements. So we need to detect what these, what these potentially soft degrees of freedom are and then scan along them. That's another part of the project. We need to create targets by downloading data from QC archive. So these are all kind of like reasonable tasks that need to be done in order to fit this large set of bond angle and improper parameters. And once all of this is in place, we're going to build a set of molecules and execute the workflow to generate the data and optimize the valence parameters. And I'll be doing this in collaboration with David Mobley's group and David's students. At this point, I just want to mention, give a small pitch that my postdoc who developed the web interface is in need of funding to do research for the next three months. And I was thinking that this part of the project might be a good fit for him. So if you happen to be, so if you happen to have governing board duties, I'll post a short document to that channel for you to look at shortly. And then moving on past the valence parameters of bonds, angles and improper dihedral, we're moving on to the torsions. And there's an entire talk devoted to torsions where you'll find that much progress has been made and there's still much to do. But most of the tasks that need to be done are outside of force balance right now. So that's going to be an upcoming talk on torsion and fragmentation. And there are some other parts of force balance related tasks that are a few months out. One such task is to fit Leonard Jones parameters to experimental data on a few hundred liquids. Okay, so you can imagine this is going to, this was going to take a lot of computational power and we might just barely manage it for a few iterations, right? Like it's like we're going to have to manage all of that data and get it somehow. You know, it's very hard to do a Google search for every single property you want. You can't tell how reliable the data is. So using a government-carried database such as thermal ML is going to be very helpful. The automatic, like the automation of simulation setup is going to be very important. And there's some important infrastructure components that are needed as well. Okay, so as I said before, force balance currently will modify force field by writing out a new file and reading it back in. But the open force field toolkit provides an API for directly modifying the parameters. And by taking advantage of this API, we expect that there will be significant performance improvements to come in the future. Such as, if you want to evaluate the effect of changing a parameter on the energy, in principle, you should not have to reevaluate the entire energy, including the particle mesh eval part if you're only changing a bond parameter, right? So if you change a parameter through the API, then the software might be smart enough to know that. But if you write out an entirely new force field file and set up a new parameterized system, you will just end up doing a brute force reconputation of a lot of components. So this infrastructure project is really going to help with optimizing performance. And another important property, another important optimization that we are going to do is we are going to integrate force balance with a separate property calculation tool that a subgroup of the collaboration is working on. I think this is tentatively called the property calculator. And the key groups working here are the shirts and kadera lads, as well as Simon Boothroyd, a postdoctoral fellow who is mainly working on this. And this is going to allow the use of reweighting and surrogate functions to greatly accelerate thermodynamic property estimation. Basically saying you don't have to run a separate simulation every time you want to estimate the simulated properties at different values of parameters. Going into the longer term, we're also interested in fitting the parameters of semi-empirical charge models to experimental data that's going to involve some integration with efforts going on in Mike Gilson's group, in particular Mike Schauperl and Paul Narenberg has provided a lot of meaningful help here. And this is something that I see a few more months out because there's still some fundamental research being done on the semi-empirical charge model part. And then here's some current challenges and limitations of force balance to be aware of. For example, you have seen that it's important for the user to define a lot of things, right? So that has the prior widths, the pre-determined parameter types and the target weights. So Bayesian optimization is a possible long-term solution to a lot of these important problems. And something that I'm currently grappling with and have grappled with for a few years is that it's difficult to define convergence criteria when the objective function contains statistical noise, which happens if you are simulating thermodynamic properties. Okay, so that is, and possibly with some more involved collaboration with the property calculator group, we might finally work past this very long-standing problem. So I think that's all I had for my talk and I'm interested in any questions you may have. Just a quick question on bookkeeping. So are you gonna, how are you gonna label each version of this so they know which parameter was used and what it looked like in the database? And so they know what happened in each calculations. So I think John may have a better answer than me, but the very basics of it is that when we store data in QC archive and thermal ML, is that it's going to contain important metadata or provenance information, which will let you know where that data came from. I hope that partially answered your question. Are you asking about versioning the force fields and the inputs to them? Yeah, yeah, we intend to version control all of the stuff that goes into each generation of the force field and then keep expanding that and released version force fields as well. Hi, I have a question about the objective function, like how much user control there is over the objective function? And if that comes into your cool website, GUI. I think that at the moment, we don't have much fine grained control over the objective function. Although the intent is that for liquid property targets for example, that you should be able to control the weights for individual properties, as well as individual phase points within each property. So currently, this can be done through direct editing of the files in the target folder, but the web interface currently doesn't support that. Thank you. Hi, have you thought about, put any thought into using solid state properties as target properties in particular? I mean, a lot of the molecules we deal with in pharma, we never see the pure liquid, but we can get small molecule crystal structures, we can get melting points, we can get thermodynamic solubilities, stuff like that. Very good question. We have the very rudiments of that. So you can fit the density of ice, for example, in the development of some of the water models. I included the density of various ice phases at different pressures. And maybe just going one step beyond that, it should not be difficult to implement the fitting of the lattice constants, but that's all of the thought that I have put into that problem. If there are any particular targets that are very helpful for solids, I'd be interested in adding those. It would be great to include crystal, like CCSD data, for example. Thermodynamic solubility is something that, we're increasingly having to optimize for within a series. So if we could be able to parameterize against that before we design molecules, that'd be really helpful. Right, yeah, I think that I think, and David Mobley might give a more accurate answer here because he created this free solve database of solubilities. I think we're initially looking at a validation, right? So a solvation free energy, right? Hydration, specifically. But that's different from the thermodynamic solubilities because that includes the crystal. But if there's data you could share too for public molecules, please find us. I've got a question towards overfitting. So basically to prevent overfitting in your objection function, you include some soft constraints to your initial parameters. That's what you said? That's correct. Yeah, that's what the regularizer is for, right? Yeah, mm-hmm. Is it time for a coffee break? I think so, all right. Thanks, everybody. Lee Pink, again.


And honestly, that is probably the thing, Michael, I don't know if you agree with this or not, but that's probably the most important decision that you and I made was to go into retail because had we not done that, there are so many knockoffs out there and there are so many people who are out to rip us off. It would have been someone else, one of those big as seen on TV brands who would have ripped us off. They would have gotten the foothold in all of the retail channels and they would have become the brand. So if we had followed the sharks advice, I truly believe that we wouldn't be out of business today, but we would not be nearly the company that we are today. And that's because we decided to go into retail, which was a scary and a dangerous decision to make, but a lot of made it.


Good morning, everybody. I'm Tommy O'Brien, company live from TFNN and we have with us today Tommy O'Brien the fourth. You say hello to everybody. Did you say hi on the program? He had a good hour last hour. He's done for the day though.  You tired? He's ready for a snap already. Folks, it's busy. Tell him it's not easy doing an hour of programming in the morning. Tell him, folks, markets accelerate into lower prices right now. You've got Microsoft earnings putting a hurting on the cloud. NASDAQ 100, you're off by 2.3% right now. And boy, you take a look on a five minute basis. It's been a quick drop ever since Microsoft earnings call talked about slowing Azure growth, but even since above 3.30 in the morning, you're talking about being down another 200 plus points, 200 plus points. Oh, are they breaking open the Thomas toys? We got all the toys, folks. We got dinosaurs and trucks. We got Mickey Mouse. We got Mater. We got a tablet. We got seals. We got dinosaurs. Tell him, Tommy. No. What's your favorite dinosaur? Did you tell him Triceratops? Yeah, he likes Triceratops. What do you like? Stegosaurus. Oh, is it? What's this? Stegosaurus? Oh, and Thomas the train. So we jumped to Microsoft shares this morning, folks. Yeah, down 4.4% right now. Amazon is getting hit in a big way for AWS down 4.6% as well. We jumped to Google shares. Google off 3.4%. Apple trading lower right now off 1.8%. We jump over to companies with their numbers tonight after the bell Tesla. After the bell Boeing, we get, no, they already came out with their numbers. Excuse me, Tesla. Lamb research. Yes. LRCX is their symbol. Yeah, off 3.7%. And yeah, this is a dicey one, man. S&Ps. It's not stopping down about 62 points. And the one thing I want to comment on, if you didn't see it when I was talking about the program folks, talking about Microsoft numbers here, the one to keep in mind of when they talked about Azure, okay, in a full December quarter revenue from Azure was up 42% in constant currency. But in December, that growth was in the mid 30s. So that's combined for the 42%. So that means that in October and November is growing at greater than 42%. It was in the mid 30s in December. It's going to drop even further from that for the current quarter. So Azure not grown at the rate they thought. Stay tuned, folks. Basil did his program at eight. That's coming up now. Then of course, we got our man Steve Rhodes live at 11 live programming all day, folks. Thanks for starting your day with me. Say bye Tommy. Bye. Bye everybody. Bye.


So in this video guys I'm going to showcase you how you can get the treasure seekers along cult which is pretty amazing and also at the same time solve the puzzle and the treasure map from the quest of solved by the bow today I have you covered. So I do have many many secrets between Hogwarts legacy and this treasure seekers long cult is another one tied to a riddle tied to a puzzle that you will have to solve and I have you covered today. But now I have your attention people if you do enjoy this video leaving a like really helps me out and if you like what you see and want to see more Hogwarts legacy be sure to subscribe. Okay so to start this quest and to grab the treasure map you need to come to this point on the map right here real down south. Now this area is occupied by a lot of hard hitting enemies if you are a low level but if you got your broom guys you can simply just fly around this area and then just fly into the corridor where this door is hiding Henrietta's hideaway and simply just enter it. Now once you are in here the first room is pretty simple to solve you can see there's two uh what are called dice and platforms that you need to access and either side of the room guys there are statues that spin around when you use incendio by them. The one on the right will reveal a chest for you and the one on the left will reveal the second dice that you need. So once you've done the one on the left you need to grab this this dice with the spell accio and pull it and place it on that second pad. Now once it's on the pad guys if you look closely at the dice you can see that they have symbols on them these symbols match your spells. What you basically need to do guys is hit these dice with those spells. So the one we just grabbed is again incendio and the one on the right is glaciers so just do that guys and you are good to progress on through the door. Now what I will say is this cave system is full of hidden passageways where you can find loot and treasure but what we're mainly in here for is the map but if you do want to explore be my guest. But I'm just going to take you on a direct path to this map and how you get there. So this next room you enter you will have to take out all of these guards so do what you gotta do people here. Now once you're done with this room from the dragon statue in the middle of it you want to come over to its right hand shoulder and make your way left up and around this staircase. And then you'll eventually guys come to this section here where if you stand on its platform it pulls you through the wall.  What you want to do here guys is drag and pull using accio this flaming torch right here onto the floor it will pull that you can simply then just run across. You will then come round to another room full of enemies. Again guys you need to take all of these enemies out. Once you've done this guys Dan on your right hand side of this room is where you need to go. And going down here and standing next to the room you'll see that the wall does actually disappear. Now I'm not sure you can actually run down here without killing the enemies you may be able to that's something I didn't try so try that it may work for you. It saves you trying to fight all these enemies. Within this room there's plenty of loot for you to pick up but the one main thing you want to grab is this note this map. So grab this musical note. Now to get out of this system make it easier on yourself. You want to grab this dice again using that spell of accio and you want to bring this into that main room we just left. Within this main room guys there are two pads for you to place these. With the other dice up on this platform right here where there may be an enemy you have to take out on.  Now place these on the two pads as you can see me do right here. One dice requires a lever also and the other one again requires incendio. So fire those spells at these dice people then you'll see that door does open for you. Within here there is a legendary chest so grab this then simply just stand on that platform. Activate that statue and spin around and leave this area. So once you are out of this area guys you need to come to this point on the map you can see me going to right here. It's basically a castle now this castle is full of hard hitting enemies. But guys you don't have to fight for them if you fly around it and look for them bells. As I do you can simply land next to them and solve this puzzle. Now once you are here guys you need to look up at these bells and shoot them in a specific order. Just copy what I do on the screen now people you don't have to do this in real quick succession so you've got a bit of time to play with just fire as I do people and you are good. Once you've done this right you'll hear that Harry Potter theme and then a chest will open up next to you and will reward you with this amazing treasure seekers lung coat. And there we have it guys a puzzle solved. Guys if you enjoyed the video leaving a like really helps out if you like what you see and want to see more Hogwarts legacy be sure to subscribe and hopefully guys I will see you on that next. One.