Home Assistant 2023.7 Release Party

once Paul was click yeah yes right okay I think we're live you think or you know I know all right yes is everybody ready it says live pretty red how can you be ready for this hello hello hello everyone yes um let's go yeah indeed welcome uh home assistant summer edition at home Assistant 2023.7 release party um we're here to uh to party and to release um yeah so yeah again welcome everybody uh we're gonna do a quickly around introduction uh lots of new faces today um just be good to like get to know everybody my name is paulus Krause I'm the founder of Home assistant almost 10 years ago minus two months it's pretty cool um yeah and that's uh that's me hi I'm Frank and I'm mostly work in the home assistant project and you might see me from the release notes and doing the releases at this point Alan hi I'm Alan and I contribute to the nest integration and some of the calendar Integrations hi uh I'm Adelina I'm the I just started at nabukasa um two days ago and I'm the product design lead for this new product and design Department yes and we're going to talk about uh about that in a bit as well but I think we should first kick into the release because I guess we were planning on a small release after the last release was pretty big and we have failed so um I think there's a lot to call for yeah the last release was like oh this one is huge and this release was this one is even bigger what happened well Ellen happened I would say yeah all right let me uh Kick It Off yeah let's do oh it's my screen okay yes yeah let me resize a bit and so it fits better I think that should be possible we yeah and this piece a little bit more out of it I think this is it oh here we go boom 27 July yes it's my birthday month your birthday month yeah oh yeah right yours not home assistant September I believe yeah right so first thing to notice are new Integrations should we get stuff with that yeah let's do it all right first one here uh is this recovery yeah you probably misspell it on some places as well like uh whatever and so it is an integration that can integrate um some smart meter electricity meter and gas I believe even as well so if you have a compatible meter you can pull in your energy data I know into home assistant so that's cool and this is German right I think I don't know my five seconds Googling it's a German company oh well the this well I'm not going to try again never mind then we have uh on the right of it we have Dremel and Dremel is mostly known for their hobby like tools and such like the Dremel multi drill tool I'm not sure what the name is but something like that but they also make 3D printers so if you have one of those you can now pull data from your printer in you know when it's finished Printing and do a notification and things like that so that's pretty helpful on the bottom left we have locked and locked is a well it's a lock for your house yeah it's locking it yeah it's kind of a thing in Netherlands right yeah yeah absolutely so there sorry I have a little like itching my throat but the the locked is like I believe it's like a police certification for insurance and such they have like a three-star rating of two star skg rating or something like that Netherlands so it's pretty pretty interesting to see but they now work with home assistant so that's nice and then we have Ranson and Ransom is um an air ventilation system for your home like air circulation and you can connect home system to it and we'll provide you all kinds of data like sensory data of the air quality that goes through it like the amount of air but also like I believe pollution kind of deals like that's good yeah that's nice so three new four new Integrations you know it's forever growing right I feel like there's like I know how many we have right now but it's uh it's a lot yeah I'm trying to think of a number but it's high yeah I know if I try to open a folder that contains the mall that it doesn't work because it's just too much it stops at a thousand so it's at literally over a thousand it's 1164. there you go it's checked yeah that's that's wild by the way because that's not just devices that's apis right like lock the smoke blocks like I mean Z-Wave has whatever 50 000 devices it's even worse I would say yeah matter is five [Laughter] oh wow all right so uh let's dive into the main features of this release do you want to start with the big one let's do it let's do it so Alan do you want to talk about what you've built yeah yeah where to start yeah so I mean this is something we've been talking about I was looking at it and I think we started talking about it I mean at least I started talking about it with you folks about a year ago but I'm sure you've been talking about it about longer um but yeah I guess the summary is you know service Services can now respond with data uh I guess kind of stepping back you know I started thinking about this kind of uh with respect to calendars kind of seeing you know how could we make calendars more usable or easier to use and kind of reading the community forums of all the crazy you know good ideas uh that people have or what they want to go do and thinking like you know how can we kind of go you know unlock some of these things you know for myself for example just simple things like wanting more flexibility than you can get from the existing calendar with kind of one event at a time has been kind of one one thing I've been thinking about so for example you know I look at my calendar I've got many events throughout the week and maybe a couple events ahead I've got you know I'm gonna go somewhere and a particular location and I want to maybe track that location or something a little more Hands-On right so there's all kinds of really interesting use cases we could talk about but anyway kind of started thinking about you know what's kind of the the right way to go explore this and I think prototyped a few things I think we ended up on kind of services with with response data as the way to kind of go forward here yeah um so that's kind of like the the intro but I know we'll kind of talk a lot more about it so well it was kind of interesting right because we we explored Alternatives rightly we had what we call data sources and data source has been interesting because data sources initial time that I that we proposed it it actually resulted in the trigger being added to template entities where like why do we need like new places to get data we can just have like triggers like get data and then update entities which actually solve part of the use cases that we had initially architected for but then the template was like a whole new thing and like we had you know Allen actually built every every idea out there Allen prototype we had so many ideas and I was like sure I will build that and we can see how it works out yeah yeah we had data sources as like a separate platform at some point um then we realized that we're basically mimicking services in every way except for like it can return something and to basically copy paste all that code or make it reusable but like if statements everywhere it was just like no let's just put it in services and let's not complicate everything for everyone yes yes all right that's it welcome to my instance with like a lot of issues but it works for grammar purposes I I've been like misusing this instance for like uh screenshots fantastic and for at least not so over the years it actually like cut butchered very well but at least it contains everything and I know it works because I made screenshots um so uh for example the servers Alan just talked about is the create uh sorry the calendar list event surface which is a new one and um well let's try this one let's pick a pick a Target I think my uh my garbage pickup is a good one to show and let's see what is in stock for the next 10 days 240 hours and I can call the server so originally serverses are something you could call and then something would happen right so you could turn on your light or um I don't know talk all the power plug behind here in both Media Center or something like that and it would also always be like an action that you executed and then it's done if it would fail it would stop the execution of of the surface crib but otherwise it would be like no response at all if if it everything ran it was just okay but now Alan added a possibility to return data so in this case calendar.list defense will this case return like the next 10 days of my waste disposal calendar if when I call the surface I will actually get something new here which is the response and in this case my organic organic waste is being picked up soon that's the next one so this is only one event response which is already great but if I would extend this to like 100 days like that would work I will get all the calendar items back and this is a fundamental big thing right this is uh I was really curious to see what your trash schedule looked like in the next 100 days that's pretty cool yeah now so this has been a very fundamental thing in that like if you go back like almost 10 years right if you look at what the home assistant was built around it was events and we had state state changes fire events and services is to interact with entities and write the states and that has been the foundation everything we've added over the years was always built on top of that right we've added validation of configuration and like entity platforms anti-components lights were built on top of that and switches were built on top of that and Integrations are built on top of that again and now this is actually changing the way home assistant works like the actual core this is adding a new feature to very bottom level and it's a bit I think the reason it has taken so long is because it's hard to kind of grasp the impact of this today like we're taking Tiny Steps right we're like we have two services that support it it's uh list events and then the other one is the conversation agent so the uh talking to assist and it's it's gonna be interesting to see what everybody's Gonna Do With It um We're not gonna like go around accepting every kind of service now like we need to really think about the implications of this because you know we home assistant is not a programming language right some people use it that way but we do want to make a lot of powerful automations possible and I think that we've definitely unlocked that and this is going to be very very cool yeah I think that's why we kind of spent so much time experimenting and prototyping is really thinking about hey what are those you know implications because this is kind of a big a big change right what's the kind of like way we could get started here uh without you know like uh something that we wouldn't you know wouldn't make things way too complicated to use or might have unintended side effects um you know also kind of seeing this yeah you know across a few different um you know use cases of like hey you know we've got more data here that is larger than the state machine that seems like useful for people to use but it doesn't quite feel right to just go you know stick into a sensor and make it super complicated to go use their array like um you know um like a shopping list search or route directions or all these kind of things people have thought about or like ah that doesn't quite feel right for a sensor right I mean that that's actually a really good point right like the the way around this was always to just put everything in the state machine like you would hold here in the state machine what is the forecast of the solar generation in three hours four hours you have like 50 entities and it's kind of like you figure it out and we were always calculating it because the state machine is we are down we're putting the data there in case you need it not when you need it right and so this changes it this is like especially for things that cost time CPU or money right like API calls can cost money um to cloud services then like yeah it's important that we only do it when you need it so this is yeah this is really cool so should we uh should we do the next step of the demo Frank what is the next step of the demo like we didn't prepare anything so you're pretty much anything but um don't get me wrong I didn't know what the next step would be okay well I mean we have so blueprint right yeah um which I think that do you have it like do you have do you have your screen sharing ready Alan I have like uh I have a rebuilt your blueprint in just a script just as a demo for people which I can show as well like we have two or two things here right should we show that one quickly too because like that makes the full story I would say like we have the calendar event and there's another one which is conversation the process so we as we said we have to learn how this will impact home system so we have right now published two Services one is the Catalyst get defense from the calendar and the second one is the conversation process um which is actually talking to the default conversation agent or the one you select and you can basically ask questions like uh how many likes are on if I would call this service I would get a response back with 12 including the data of the things that are on at this point and this is helpful in a way because we could also change to a conversation agent that is open AI so he can do jokes right please let it be an acceptable joke it's Mario so it probably should be uh so right so here's a joke so you could write an Autumn like a like a do a search call in automation uh that actually like returns uh a query from jet TPT which is pretty awesome this is a good joke actually this is uh I was not reading it so right that's a pretty good joke okay not children friend yeah um there's a question already I'm gonna like pop it up I'm getting thick um here's if I can call the service to ask home assistant about the events happened in the past in theory yes but we haven't added services to query the history yet and the reason for that is mainly just because we kind of ran out of time but we also wanted to make sure that the queries we are going to provide are optimized and the history the the database it's very easy to start querying the database and like break things like be inefficient queries that take a lot of CPU resources so for now this this release has not been available if that question is calendar events specifically uh however you can scan backwards in the calendar uh for what it's worth if the data is there in the calendar that's true it's a good question because this is like the thing we things we should be able to do now right in the future or whatever like creating history like um did it already rain today and will it rain today if both answers are no maybe I should put water the garden right like we could go into like things like that for the future which is super exciting at least I think it's super exciting to go that down that path yeah all right so the next step is of course we've shown these two services how do you combine them and so to combine them we have extended the script syntax the scrim syntax is what we're using automations and actions right like an action of automation it's a using our script syntax scripts user script syntax um so yeah let's let's have a look um shall I share my screen um yeah oh sure first off just for my screen I'm just gonna enhance this is just a calendar I quickly added some events today um I hope it's readable yeah so drop off kids at school home system release party pickup kits now let me first uh I put added all this into a script and the reason I added to scripting on automation is because I want to show you the response so open my script so the first thing here is that I'm calling the event list events on the home calendar I've hard-coded the date for now but normally you would just use a duration um and it's by default if you don't specify start time it will use now so you can say like 12 hours next 24 hours but I want to have all events that were happening today so I kind of hard coded for the demo but here you see new field response variable and as you might know within a script we have variables you can set variables you can mutate variables you can update them and so what this happens is that because home assistant knows that list events has a response value you can actually now say I want that response and store it in this variable so now you know in the next step hey the response the results of these events are being stored in the variable events now The Next Step what we're going to do here we're going to call the service conversation process now I'm using a template so the visual editor said uh you got to do the yaml which it's okay um I didn't even do anything special here I just say explain to me how I should prepare for my day based on the following events on my calendar and I just dumped that result of the list events in which it's kind of interesting because this is just going to be formatted as like a Json thing but uh it's being sent to check TPT is smart enough so that's good the 1890 this is chat GPT as well um and the last thing and we haven't even talked about this is that a new feature here is that when you do a stop command in your script you can say I want this script to return a response so in this case I had set up my service call response variable to be processed so the variable process now contains whatever DPT came up with based on my calendar and now I say stop this script and the set the response value of this whole script to the variable processed and what's really cool now is that because scripts can have return values you will be able to take like if you have a piece of logic that you reuse among like five or ten animations you can now move this into a single script scripts can have parameters the data is accessible as variables when you call scripts you can have response variables so all of a sudden you can create very good powerful reusable Logic for anything that you're using and so you could call script inside your service inside another automation store the response of the script and then process on it as you wish so how does this look right now I mean this is uh I'm going to call the surface the response here is from the previous when I was testing it uh oh I messed up give me a second um there's a there's a bug right now where it doesn't show the response but I'm just gonna live fix this for you good demo but basically the thing is with every description now create can have a response yes this is my my chat TPT is also said to be pretend to be Mario by the way but yeah yeah it's like here you can see like first drop of the kids at school then get ready to party like it's 1985 at the home Assistant release party after that oh wow don't forget to channel your inner race car driver and zoom over to pick up the kids because like it knows this event is right after the party right to pick up my kids it's going to be a busy day but with a little Mario magic you'll Ace it Yahoo that's pretty great it's amazing and this means that like if you are using home assistant and you want to have a daily summary when you wake up for example as a notification on your phone you could of course copy all the things I just did or we've actually Alan has built a blueprint that we were also linked in the release notes of Home assistant that this is all right Alan yeah yeah um I can show I should have that blueprint here you could have well I can show that um let's see here in dark mode does that translate well some people ask for it in a chat probably some people will be happy we'll balance it out a little bit okay yeah okay so so kind of the same idea but using a blueprint that I created say hey at 7am I'd like to send a notification I normally have this set to go to my phone but for the demo right now we'll make it pop up a notification in the UI I've got some calendars here this is also my test instance that I've used as well so but this is my real calendar so hopefully this will be interesting um I have it set to do 18 hours so like give me everything that's going to happen um today and I've also got it including the weather and location one thing about the location is it seems like chat GPT also kind of knows that long potentially so it kind of grabs the lat long from The Zone and you can kind of pick your your conversation agent I put in here a little prompt kind of like you know to to give it some you're doing a little prompt engineering here of like the kind of uh you know like hey don't say zero percent chance of participation or precipitation or these other kind of boring things but like you know be helpful generally and somebody said hey the notifications are kind of long sometimes so I said hey let's try to keep it short so oh before you run it one of the features that was added I think this release is that if you close the menu for second you see this small icon next to the conversation agent whenever you pick a agent that is not a home assistant like the chat TPT you can actually directly jump into the settings and configure that conversation agent this is a feature that we added so it's it tries to like you know you can do everything from the same page so this is just the options flow for this config entry yeah okay so this is so this is going to combine this prompt plus this prompt plus there's another prompt in the blueprint as well and so it's going to come by in all of them um so kind of leads to some fun results sometimes so maybe I'll give this a little run and we'll see what it does give it a second and I've got a little notification okay good morning uh so I'm in you know Los Angeles here so the weather is pretty pretty mild so bring a light jacket hey the release party is starting and you know have a great day so pretty cool it's pretty pretty magic right yeah maybe I could also go let's see what's going ahead this week uh so maybe we'll do you know seven times 24 and do the week ahead and we'll see what else we'll see what else I have planned for the week so I'm off work this week so let's see uh what it did didn't quite get that let me try to stay safe and run it again did I forget that okay here we go so you got the home is this home Assistant release party enjoy the celebration tomorrow you have plans for miniature golf uh so I'll see you guys there at the miniature golf tomorrow I'm going to bowling I've got a doctor's appointment so it's kind of laid out my my full schedule there pretty cool I did one the other day for like oh my kids are on summer break or they're they're at summer school and it's like oh yeah it's day two of your kids being at summer school like you know it kind of has pretty good intuition there just given that little data about the the events so yeah this is awesome and because it's a blueprint you will be able to just hit that button in the release notes import it into your home assistant instance you will have to set up chat TPT um or the Google generative AI if you're in the US you can access that one as well and then you know this blueprint will do all the magic for you and of course if you feel like you want to extend it you can of course do the prompt uh The Prompt is access to template so you can just pull in any data of your state machine and if you want to like do more stuff like you can always just you know blueprints generate automation so you can just copy paste that and make it your own automation yeah I tested it out with chat GPT with this current prompt um also with the Google The Google generative AI but I think that one might need some prompt adjustments so I'd recommend modifying the blueprint there a little bit because it doesn't quite pick up on a couple things yet yeah it would be nice to see like like more contributions on people submitting like blueprints related to voice assistant so that like we can make something really powerful and more powerful than Alexa or like Google can never do yeah for sure yeah I'm definitely not a blueprint expert so I'm really excited to see what what folks that are really good at this stuff can come up with it's going to be pretty awesome and then actually for the people making blueprints if you're going to make it share a blueprint and you run into issues where you feel like I cannot express myself correctly like get users to get like the right selectors please let us know right we're happy to extend it to make sure anyone can create awesome blueprints yep for this release we added the if you make blueprints the agent or the conversation agent selector people are writing those so you can give people the choice in the blueprint which a conversation agent is confers to so in this case like open AI but it could be as well another one this is a by the way screen share of the the release notes um the the chapter about all of this so you can read up again but there's the blueprint from Alan she had here and this will import it directly from our website so if you have upgraded you can just import that little blueprint that Alan just showed with a click of a button there okay so um [Laughter] but this is a big one and by the way so I'm I'm I'm yeah thank you again by the way this is going to be huge um for the upcoming time and the upcoming months I'm I'm so curious to see how this will change and the landscape yeah thanks excited to see where it goes and I'm excited to see what people do with this and uh you know get more ideas yeah just one one final note just like with Alan's uh blueprint you can pick a conversation agent don't pick home assistant you need to pick one that is generative AI home assistant only works on like the sentences that work for your language for your convert turning on your home like turn on the lights so if you send it whatever Allen's blueprint is generating you'll just be like sorry I don't understand that will be the response oh yeah I adjusted the blueprint from Alan to include that warning in the ah okay she choose the agent yeah but yes totally right suitable should ask for that yeah all right so big feature number one down 15 to go or something um what shall we go in actually we just go to scroll down the list and see what's slow down yeah all right new entity dialogue for locks so we've been improving locks or well entity dialogues recently and this cycle we've modernized locks and this is how it looks pretty slick looks like a switch a little bit like combined with the alarm control panel because it has a state in between that is locking and unlocking and during that time it will show a little animation to indicate it's busy doing locking or unlocking and um yeah if you have a lock like code like a input code or security code on it it will pop up like the security key path that is also available on the alarm control panel so yeah locks look now shiny and great nice yep it is by the way this is just for the people like we've been it's just a context like we've been updating more info dialogues for like you know a while now and we're almost there like wrapping them all up and the goal is just to modernize them make them Pleasant to use very uh make sure that they work nice on mobile as well no small touch targets anymore um and it's looking gorgeous but yeah don't don't think that we forgot all the other parts of home system that's uh we already have you know Matthias has been working at uh in our cars now for two years um and working on you know all the more info dialogues and now that we're gonna you know grow the team and have we're going to even have a product manager start at nabukasa next month it's a sneak peek I guess um yeah it's going to be awesome the team has been doing amazing job so far yeah this looks great yeah this looks beautiful I like the new dialogues a lot compared to the old ones and I've seen some sneak peeks for maybe hopefully next release we'll see but like those will be mind-blowing at least what I've seen anyway I'm telling too much now I guess let's scroll down sentence triggers also knew this cycle um yeah it's actually a good moment uh to talk about year to voice which of course uh home assistant were having year of the voice year of the voice our goal is that we want everyone to be able to control their Smart Home in their own language using their voice at the end of the year that's kind of the goal and we've been making steps for that we did in chapter one we announced assist which is our uh natural language processing engine it means that you can send the sentence turn on the light in the living room and home assistant will understand that no you're talking about your area the living room know that you're talking about the lights turn them on send back a response saying done and we've been kind of like chapter two was where we added text to speech speech to text we announced that two months ago and this month in July 20 we're going to do chapter three you have the voice um ready when you are it's a slogan this is one of the features that is going to be in there but for the first time we're doing the chapter three like we're doing we usually year of the voice just before the beta or like when the beta started and then like when the release was happening we didn't want to hold this back any longer so we're just shipping it and we're gonna also not talk too much about this instead definitely tune in July 20 um because in July 20 we will host a year after voice chapter three but quick really quick just what is this just because we don't want to like hold it from you you can now uh you can already talk to home assistant like people are using their phones I can actually I I just got a very cool new phone from the Netherlands and actual uh a Payday at the old phone company and people can use these phones to talk to home assistant and now they will be able to register any sentencing home assistant to trigger an automation so you could have in fact you can just trigger an automation to say party time and it will like you know lower your blinds and like play like music Turn on the smoke machine if you have one these kind of things it's gonna be really cool no no responses yet that's something we're working on yeah the screenshot is not inspired by the state of my living room right now by the way um yeah it is so it was yeah oh maybe tomorrow anyways I I did test it it did work good at least I attack him today um yeah okay sounds trigger I think it's really cool by the way it makes it really easy um and I I hope to see more of this yeah yeah oh sorry sorry yeah with this like people can build a huge office of it if they want to yes yeah especially but once we get responses going I think that's going to be the big next thing and like if you have responses going you could even turn Allen's blueprint into like querying home assistant right you can just say what's my schedule today we generate that response which said TPT send it back that'll be really cool oh wow so basically by the way this was already possible Right with the custom intents but that was kind of complicated it had to be in yaml and just being able to add a trigger and then put the sentence in there it's just like amazing how flexible is like the sentence matching there so you have it is a little bit flexible and you can use the syntax that we use to define on normal sentences as you do for the home assistant uh engine so you can do like optional blocks you cannot use uh matching so normally when you write a yaml file you can write like oh here's like a curly brace it's like I don't know uh area or something no area probably works but like you can Define your own list that it should match on like multiple and that is not working here so here you can so square square brackets will you work for optional stuff and I think uh pipes to uh to oars well that's awesome I can't wait for that uh Deep dive next later this month that's cool it has been documented by the way so the the capabilities of the sentence are in the documentation which is pretty cool that's there very cool well there's more to the years of voice here I wanna one um could it work with templates like what a mess in the living room which triggers cleaning the living room living room I'm not sure if you can match on areas right now so you would could of course create five sentences and then based on the sentence pick the area to Target but that's a good idea we should look into that um if we can just match on areas clear our favorable part of the sentence yeah maybe I don't know it's a scientific variable later on sounds pretty cool actually yeah that's a good idea open assist another one for years of voice in a similar way there's now an action that can be used in cards to open up the assist dialogue so yeah it's basically the same as hitting the button in the top right right it is it's 100 the same except that you can configure it right so you can choose to say I wanted to start listening right away the main use case for these is not to add such big buttons as you see on the in the screen right now that's really for demo purposes um the goal is that there's people that hide the top bar there are people that want to have Assist even easier to access they are using wall tablets they are using the new pixel tablet to kind of have like a dashboard ready and we could just hit boom and hit hit the button and start talking yeah I think that's the main use case if you have like a wall mounted dashboard you could like use the the one that I have on the right here in this demo that automatically starts listening so you can have a button on the wall board that you can just like touch and you can start speaking directly and instead of like hitting the microphone again if the top bar is hidden you couldn't reach it even so yeah that's cool cool little addition all right that's all about voice yeah we have a new entity in town we're adding entities lately but this is a good one I would say it's the image entity and surprise surprise it's displaying an image yeah I think the the origin of the the image entity kind of was hacked together it existed before because people were abusing the camera so people would say hey this is not a camera but they would use like they were a camera for vacuum cleaner showing floor plans right I think this QR code was previously a camera as well and the problem is is that if we want to create a dashboard for you that's automatically like organizes your cameras we we need to know if it's a QR code that you don't care about um or this that's actually part of your security system so this is going to help tremendously because we're going to finally split up and we can assume that a camera is important to you that's why you set it up so the cat of the day picture would no longer be a camera but just an image yeah entity which is helpful if you want to list like all cameras and then skip that one right um so it's in in that regard it's not much different from the camera entity except it's like optimized for images too and that's an important factor behind this hole as well because if you have uh put in an image into a camera entity as we used to do then the UI of Home assistant will also think it might change every time right so we'll be pulling on that image because it could be like a camera image that is constantly changing so that's super inefficient for an image that doesn't always change like this QR code or account of the day picture which will only change once a day or a weather reader or things like that that changes every hour maybe so the image entity will only update and be pulled once the image actually changes which is kind of nice more efficient and lightweight for that regard and well also senior to use for your data if you're using it on your mobile remotely for example yeah so yeah image entity that's cool it's my new favorite feature in this release if it simplifies the calendar entity code base that's great having added some complexity to it happy to hear it getting simpler that's great how does it know that an image has been updated so it has a part of the state of the entity is when it changed so Integrations can say okay well the image changed at this time and as soon as that the time changes the home assistant front end will then know like hey something changed that will update the image um another case where this will work is for example we also have mqtt available for the image entity and templates so you could Define your template that like picks up a URL from the cat of the day picture which is a fixed URL but has a Time pattern that says well every midnight and one minutes past 12 update the The Entity then it will re-render that template which is essentially an update which will trigger then the update in the front end to refresh the image so there's all kinds of logic in there that if the back end indicates something changed like a new render or the integration defines that the password change that's in this QR code maybe well then it will update the image nice somebody is saying how dare we skip the cat picture like we keep talking about cats but we haven't shown an actual cat down I I didn't I I wrote the template somewhere earlier this week somebody yes how does this work and it's like you have like catoftheday.com or something and like it has a fixed image path and it's like a really little template uh maybe I will share it later today but it's uh yeah problem solved but things like that are now easy right and a weather a camera like a camera radar weather thingies yeah would be nice too and there are some Integrations that we still need to migrate to the image entity and there's also like a Fritz box if you have that modem it has gas Wi-Fi and can randomize the password or change the password I believe and it also has an image entity now so you could like put that on your I don't know wall mounted tablet if you have guests come over they can just scan the password at that point so those are the use cases people are thinking about which is kind of nice yeah um if somebody wonders what this QR code does it links you to the home assistant home page so just like it's not not a cat so JLo has an issue an issue a question um yeah first of all I mean I just mentioned that we're going to have a product manager start that's actually JLo um but it's uh these are going to start August 1st so next release party I will have him on for sure um if you want but the question is actually interesting a vacuum it exposes a camera with a live position of the vacuum like today a camera entity right like a floor plan map with a with the vacuum on it should be an image or a camera and I would say image yes because it's images it sends over not a live camera feed yeah the the big difference about the camera is that you should be able to click on the camera and get real time like a view of what that camera is seeing a generated floor plan with a vacuum is uh as an image yeah definitely hello hi wow by the way yeah can the image speed animated gif diff Jeff whatever yes yes it's yes whatever works in your browser so yeah but P should work yes SVG should work oh nice I believe I believe sure I'm not sure have you tested it I love the content type is approved okay anyways that's right turn it down uh image entities uh kind of like one of one of the missing things I would say a new thingy to the energy dashboard so Can you spot it I I I didn't spot it at first so it wasn't in the beta released I would say the first time either I was like what so one second right before we jump in uh young has done a lot of work on the image entity uh just confirmed SVG is working so nice great yes built the mqtt part by the way so well thank you there yeah the platform oh wow he's doing a lot of good work by the way not just on qvt but a lot of them keep the theater please anyways a new one here energy dashboard here is the self sufficiency quota uh or gouge let's see this played right here uh which shows you like how much of the energy you produce you are using yourself it also means that the lower it goes the more you pull from the grid which is actually not like efficient right I think this is a nice neat little graph yeah so how can you improve this value I mean stop paying your bills um if they disconnect you have from the grid you cannot like take from the grid anymore oh that's a valid answer yeah you got to run the dishwasher during the times that you generate more solar right that's the if you have solar panels I mean this is all related to solar panels of course yeah that's definitely true so if you use uh the the the energy that you're producing and um as more as efficiently as possible yeah then it will just be go higher the another solution is just to add more solar panels like stack them I don't know if you have your rooftop already full of them but um yeah that's one and the other one would be for example like getting like home batteries right um if you can store the energy and then use it yourself you don't have to take it back from the grid again so this is a pretty interesting graph because it kind of teaches you and learns you how to use your energy more efficiency that you're like producing with solar I think actually it's more interesting than the one above it right self-consumer energy it actually doesn't matter that you don't consume them all yourself right like the goal is that you don't get anything from the grid so if you generate too much you give back to the grid even if they don't pay for you for it that's fine as long as you don't have to get anything from the grid I wonder if you just like I should swap them or even just you know drop the self-consumed like I think self-sufficiency is definitely a better statistic yeah it is yeah I agree so we have a live live product development I am writing this down yeah like yeah please make notes people yeah please um I think maybe you know before we continue with the rest of the release uh maybe you know um I don't know my lady do you want to like share some of your work on home assistant like um because I think a lot of people in this chat even though they have never seen Malay on the stream they've probably seen uh one of the many projects that he's created and shared with the community over the years um in fact it was very interesting I was talking with Alan about service response values and he was telling me like well you know I actually just created this eating screen based on this like project and then he shared Marlena's project uh with me and I was like well guess what who's going to start in Abu casa yeah I'm trying to get my calendar return values on there so yeah it's gonna be awesome look at this one yeah yeah I love that thing it looks so good yeah so I mean you want to talk a bit about show some of your projects Malena uh yeah sure I mean uh well I so how where should I start I mean yeah I've been working on products and ux design for 15 years I guess well 16 maybe even longer who knows but yeah I work on a lot of projects um trillion I don't know if you know that it's like a instant messenger um and then also like things like the UN style of us all that kind of stuff but smart home is awesome well I first started using home assistant when I realized that I cannot use like Alexis simply is not good enough and I try to install it but I run it on an SD card so it didn't work so for half a year I couldn't I haven't really started using it yet but only until I had my surgery and I was recovering I had nothing in my hands I had nothing to do and I finally start coding on home assistance and I think within one month I already coded like like 10 000 lines of yamla of it so yeah so I think one of the dashboard let me see if I can show it um but this is not the this is not on this release and if you don't really want it you can you can find it on my GitHub which one your dashboards looks so beautiful by the way oh I'm gonna let me just share your theme in the chat oh all right oh yeah this one this one yay fun hey this makes me look like an amateur hour what it is that's beautiful it's right yeah [Laughter] this one is cool because like the the background is kind of like the floor plan is like trying it it's simple enough to show what the status is so it's all color coded here anything that is like lit up of things that you need to pay attention to and things that are not uh just information and this is obviously not the direction of dashboard that we're going in because this is like a maximalist approach and there's only one user for this dashboard this is myself so I just add as many things as I like under this dashboard so it's not for everybody um but um let's see um yeah this is like kind of based on Star Trek L cars if everyone knows Star Trek um yeah it's like there's uh also based on like the Metro interface in Windows so the live tiles you can actually you can actually dial things around and you can actually see how good the air quality is right now happy fourth yeah before so everything is from yesterday right yeah yep oh and that's an all right yep look at it scrolling down too much um yeah so that's the dashboard I mean there's like Fred like I tried to like every time someone released like a a new awesome card I try to use it this is the Sanjay diagram which shows that uh I'm turning on my AC right now definitely and the computer is also use a lot of energy and let's see lights um because there's some people they're probably like well I want all of this so just the theme is on GitHub and I think that the energy graph you just showed that it's a custom card right the the energy distribution these are all button cards right now but who knows if we can do any of that in future I think tile car is pretty great and yeah like expanded who knows uh yeah um yeah this is like it has graph in it and the lights um this is cool because the the color of this bar is the average of all the lights in that room um and you can tune it around let's see try a different scene all right oh cool yes that's the light control card and uh well this one is awesome because uh this is kind of like based on my architectural background so do you know that um we we have a certain comfort zone that we would feel comfortable in and it's between 20 degrees to 27 degrees Celsius and 20 to 80 humidity and that's like let me zoom in a little I think [Music] um other uh site from a tree chart or something like that so you can see like each room in my apartment like which in the comfort zone and which one is not like the bathroom is tougher way too hot right now the living room is like you I need to open a window so that's what that is um one thing that's cool is uh yeah this is a way overkill for everything but you know just you know you can see all the temperature in the apartment uh one cool thing that here is that you can see the air quality change in the apartment inside correlated with the air quality change outside and once the fireworks started last night it's basically the air quality pollution just shoots through the roof and you can see that it kind of did the uh dirty air kind of comes into even though I close all the windows so I do turn the whole every file on the whole time so this is the environment uh so this this one is cool too because like I like okay this is uh so so you can see like the whole like outside and inside and the firewall and like in the train diagram this is partially in uh influenced by the subway system between Hong Kong and Shenzhen which is like where I'm from and like you like in order to go between the two cities you live across the border and actually the and uh and so yeah um so yeah this is like a Subway diagram for that and that's what the network I think I'm just like the rest of everybody that's watching right now is going like oh wow oh how how but why and and I don't know just neighborhood you can see all the trains running in the area there's one there's one question here I don't know if people want to know it but it's like how many hours have you put in oh yeah you can you can look at my GitHub history I'm sure I would say it's probably more than five so yeah yeah this one is uh yeah uh the live dashboard this is what Empire State Building looks like right now it's nice to have weather with the actual image of the city right you can there's a two charts going on here one is the the past 12 hours and that's the future 12 hours so you can see like how the temperature is going to change throughout like the past and the next 24 hours and also like the um the stage of the weather as well so that is cool oh and last lot not only it's like oh that's not the spaceship right so you you need to have a astrometrics dashboard which uh shows the solar system and also um yeah just just analyze around the planet and all that kind of stuff um I wonder what chat GPT could do with some of this data summarizing the state of satellites in the solar system yeah because all these like summarizes just template summary on each page and I would love to like yeah to have like tragedy videos from all those instead I could use it now with a template right and then have like a tax Center and fill that with the chat TPT response so you're not constantly hammering cat GPT but maybe do it like every hour or every day or whatever interfall you would like and then pick that response and put that in like a textual template nice that's amazing for now why not you know yeah let's go back to the blog we can always uh have Malena share other projects later so you can come back to this segment later [Laughter] right so now we're talking about dashboards already a bit shall we dive into some changes to the dashboard yeah let me let me actual desperate to the street to the stream yeah yeah let me share with y'all that's happy all right it looks so boring yeah look at my beautiful dashboard this is my office dashboard by the way look how I thought I'm more functional gosh I like to automate stuff minimalist sorry I'm a minimalist yeah I'm just like how can I ever make sure my dad stuff again well uh but thanks for the letter how many hours make it work uh 30 seconds probably so new in this release by the way for dashboards is first thing to notice if you added a dashboard there is now a little number shown one two and three so this is important because why again paulus so yeah this is uh our dashboards are done using masonry and so masonry is an algorithm where basically like it's how you make a brick wall like everything kind of fits in you try to fit everything so what we are trying to do when we you know take the cards for your dashboards that based on the width of your screen you know being on your mobile or tablet or your big desktop computer we're gonna first we have like we call like virtual rows so we try to fill the first five virtual rows of each column and after that we're just kind of like put in the cars just so that like they kind of even out so it's like a square right before we have masonry and we kind of did like one card column one second card column two it'd be just you know one row might be like one color might be super long and the other might be super short just because certain cards are shorter you can already see it in this example right like this is still kind of it looks kind of as even as possible the problem is and I think a lot of people are aware of this the up button doesn't actually go up because when you press up does it move up no it will actually look at the masonry and it might pop up anywhere on your screen now we know that some people don't really like the masonry layout and that's something that we're looking into but we don't have we're not there yet but for the people that use masonry today which is I guess all of you um yeah we made this feature so you can click on the number now and when you click on the number you can actually enter a new number that it should be so you can say hey put this on position one or two or three and so you can quickly move cards around and that's really nice I do realize now looking at this is that the up arrow is actually decreasing the number so that's a bit confusing now right like you hit plus yeah it moves up yeah but that might be weird I don't know we'll look into that um but it's really cool it will help you quickly move stuff around information yeah so some people ask for Dragon drop for a long time right and this is like just the teleport which is not the same and we know it's not the same but why this is awesome and cool at this point is that if you have like imagine you have 20 cards right here right and you're adding 21 and you want to move that one to position number one then you would have to up up up up hit 20 times to get it in the first position so right now clicking on it will just be able to enable you to teleport it to the right place which I think is a major major major uh Improvement already two not drag and drop but teleporting teleporting for now um do you want to show the second one as well Frank now that we're here what is the second one help me out here oh yeah yeah sure of course yeah almost forgot about that one how could I forget so last release car sorry let's call him Tim because his name is Tim um his GitHub name I always like butcher so uh Tim actually added copy and paste support last release to the automation editor and Tim was like well he could do the same thing for dashboards so that's now here which is pretty amazing this means you can now copy and paste any card you can cut it to by the way um any card from your dashboard into something else like a different view but also inside a different card so let's say I cut this one out and I would create a new vertical stack I can paste the previous pasted card cut card in and add a new one based on the same one and again and now I have a vertical stack okay that card pays it twice and this also works with this vertical stack which I can completely copy paste into another one so moving cards around between different views and pasting them into like nested fuse or nested cars that's that that is now so much easier instead of going into yaml yeah there's one one gotcha just that like it only works in one single browser tab so you cannot have like two tabs open and like copy paste in between yeah that's true but yeah I think that the there's uh what JLo's calling out like JLo uses vertical vertical layout for his mobile dashboards with dozen of cards it will not be very easy to switch between different vertical stacks and like yeah move cards around yep so that's I believe all the dashboard changes and if I forgot something we'll get back to this and I should remove the kitchen and coffee maker from my office dashboard otherwise I will regret that later on turning off the coffee that's a bad thing anyways let's go back to the release notes that was the UI changes um yeah this one is for you about this one yeah so by default and until today homeless hasn't always showed all the events that happened in your home assistant instance in the time where you are but at the time of your phone the time of your browser time of your computer that you're using to browse Home assistant now this is great if you are at home but it can also be and it's generally expected that the times you see are your times however it can be confusing because the server has maybe a different time zone if you're traveling or in my case I'm managing the instance of friends and family that I see for example my my parents solar generation and it's like at six a.m in the morning it's peaking well it's actually like they're based in Europe and I'm based in Brooklyn so there it's like during the afternoon of course and so now I can just when I'm browsing their UI I can just say hey let's use their time zone and then I see everything as it happens so I can see oh they did actually come home at like you know 7 p.m and they did it instead of like midnight or something like this right so it's very easier to kind of track what happened in the house why something went wrong these kind of things looking at graphs everything makes sense you don't mix up days anymore so this is a really really cool feature this is really cool a lot of people are interested in this for calendars in particular and so but we kind of always said hey you know we want to be consistent with what we're showing in other dialogue so it's great to have this as a global control that's consistent across the entire UI this will be I think a lot of users will be really happy about this for a calendar in particular yeah a social personal preferences and what you expect right for me personally if I would travel to a different time zone I would open Home assistant I somehow still expect probably to see the local time from my instance and not where I'm at right now because well that's already differentiated in my hat I believe so I'm I'm I think I would be my default but especially if you've managed remote ones like polystars yeah yeah that would be really helpful uh right what else oh right so last release we changed the integration dashboard and this release we changed it again but for good reasons because like in general the new Integrations dashboard was lost and well received so there was it made things a lot easier and the new integration pages are really helpful and awesome but still people found it to like the general response was it was too busy or looked a bit different than other things and do you want that we have in home assistant and the was still like a little bit of height difference in case there was an error message so for this recycle we've iterated on it on that concept the materials made like an iteration on it and Paul implemented it or oh sorry brown or Paul I don't remember either of them um and anyways um it now looks a little bit more consistent to the rest of you why it's the whole header is now clickable right here so you can click on the logo or the title or any part of this top part and it will go to the integration you click on the devices right here the little badges the little indicators that tells you like it's a custom integration or cloud-based integration have now moved from the image into like the right corner it's just a little Slicker and the busyness has been resolved by removing the device icons and all the little indicators that were at a I think that was shown here it's gone so yeah what did you say Marlena oh then it's very nice it's like they are the same height now because the error message is on the second line yeah exactly so even though like it's still the same as before like it's still everything is in the same place so no muscle memory to retrain or something um but just a little bit easier on the eyes and yeah I think it was well done so thank you very much yes oh yeah I love this one so one of those things but like you add it they were like why didn't we do this before yeah indeed let me let me switch tabs by the way and let me just show you how it looks instead so previously if an automation would fail like you like butchered a yaml or you create like a typo in it if you do it manually that can happen of course and you would like restart or read home system then your automation would just all of a sudden like disappear would be not be shown and and where did it go and if you didn't notice it would be gone then how would you know if something is wrong until yeah the time something doesn't work has XXX thank you so when we've changed the cycle is that if if an automation has an issue we still load it we'll still show it and it will show up as this red angry confused Little Robot there in this case this I I destroyed this automation by making a typo and a restart home assistant and I will show up so it no longer disappears to show up and if I open up the automation which is still possible in some cases it will tell you why in this case it says an invalid platform home assistant with Double T has been specified and problems raising his hand thank you bro you did well and Eric too by the way and that's this case this trigger right here which is not correct that's not valid so this is one of the things you need like Paula said and why didn't we do this earlier I don't know but I'm happy it's here it's no longer like disappearing and consistent in how this works so yeah question um because I actually don't know the answer myself does it still need to be valid yaml to show up or if you completely break the yaml world also they will still disappear um if it's like unidentifiable at total then it then it will not like other than your yaml files full year fell out right right if you have a big syntax failure so that will not work so it has it has to have a way to identify the Automation in some way yeah but it is most often it's like using a device that's no longer there or things like um you made a typo like a little typo in the trigger things like that your template you forgot to close something so it's often just things like that that will now be picked up so I think that's cool right in the same category which I can show you is a new dialogue we've added so if you create a new automation screen I'm clicking out here we go so if we create an automation then we would have this dialog which was introduced a couple of releases ago like you could create a new automation or use one of those uh blueprints but for scripts we didn't have that so Tim actually added the two scripts the cycle so right now at a script it shows a similar dialogue with the the script blueprints you'll have I think this is great because I think a lot of people probably didn't realize that there are script blueprints I think so too and especially with uh the the new um response values on Google on on surfaces right this the scripts become much more valuable to create and share Snippets from so blueprints are a great way to share it up with the community there are quite a few scripts if you're looking for them like blueprints or scripts go to the release notes I've added like a link here the blueprint exchange and a community Forum this will probably open a new tab no it doesn't and this will show you all the scripts blueprints that are on a community form so this is filtered already take a look at all the the script blueprints we have which are actually more than I expected it to be so I was surprised to see some cool ones there actually nice all right Jack Jack also done we're not done yet by the way we now have we get going there's so much Bluetooth proxies when I explained I want balls yeah so um Nick bijuako he is always looking into ways he can make home decision faster and you know we're we've been looking uh like one of the things that was still slow and home assistant was actually our Bluetooth uh stack and what we are seeing is that there's a lot of Bluetooth traffic in homes like there's especially Apple devices love to talk and like say hey I'm here I'm here I'm here and those a lot of these packets they come into home assistant and then we throw them away because we can actually use them and so we see a lot of throughput and every packet of Bluetooth had a lot of overhead because we would receive with a Bluetooth proxy a Bluetooth packet and which is an ESP home device right one of the uh the ones you can make for like six dollars um to add Bluetooth to home assistant and the moment it receives a packet on the Bluetooth radio it would immediately switch to the Wi-Fi radio send that packet out and then start to receive the next Bluetooth uh packet but this was very inefficient so what big Draco did is actually multiple steps so we don't parse the packets anymore on ESP home at all we just take the raw values then we group them in groups of 16 and then send them over to home assistant and because of that in home assistant directly fed into the Bluetooth parser and matched up and so it's lightning fast a lot of different parsing steps are being removed from this and we see a great speed up up to like 40 to 80 less Network traffic because everything that you sent between the ESP home and home assistant device has certain overhead like a packet header these kind of stuff and all that stuff can now just be is done once for 16 packets instead of for every Bluetooth packet and what we're actually seeing here is that the Draco has now his recommendation is Bluetooth proxies are faster than even native Bluetooth dongles that you are like the Bluetooth built into home assistant which is insane because this is like browsing your network and like it's being forwarded but the reason for this is that if you use Bluetooth on like Linux which home assistant is based on what happens is that you are you know it has to go through many different layers until it gets into home systems your uh the Bluetooth stick talk so Blues Blues is like the Bluetooth d man it talks to debuffs the deepest there's a lot of serialization deserialization is very inefficient and all that stuff is just not there with Bluetooth proxies because raw bytes are being forwarded so super fast ditch your Bluetooth dongles we're sorry uh now yeah you can still use them it's good but like uh Bluetooth proxies uh they work a lot faster now and the other cool thing with Bluetooth proxies is that you can they can also do outbound connections right so if you have a Smart Lock that requires an active Bluetooth connections that's actually possible with the home assistant Bluetooth proxies now actually what I realized is one step with me I haven't actually sat here is like what is a Bluetooth proxy because we forgot to introduce the concept so in case people are uh new here on the stream I'm just gonna quickly open the Bluetooth proxy page yes so the the reason we use Bluetooth proxies in um in home assistant is because Bluetooth range is very limited and most of you put like your beautiful homes in yellow box in a closet next to your Wi-Fi router and cable modem and no one can see it well the problem is with those closets is that we cannot Bluetooth very far from there but Wi-Fi has a lot further range or even your local ethernet right because there's ESP home devices that work with ethernet and so we create a Bluetooth proxy so that you can create many different Bluetooth proxies add them to your house and from wherever they are they will talk Bluetooth locally to the devices that are close by and all the data that is fed back to home assistant and home assistant is smart enough to work with multiple bluetooth proxies pick the one that is closest to it if there's a connection failure it will fall over to the next proxy because maybe the Bluetooth device is on your body and you're moving around and so it works great it's really fast and you should definitely try it out so if you have one of those for example little FM lights devices M5 stack atom light yeah they sell for seven and a half dollars and we have a web-based installer which is actually the website that Frank currently has open and you can install them from your browser just connect them to your PC like that one selected connect and start installing it and then home system will Discover it if you finish that process home assistant will just cover it and you can add it and then you have like this blazing fast Bluetooth extender you can place anywhere in your home with Wi-Fi and your Bluetooth range will expand uh which is absolutely fantastic and easy to do yeah it's not yeah and the two devices you see on this this page these are two favorites so the Wi-Fi one is the cheapest way to expand it the only Max one it's an Ethernet based board and it has power over ethernet so you can literally just have anywhere you have a Poe switch Poe powered Ethernet plug it in HBO device is powered it's online it's forwarding stuff yeah yeah the performance impact by the way will be the best on uh not only so that's connected devices because well the changes that have been made are mostly profiting from like last switching between Wi-Fi and Bluetooth which of course if you plug it into like a wired connection it's not the case at all so you already had like a good good performance on the radio at least yeah still really cool Tech and if you like to extend your rank in home for Bluetooth this is the way to go it's absolutely amazing and if you're using a Bluetooth device or sorry ESP home device already you could build your own using HP home too right your own firmware maybe add like uh like a temperature sensor and humidity sensors you have that information from the room too and like a motion detection and things like that it's really extensible it's beautiful all right back to the nose I guess that's a yes uh yeah let's do it oh here there's a question from uh from Brian at any plug-in Bluetooth extenders that you can just plug into a wall outlet and forget about it um well the Bluetooth proxies like if you have one of these the atom the atom light that Frank is holding right now it's it's just USBC right so you could just get a adapter cable plug it in it wouldn't look very beautiful but it will work um yeah I'm quickly Googling my ass off to find a good one there's also an M5 stack m u add a mule in this one that's also ESP home based but this is also a nice one to look at because it has a USB connector directly so if you have like a old charger you can just plug it in and get it somewhere so there are multiple options there all right matter updates yeah this one is good right doesn't matter already all right a little bit more Yep is getting better every release and I think that um people had a lot of expectations in November when we launched the medical launch because whoa matters here is going to change everything but it's like this chicken egg right like the home automation controls need updates devices need to be sold all of you need to start buying these devices and start using them and then people start to like care more and more issues are being found issues are being fixed and we're getting now currently and I think last release also really in a place where matter is just it's good like it's it's and for home assistant users like I sometimes hear like matter doesn't bring anything to the table but I think what matter brings to the table for existing power users like probably a lot of people watching the stream is that it's the first smart home standard that works over IP so an existing Wi-Fi if you buy a Wi-Fi iot device in the past it was very likely not going to work out the box at release day with home assistant but with matter based Wi-Fi devices it's actually will work right so I had this Topo link uh the type of switch that I bought the other day a meta device I plugged it in my phone said hey do you want to set it up my Android phone I click yes I click pair to home assistant actually done it was added to home assistant no tp-link app not needed at all local connection encrypted connection awesome so better yeah and what has been improved this release is its performance um huge Improvement to the performance because previously like matter has all kinds of like data endpoints you can subscribe to and then it will send the device will send updates and such um that wasn't really efficiently done at our end so what happened if you had a lot of devices which some people now starting to have um even though there are just a couple of devices available so it's still amazing but some people have some more devices we started to notice like uh well problematic amounts of data going in and out so Marshall has been working on making sure we subscribe only to the data we actually need so there's less data flowing and that's easy to handle so everything becomes more stable yeah that's basically in a nutshell what's happening the other thing is here the the second part is matter Bridges so matter has this notion of a bridge where you can take an existing existing home automation Hub can expose itself over matter and then not just be one device but all the devices that that Hub can control and so uh for example the acara M2 Hub controls the akara ecosystem instead you know home assistant doesn't have to integrate the akara API anymore we can just talk to the akara M2 Hub directly get all that data previously if you would pair a new device or remove a device from your Cara Hub you would have to like restart home assistant and now that's also detected instantly yeah yeah if you add and if I see your car up it will just pop up yeah but the device should be supported with homosexuals so if you have like one of those nicer like uh trvs then well those will now also work because this release we've added climate support for metal devices huge like and actually this the reason this is really big and this is actually also relates to Alan is Nest the latest Nest Thermostat not just all master thermostats only the latest version supports matter so you can actually integrate locally Nest thermostats and talk directly to home assistant there's no Cloud necessary it just works yeah yeah this is pretty great I saw somebody got the nest working on the newer version mine are a little older so they're they're not quite working yet but you know I know we've talked a lot about authentication setup and oauth with with Google devices in particular and so I I think this is pretty exciting for simplifying that journey of getting your device integrated into home assistant it's uh so so people probably don't know but Allen's maintains The Nest integration the new Nest API and the way it works and it's it's pretty complicated and we've tried to easy make it easier but we couldn't like get the right authorization from Google to make like a generic login because of the security practices of the Raspberry Pi as in if there are none um so but but that tends to happen is that everybody had to create their own Google Cloud project pay five dollars to unlock the Cloud feature and then connect their nest thermostat to home assistant uh or the nest all the nest devices like you still need to do that today if you want your other Nest devices right so the the cameras the smoke detectors too I think Alan are there or yeah they're not supported in the new apis yet so I don't know what the future looks like for those but okay yeah but yeah the camera if you want you still need to set up the nest integration if you are an owner of a nest thermostat you don't have to anymore the the one just caveat this is just uh it's already written in the text there are three different Nest thermostats and there's one that is called Nest Thermostat that's the one that has matter the other two Nest thermostats are not called Nest Thermostat but they're called Nest Thermostat e and Nest learning thermostat those do not have matter yet and I think the learning thermostats they're very old I don't think they will be able to Port matter to it I don't know if the E would be powerful enough to support it yeah yeah I think that brand started in around 2020 so that's kind of the reference that I have mine where the E from 2019 so just kind of missed it but I think you know if you've kind of got that one on the top Corner yeah so a Google published is that every Nest Thermostat that was created in 2020 and newer would receive support um in the future that's what the original statement said that I tried to look it up but as far as this right now only the nest thermostat which is super confusing by name by the way if you look at all the others but if you have this one this is that Nest Thermostat these are not apparently um but this one is the the one that currently is supported by meta yeah I was doing a similar exercise to figure out if my Hub support it was a border router or not I'm like okay you look at the little details like is there plastic on the corner then no otherwise yes and they're all named very similar yeah I'll link this in the in the release notes it was just too hard to figure out at all anyways um anyway it's good to see what the future might look like I guess even though there's kind of early support here this is like a much much easier Direction I think for end users than you know kind of dealing with credentials especially for a simple case like a thermostat right you just want it to work and right yeah yeah what I really like here is that you know Google didn't have to do this right like as in Google has their smart home system which Nestle already work with I'm very happy to see that Google is opening up their devices um to make it compatible with home assistant via matter locally that's just awesome to see yeah I'm just looking at like our stats by the way because if we are on YouTube right yeah why is nobody pushing your thumbs up can you hit the thumbs up please thumbs up thumbs up this is great release right well thank you anyways that's more yeah what's more in this release oh yeah so this is more of a of a a boring policy stuff is generally a bit boring maybe but still I think it's an important one out of there because I think it's an important thing like we often read I often read messages about how we break stuff again right and and it's actually not something we want to do it's something that sometimes happens and sometimes necessary to move forward but we really really do try to minimize that as much as we can and if if it happens to do the best we can to inform you and help you however we always kind of like it was an Unwritten rule maintain the rule that and deprecation period like the period that stuff like should have before removing it fully was two release cycles and that turned out to be more often to be a little bit too short so if you would skip two releases and we made a deprecation in that period you would run into a breaking change after two months so that was not so friendly so what we've done we've put in a new policy where we're going to and force people to or to do contributors to enforce contributors to at least keep a period of six months of deprecation which gives you like if you upgrade twice a year then you're safe you will get probably every breaking change notified on your dashboard and your repair center and tells you how you should resolve it or we can automatically migrate as well and then you should not run into as many Breaking changes anymore so that's the idea and yeah I'm actually pretty happy with that result hoping that people will run into breaking changes less especially when moving from yaml to UI yeah I think it's also good to say that anything that has migrated to the UI is not going to get breaking changes like these the breaking changes that we often see is because people are moving from yaml and moving integration to the UI and like I said before we have 12 1200 Integrations so yeah there's always an integration moving to the UI right and so right now we're making sure that that process is going to be very smooth yep two hope you will not run into this one at least again yeah we do care Canada actually we do it is it is annoying I don't like them either anyway I don't know if worthy changes we've we've gone to the big list by the way uh there are some big things and I don't know where he changes but I felt like the section is already like all the topics are already big enough but Frank before we go to the Noseworthy changes yeah you want to like should we just like look at some more of madalena's uh work to actually have more given that like people really liked it and there's yeah her dashboard ah okay what's the thing on a ride by the way madelina or from my and the right sure left maybe right yeah it's that thing yeah people in the chat were commenting on it as well um let's see um that's the uh um [Laughter] spoil everybody what the name of the ship actually is um yeah so I mean this is uh well this one is fun because like it's an eating display I don't want to make you a little bigger okay [Music] so that's the you know so yeah I think it would be nice to show the one from the the photograph right because the intent of the design really is it's not just in the picture frame right but it's also something that blends in with the home decor better right because like if you want like any of your smart home to be approved by the rest of the family uh the people living in the house right it needs to like looks more like other things that in the house so this is frame the picture frame so that like it looks like other notices the at the entrance on my door you want me to share the photo from your GitHub yeah so yeah you can see that like the trick here is uh yeah what only one of them is a eating screen and the other ones are actually printed and they are one of them is an intercom but they're all like made to look exactly the same so that like looks great at the entrance and it doesn't look like I'm just taking a tablet on a wall nothing like being contextual right like with the surroundings is important right so is it just like not as dense and crazy as the dashboard that I have but just uh with just the things that you need to know when you exit the the apartment which is the weather and also the L train is not very good right now as usual with home assistant we we love eating screens you know I think um Marlena was doing a research like a breakdown of like top up photos Reddit posts on the home assistant subreddit oh yes how many were eating well I mean like like for the tops of Reddit post having at least like in the top ten I think the top six of them are eating yeah so it's like that's the most like favorite dashboard that people want it's not like just tablets but yeah tablets are pretty popular too yeah I mean some people also like to have no screens that's true boys yeah yeah it's very good I was gonna say I built that project and it was really cool I appreciated having all the the config for the ESP home all checked in to GitHub it was like pretty helpful for me learning how to do very Advanced things with ESP home so it was a super cool project like one thing that like really is really cool about it is that I had this project in mind since like it was like 2016 or something like that like forever like I bought the eating screen but like I have no idea how to get the Arduino to work for so many years and then one day with ESP home everything just collects together it does one week boom boom it's amazing it is great for making custom Hardware like from scratch I just uh I highlighted the keys keys to kbx 81 he is one of the maintainers of the ESP home who works at nabukasa full-time and he said he just merged support for another eating device so you can never support enough devices it needs to be at home so that's one more yep so I'm an eating amateur but I've seen people buying these old displays from like Kindles and e-readers and such is that it's still a thing or like like if I would build such a thing would I just like break one of those or how how would I go into such a thing there's an ad on that like converts the dashboard into JPEG that you can load from that Kindle but yeah I don't think you can do ESP home with a Kindle it's like more complicated and actually yeah before then I bought two second hand kinder to try to build it I couldn't make it work so my trick is I go on Amazon I typed e-ink and the first thing on there is supported by ESP home this is the first thing of the size I wanted and so it's the first one the wave share 7.5 inch is what I ended up using and maybe you had to pick like which exact one there's a couple drivers maybe but um yeah if you're at all curious definitely I think this is a good project to follow and buy that device and then you're good to go let me try put it in the chat highlighting it on the screen right now eating curious for a while and it took me over and it was cool I'm into it now yeah it's good right um so we have two choices right now we can um there's one more modeling a project we can look at or we can finish the release notes enough time but the next this other project is really cool I'm curious now we're looking at beautiful stuff and um put a screen full of text it's not like but Malena this is uh unreleased this hasn't been released but uh it's uh what I wanted to use to replace all my um Alexa because uh all the Echo Show has been showing ads in the past year right right it was great to show some information that I actually care about um yeah I shared a screen okay oh yeah so that um that's home assistant um and uh yeah well the coolest thing is well with the slides that I have 15 chores overdue is that this is uh this is the club and that's the actual satellite image from from the American Satellite pointing at the Earth so there's an actual clouds right now which is awesome and yeah and it would just like go on a slideshow just like you know any of your Google home or like uh Echo Show devices and yeah so like it's something that is like for ambient information so it's like something that is good to know and if you glance with it like something interesting that might take your interest and we'll just run in the kitchen like this right so it's like a quality alerts things like that and and that's more of it right beside like slideshows like slightly cloudy I think that's why food if you want weather forecast like that yeah so do you catch this or something to a cash device or what's the idea yeah so for like the Google home devices or like the Nano Lenovo clock I can yeah basically use a fully key or browser but for Alexa I do essentially have a voice command to tell Alexa to start the web browser every like 10 minutes yeah it's always right so basically you have forced it to keep running and yeah so well that's more than this right so you I can actually use it to control the apartment too so like this uh that's like the menu [Laughter] so yeah you like all the chores um I still haven't wanted my plan yet you know things like that this is very much based on the um Windows Phone interface skew show so it's horizontal scroll and there's a you can control the lights of course just like the the other dashboard right and then you know and then there are things like uh you can play music um yeah this is awesome like again like like just tap on it and then like you can play the radio in a stereo in the living room it just looks beautiful I I don't know what to say else this one is cool too so yeah this is like the TV remote control so you can like um you can see like what I'm playing right now uh you can use the remote to control it I mean actually we'll stop playing and you can see like what's on deck on my plaques as well these are all great shows by the way and all the John Wick movies that I um purchased on blacks um yeah so that's not um um yeah so this is really cool because it's all touch branding and it's just like it fits in like tiny screen that like those devices have something to think about you know well it's really hot outside nice yeah so you're welcome that's what happened now this is awful cool yeah it looks great yeah yeah yeah no it's time for your dashboard what this is just amazing mine's default only I only use the default I don't even have any custom cards so I got a lot of work to do here yeah right well if you're using weight long enough using the default we have a lot of work to do right that's right yeah I'll just I'll just wait and uh you know we'll see yeah that's good that's a good question yeah really nice absolutely stunning for ah [Music] all right back on Earth thank you so much for sharing absolutely inspiring yeah it doesn't inspire a lot hopefully we can like make it easy for everyone to you know do similar things for the dashboards too you know can you please apply for a job by the way somebody asks yeah I tried have they asked paulus about it no yeah for the people that missed the Stars the start of this uh this stream manalena started last Monday at nabukasa and she is gonna lead uh product and Design yeah yes yeah some of some of you might have seen here already because I've been doing user research like with some of uh home assistant users so yeah this time we uh we're gonna have you know research informed something that actually works with I'll admins and our users and also it's like data driven it's not just about you know um uh you know just like what's cool and also what's helpful and useful for everyone uh one thing I think that would be great is to like recognize the fact that like a home assistant user base is a wide range of power users and also people who just graduated from their like normal smart home system so on one hand we'll make it easier for people to come on board but on the other hand we have to keep it powerful as well for people who like once they use home assistant for that reason yes yeah in the next few months but you know I just started so you know nothing nothing released yet there's so much more to do across the board it's just yeah I'm looking forward to it though it's always I'm always looking forward for yeah I'm looking forward to your work yeah me too I'm nice if you want something to do let's pack it to the next level yeah yeah well yeah I think just just to wrap it up right like with home assistant we've been we came from text files we went to like when we started working cool time we were like okay now we can add a UI we have time and effort to like put it in that and we've been making almost an easier to use we've tried to make it more accessible with yellow uh with almost in blue with the sky connect get people more um out of home assistant I think Raspberry Pi shortage has really helped the home assistant Community back I think there's been a lot of people in the last two years that have watched videos are like I want to use home assistance go to the store and don't find anything that's going to be solved quarter three um I expect the community to actually grow a lot once Raspberry Pi just becomes generally available again and so we're going to see a lot of new users also less experienced users so we need to make sure we accommodate everyone true all right all right so I think for the for closing the release by the way I would strongly recommend to check out the other no worthy section yourself like there's not like there's a lot of stuff in there by the way um but nothing you can explore on your own I think we had the major ones at this point are there any breaking things we want to race and tell if you're using home assistant docker some people are using the wrong label on Docker and like you know Docker is kind of complicated right so if you go down that route like we generally be like you're on your own but still some people like take the wrong tag so the correct and preferred tag is stable like if you use stable you will always use the latest stable version we prefer that you get your home assistant container from uh the GitHub repository ghcr.io which by the way this is only information container if you use homes in operating system supervised this is all done for you so only if you set up the docker yourself please get it from the ghcr link otherwise if you have to get it from Docker happen that's okay get it from the stable tag yeah so what happened in the past or we still do by the way is that we build like intermediate containers like little containers for specific environments like respected by four or specific architectures and all those images we build in the end we combine into like a meta image which is this one this the one display right now uh which is a multi-architecture meta image so you can just use it no matter which architecture you're using and what happened in the past is that some tutorials or some people use this specific architecture in this tack which was just meant for us as an intermediate build artifact um and we are no longer publishing those through Docker Hub because we're not using Docker Hub anymore internally so if you've been using one of those like intermediate images you will no longer receive updates at this point so that's why this this warning is in the breaking changes section just make sure if you're using Docker in a docker post file or whatever Docker interface you're using like pertainer on your Nas or something like that make sure you use this one it will just work and that's the one we officially maintain and also document and that's like the official image except we'll just like BL today yes right all right I think that's the only noteworthy change I'm just gonna like I have read during the release notes I already mentioned year of the voice Chapter Three is coming I forgot that I did we have actually a promo graphic that I've put together um I think yeah I was gonna share it first you will never guess what does that mean so yeah if you are uh interested in voice uh or want to just interested in more cool home assistant stuff definitely join us July 20 we will um pre-announce it on YouTube right after the stream ends we didn't want to like you know mess with the people finding this uh release but yeah it's gonna be really cool we're gonna talk about stuff that came in this release a lot of stuff that is coming at other places which I definitely won't tell and you will notice where it's going to come from um yeah it's gonna be cool and uh so yeah definitely come check out you have the voice uh chapter three Mike is all psyched up to talk to you guys um yeah thanks five minutes left night any any closing words Alan no I'm just happy to go update my Docker container so I'm glad you showed me that note I would have missed that it's exciting very informative yeah you have any closing words Milena uh I'm just so happy to be here and meet everyone this is a great project um it's definitely like you know everyone really loves working on it and also it's a great open source community and I can't wait to see what uh I can help with in the next few months awesome we're so happy to have you cool um should we just wrap it up Frank I think so I think this really wasn't already like huge and like all the stuff from Atlanta show that I'm already like overload overload yes definitely but no it was I think this release was a huge last release was huge so closing it up I think next release will be well let's take it slow a bit and like the holiday season is starting yeah so yeah yeah we wish everybody a great summer holiday and or of course if you're in the other side of the world great winter yeah yeah right absolutely so enjoy the release yes bye oh

Channel: Home Assistant

Views: 8,268

Keywords:

Id: r0DLyU-4nWo

Length: 114min 29sec (6869 seconds)

Published: Wed Jul 05 2023