How to create an alert rule in Grafana 10.1

[Music] hi everyone I'm Sonia lar and I'm a software engineer on the ltin squad let's talk about the new all rule creation workflow available in grafana 10.1 for open source and Enterprise users and already available in Cloud let's start explaining what problems we are trying to fix the first is that in the previous workflow users found certain and mandatory steps like choosing the type of the rule they wanted to create which added some initial decision making overhead at the same time we identified opportunities for improvements in the all rule form to enhance overall user experience during the creation process and secondly it's about aler rooting because currently there is confusion among users about how our system decides to send an alert to specific cont contct point so let's jump to the UI and let's see these changes you can see in here that the first thing we did is that we move the new Aller recording rule action button to here why because a recording rule is not an Al rues so we decide to move this outside our rule creation workflow let's go to the Aller rule for we did several improvements there like wrapping in here in this option model time range Max data points and Min interval then we fix that the query is not expandable and in Expressions now you cannot edit an expression but you can only remove and create a new one deciding from the beginning the type you want to use we did some improvements in the alert evaluation Behavior like the way we create an new folder and a new uh a new group and in annotations we another changes but the most important thing we did in this part is about the regarding the workflow is the chance we did uh about deciding the rule type now it's not mandatory so the first thing that the user have to De has to decide is the data source they want to use so you select the data source you want to use and then the system is is mar up to uh enable you to switch to data source manage Al Ru or not so by default this will be a grafana manage Al rule but in case the data source is selected is enabled to be used as a cloud rule then you can switch to Club room then let's go to the new fature we decided to create uh a new feature to enable users to preview how the potential alerts uh in St will be rot depending on the current alert definition and the current alert manager configuration you have this is only available for grafana manage alerts as we don't have the control where the cloud alerts are configured to be sent as are in external systems so let's review this context and review what we have in the definition of our aler managers if we go to the admin Tab and we go to the grafana aler manager configuration you will see here that our grafana alert instance will be sent to both internal and external in this case and in the external we have this aler manager that is named aler manager then what we have to to do is to go to the notification policy Tre for both aler managers for grafana alert manager we have this notification policy 3 and for the external one we have this notification policy 3 let's go to a alerts and let's see what happened with this new preview routing uh future we click to here and then we will see how our potential alerts depending on the labels we have defined are going to be root in this case for internal alert manager this potential alerts are going to be sent to default policy because we don't have matching labels for the nlic policy we have defined it but for the external manager we have this maging instance because of this label magical label equal yes this alert instance is going to be root to this notification policy that is Magic label different to not desired level and it's going to go to this uh contact point that is name graphon alerting if you want to see the details you will see the wall path that is severity critical is matches and sorry the magical level different to not descided level uh and that's pretty much it if you have any questions you can reach out the alerting team in the alerting channel thank you very much

Channel: Grafana

Views: 19,831

Keywords: Grafana, Monitoring, logs, dashboards, observability, dashboard, metrics, traces, visualization, Grafana Loki, Grafana Mimir, Grafana OnCall, Grafana Tempo, Graphite, Grafana K6, OpenTelemetry, Prometheus, OSS, Open Source, Grafana 10.1, Alert rule

Id: nPdzomH6bno

Length: 5min 22sec (322 seconds)

Published: Thu Sep 21 2023