notifications.mdx 8.8 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155
  1. ---
  2. title: "Alert notifications"
  3. description: >-
  4. "Configure Netdata Cloud to send notifications to your team whenever any node on your infrastructure
  5. triggers a pre-configured or custom alert threshold."
  6. custom_edit_url: "https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/notifications.mdx"
  7. sidebar_label: "Alert notifications"
  8. learn_status: "Published"
  9. learn_topic_type: "Tasks"
  10. learn_rel_path: "Operations/Alerts"
  11. ---
  12. import Callout from '@site/src/components/Callout'
  13. Netdata Cloud can send centralized alert notifications to your team whenever a node enters a warning, critical, or
  14. unreachable state. By enabling notifications, you ensure no alert, on any node in your infrastructure, goes unnoticed by
  15. you or your team.
  16. Having this information centralized helps you:
  17. * Have a clear view of the health across your infrastructure, [seeing all a alerts in one place](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/view-active-alerts.mdx)
  18. * Easily [setup your alert notification process](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/manage-notification-methods.md):
  19. methods to use and where to use them, filtering rules, etc.
  20. * Quickly troubleshoot using [Metric Correlations](https://github.com/netdata/netdata/blob/master/docs/cloud/insights/metrics-correlations.md)
  21. or [Anomaly Advisor](https://github.com/netdata/netdata/blob/master/docs/cloud/insights/anomaly-advisor.mdx)
  22. If a node is getting disconnected often or has many alerts, we protect you and your team from alert fatigue by sending
  23. you a flood protection notification. Getting one of these notifications is a good signal of health or performance issues
  24. on that node.
  25. Admins must enable alert notifications for their [Space(s)](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/manage-notification-methods.md#manage-space-notification-settings). All users in a
  26. Space can then personalize their notifications settings from within their [account
  27. menu](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/#manage-user-notification-settings).
  28. <Callout type="notice">
  29. Centralized alert notifications from Netdata Cloud is a independent process from [notifications from
  30. Netdata](https://github.com/netdata/netdata/blob/master/docs/monitor/enable-notifications.md). You can enable one or the other, or both, based on your needs. However,
  31. the alerts you see in Netdata Cloud are based on those streamed from your Netdata-monitoring nodes. If you want to tweak
  32. or add new alert that you see in Netdata Cloud, and receive via centralized alert notifications, you must
  33. [configure](https://github.com/netdata/netdata/blob/master/docs/monitor/configure-alarms.md) each node's alert watchdog.
  34. </Callout>
  35. ### Alert notifications
  36. Netdata Cloud can send centralized alert notifications to your team whenever a node enters a warning, critical, or unreachable state. By enabling notifications,
  37. you ensure no alert, on any node in your infrastructure, goes unnoticed by you or your team.
  38. If a node is getting disconnected often or has many alerts, we protect you and your team from alert fatigue by sending you a flood protection notification.
  39. Getting one of these notifications is a good signal of health or performance issues on that node.
  40. Alert notifications can be delivered through different methods, these can go from an Email sent from Netdata to the use of a 3rd party tool like PagerDuty.
  41. Notification methods are classified on two main attributes:
  42. * Service level: Personal or System
  43. * Service classification: Community or Business
  44. Only administrators are able to manage the space's alert notification settings.
  45. All users in a Space can personalize their notifications settings, for Personal service level notification methods, from within their profile menu.
  46. > ⚠️ Netdata Cloud supports different notification methods and their availability will depend on the plan you are at.
  47. > For more details check [Service classification](#service-classification) or [netdata.cloud/pricing](https://www.netdata.cloud/pricing).
  48. #### Service level
  49. ##### Personal
  50. The notifications methods classified as **Personal** are what we consider generic, meaning that these can't have specific rules for them set by the administrators.
  51. These notifications are sent to the destination of the channel which is a user-specific attribute, e.g. user's e-mail, and the users are the ones that will then be able to
  52. manage what specific configurations they want for the Space / Room(s) and the desired Notification level, they can achieve this from their User Profile page under
  53. **Notifications**.
  54. One example of such a notification method is the E-mail.
  55. ##### System
  56. For **System** notification methods, the destination of the channel will be a target that usually isn't specific to a single user, e.g. slack channel.
  57. These notification methods allow for fine-grain rule settings to be done by administrators and more than one configuration can exist for them since. You can specify
  58. different targets depending on Rooms or Notification level settings.
  59. Some examples of such notification methods are: Webhook, PagerDuty, slack.
  60. #### Service classification
  61. ##### Community
  62. Notification methods classified as Community can be used by everyone independent on the plan your space is at.
  63. These are: Email and discord
  64. ##### Pro
  65. Notification methods classified as Pro are only available for **Pro** and **Business** plans
  66. These are: webhook
  67. ##### Business
  68. Notification methods classified as Business are only available for **Business** plans
  69. These are: PagerDuty, slack
  70. ## Flood protection
  71. If a node has too many state changes like firing too many alerts or going from reachable to unreachable, Netdata Cloud
  72. enables flood protection. As long as a node is in flood protection mode, Netdata Cloud does not send notifications about
  73. this node. Even with flood protection active, it is possible to access the node directly, either via Netdata Cloud or
  74. the local Agent dashboard at `http://NODE:19999`.
  75. ## Anatomy of an alert notification
  76. Email alarm notifications show the following information:
  77. - The Space's name
  78. - The node's name
  79. - Alarm status: critical, warning, cleared
  80. - Previous alarm status
  81. - Time at which the alarm triggered
  82. - Chart context that triggered the alarm
  83. - Name and information about the triggered alarm
  84. - Alarm value
  85. - Total number of warning and critical alerts on that node
  86. - Threshold for triggering the given alarm state
  87. - Calculation or database lookups that Netdata uses to compute the value
  88. - Source of the alarm, including which file you can edit to configure this alarm on an individual node
  89. Email notifications also feature a **Go to Node** button, which takes you directly to the offending chart for that node
  90. within Cloud's embedded dashboards.
  91. Here's an example email notification for the `ram_available` chart, which is in a critical state:
  92. ![Screenshot of an alarm notification email from Netdata Cloud](https://user-images.githubusercontent.com/1153921/87461878-e933c480-c5c3-11ea-870b-affdb0801854.png)
  93. ## What's next?
  94. Netdata Cloud's alarm notifications feature leverages the alarms configuration on each node in your infrastructure. If
  95. you'd like to tweak any of these alarms, or even add new ones based on your needs, read our [health
  96. quickstart](https://github.com/netdata/netdata/blob/master/docs/monitor/configure-alarms.md).
  97. You can also [view active alarms](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/view-active-alerts.mdx) in Netdata Cloud for an instant
  98. visualization of the health of your infrastructure.
  99. ### Related Topics
  100. #### **Related Concepts**
  101. - [Rooms](https://github.com/netdata/netdata/blob/master/docs/cloud/war-rooms.md)
  102. - [Metric Correlations](https://github.com/netdata/netdata/blob/master/docs/cloud/insights/metrics-correlations.md)
  103. - [Anomaly Advisor](https://github.com/netdata/netdata/blob/master/docs/cloud/insights/anomaly-advisor.mdx)
  104. #### Related Tasks
  105. - [View Active alarms](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/view-active-alerts.mdx)
  106. - [Manage notification methods](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/manage-notification-methods.md)
  107. - [Add webhook notification configuration](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/add-webhook-notification-configuration.md)
  108. - [Add Discord notification configuration](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/add-discord-notification-configuration.md)
  109. - [Add Slack notification configuration](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/add-slack-notification-configuration.md)
  110. - [Add PagerDuty notification configuration](https://github.com/netdata/netdata/blob/master/docs/cloud/alerts-notifications/add-pagerduty-notification-configuration.md)