Changelog

v1.36.1 (2022-08-15)

Full Changelog

Merged pull requests:

fix(ci): fix fetching tags in Build workflow #13517 (ilyam8)
docs(postfix): add a note about authorized_mailq_users #13515 (ilyam8)
Remove extra U from log message #13514 (uplime)
Print rrdcontexts versions with PRIu64 #13511 (MrZammler)
Calculate name hash after rrdvar_fix_name #13509 (MrZammler)
fix(packaging): add CAP_NET_ADMIN for go.d.plugin #13507 (ilyam8)
netdata.service: Update PIDFile to avoid systemd legacy path warning #13504 (candrews)
chore(python.d): remove python.d/* announced in v1.36.0 deprecation notice #13503 (ilyam8)
reduce memcpy and memory usage on mqtt5 #13450 (underhood)
Modify PID monitoring (ebpf.plugin) #13397 (thiagoftsm)

v1.36.0 (2022-08-10)

Full Changelog

Merged pull requests:

rrdcontexts allow not linked dimensions and charts #13501 (ktsaou)
docs: add deprecation notice to python.d/postgres readme #13497 (ilyam8)
docs: change postgres links to go version #13496 (ilyam8)
bump go.d version to v0.35.0 #13494 (ilyam8)
add PgBouncer charts description and icon to dashboard info #13493 (ilyam8)
Add chart_context to alert snapshots #13492 (MrZammler)
Remove prompt to add dashboard issues #13490 (cakrit)
docs: fix unresolved file references #13488 (ilyam8)
docs: add a note about edit-config for docker installs #13487 (ilyam8)
health: disable go python last collected alarms #13485 (ilyam8)
bump go.d.plugin version to v0.34.0 #13484 (ilyam8)
chore: add WireGuard description and icon to dashboard info #13483 (ilyam8)
feat(cgroups.plugin): resolve nomad containers name (docker driver only) #13481 (ilyam8)
Check for protected when excluding mounts #13479 (MrZammler)
update postgres dashboard info #13474 (ilyam8)
Remove the single threaded arrayallocator optiomization during agent startup #13473 (stelfrag)
Handle cases where entries where stored as text (with strftime("%s")) #13472 (stelfrag)
Enable rrdcontexts by default #13471 (stelfrag)
Fix cgroup name detection for docker containers in containerd cgroup #13470 (xkisu)
Trimmed-median, trimmed-mean and percentile #13469 (ktsaou)
rrdcontext support for hidden charts #13466 (ktsaou)
Load host labels for archived hosts #13464 (stelfrag)
fix(python.d/smartd_log): handle log rotation #13460 (ilyam8)
docs: add a note about network interface monitoring when running in a Docker container #13458 (ilyam8)
fix a guide so we can reference it's subsections #13455 (tkatsoulas)
Revert "Query queue only for queries" #13452 (stelfrag)
/api/v1/weights endpoint #13449 (ktsaou)
Get last_entry_t only when st changes #13448 (MrZammler)
additional stats #13445 (ktsaou)
Store host label information in the metadata database #13441 (stelfrag)
Fix typo in PostgreSQL section header #13440 (shyamvalsan)
Fix tests so that the actual metadata database is not accessed #13439 (stelfrag)
Delete aclk_alert table on start streaming from seq 1 batch 1 #13438 (MrZammler)
Fix agent crash when archived host has not been registered to the cloud #13437 (stelfrag)
Dont duplicate buffered bytes #13435 (vlvkobal)
Show last 15 alerts in notification #13434 (MrZammler)
Query queue only for queries #13431 (underhood)
Remove octopus from demo-sites #13423 (cakrit)
Tiering statistics API endpoint #13420 (ktsaou)
add discord, youtube, linkedin links to README #13419 (andrewm4894)
add ML bullet point to features section on README #13418 (andrewm4894)
Set value to SN_EMPTY_SLOT if flags is SN_EMPTY_SLOT #13417 (MrZammler)
Add missing comma (handle coverity warning CID 379360) #13413 (stelfrag)
codacy/lgtm ignore judy sources #13411 (underhood)
Send chart context with alert events to the cloud #13409 (MrZammler)
Remove SIGSEGV and SIGABRT (ebpf.plugin) #13407 (thiagoftsm)
minor fixes on metadata fields #13406 (tkatsoulas)
chore(health): remove py web_log alarms #13404 (ilyam8)
Store host system information in the database #13402 (stelfrag)
Fix coverity issue 379240 (Unchecked return value) #13401 (stelfrag)
Fix netdata-updater.sh sha256sum on BSDs #13391 (tnyeanderson)
chore(python.d): clarify haproxy module readme #13388 (ilyam8)
Fix bitmap unit tests #13374 (stelfrag)
chore(dashboard): update chrony dashboard info #13371 (ilyam8)
chore(python.d): remove python.d/* announced in v1.35.0 deprecation notice #13370 (ilyam8)
bump go.d.plugin version to v0.33.1 #13369 (ilyam8)
Add Oracle Linux 9 to officially supported platforms. #13367 (Ferroin)
Address Coverity issues #13364 (stelfrag)
chore(python.d): improve config file parsing error message #13363 (ilyam8)
in source Judy #13362 (underhood)
Add additional Docker image build with debug info included. #13359 (Ferroin)
Move host tags to netdata_info #13358 (vlvkobal)
Get rid of extra comma in OpenTSDB exporting #13355 (vlvkobal)
Fix chart update ebpf.plugin #13351 (thiagoftsm)
add job to move bugs to project board #13350 (hugovalente-pm)
added another way to get ansible plays #13349 (mhkarimi1383)
Send node info message sooner #13348 (MrZammler)
query engine: omit first point if not needed #13345 (ktsaou)
fix 32bit calculation on array allocator #13343 (ktsaou)
fix crash on start on slow disks because ml is initialized before dbengine starts #13342 (ktsaou)
fix(packaging): respect CFLAGS arg when building Docker image #13340 (ilyam8)
add github stars badge to readme #13338 (andrewm4894)
Fix coverity 379241 #13336 (MrZammler)
Rrdcontext #13335 (ktsaou)
Detect stored metric size by page type #13334 (stelfrag)
Silence compile warnings on external source #13332 (MrZammler)
UpdateNodeCollectors message #13330 (MrZammler)
Cid 379238 379238 #13328 (stelfrag)
Docs fix metric storage #13327 (tkatsoulas)
Fix two helgrind reports #13325 (vkalintiris)
fix(cgroups.plugin): adjust kubepods patterns to filter pods when using Kind cluster #13324 (ilyam8)
Add link to docker config section #13323 (cakrit)
Guide for troubleshooting Agent with Cloud connection for new nodes #13322 (Ancairon)
fix(apps.plugin): adjust zmstat* pattern to exclude zoneminder scripts #13314 (ilyam8)
array allocator for dbengine page descriptors #13312 (ktsaou)
fix(health): disable go.d last collected alarm for prometheus module #13309 (ilyam8)
Explicitly skip uploads and notifications in third-party repositories. #13308 (Ferroin)
Protect shared variables with log lock. #13306 (vkalintiris)
Keep rc before freeing it during labels unlink alarms #13305 (MrZammler)
fix(cgroups.plugin): adjust kubepods regex to fix name resolution in a kind cluster #13302 (ilyam8)
Null terminate string if file read was not successful #13299 (stelfrag)
fix(health): fix incorrect Redis dimension names #13296 (ilyam8)
chore: remove python-mysql from install-required-packages.sh #13288 (ilyam8)
Use new MQTT as default (revert #13258)" #13287 (underhood)
query engine fixes for alarms and dashboards #13282 (ktsaou)
Better ACLK debug communication log #13281 (underhood)
bump go.d.plugin version to v0.33.0 #13280 (ilyam8)
Fixes vbi parser in mqtt5 implementation #13277 (underhood)
Fix alignment in charts endpoint #13275 (thiagoftsm)
Dont print io errors for cgroups #13274 (vlvkobal)
Pluginsd doc #13273 (thiagoftsm)
Remove obsolete --use-system-lws option from netdata-installer.sh help #13272 (Dim-P)
Rename the chart of real memory usage in FreeBSD #13271 (vlvkobal)
Update documentation about our REST API documentation. #13269 (Ferroin)
Fix package build filtering on PRs. #13267 (Ferroin)
Add document explaining how to proxy Netdata via H2O #13266 (Ferroin)
chore(python.d): remove deprecated modules from python.d.conf #13264 (ilyam8)
Multi-Tier database backend for long term metrics storage #13263 (stelfrag)
Get rid of extra semicolon in Graphite exporting #13261 (vlvkobal)
fix RAM calculation on macOS in system-info #13260 (ilyam8)
Ebpf issues #13259 (thiagoftsm)
Use old mqtt implementation as default #13258 (MrZammler)
Remove warnings while compiling ML on FreeBSD #13255 (thiagoftsm)
Fix issues with DEB postinstall script. #13252 (Ferroin)
Remove strftime from statements and use unixepoch instead #13250 (stelfrag)
Query engine with natural and virtual points #13248 (ktsaou)
Add fstype labels to disk charts #13245 (vlvkobal)
Don’t pull in GCC for build if Clang is already present. #13244 (Ferroin)
Delay health until obsoletions check is complete #13239 (MrZammler)
Improve anomaly detection guide #13238 (andrewm4894)
Implement PackageCloud cleanup #13236 (maneamarius)
Bump repoconfig package version used in kickstart.sh #13235 (Ferroin)
Updates the sqlite version in the agent #13233 (stelfrag)
Migrate data when machine GUID changes #13232 (stelfrag)
Add more sqlite unittests #13227 (stelfrag)
ci: add issues to the Agent Board project workflow #13225 (ilyam8)
Exporting/send variables #13221 (boxjan)
fix(cgroups.plugin): fix qemu VMs and LXC containers name resolution #13220 (ilyam8)
netdata doubles #13217 (ktsaou)
deduplicate mountinfo based on mount point #13215 (ktsaou)
feat(python.d): load modules from user plugin directories (NETDATA_USER_PLUGINS_DIRS) #13214 (ilyam8)
Properly handle interactivity in the updater code. #13209 (Ferroin)
Don’t use realpath to find kickstart source path. #13208 (Ferroin)
Print INTERNAL BUG messages only when NETDATA_INTERNAL_CHECKS is enabled #13207 (MrZammler)
Ensure tmpdir is set for every function that uses it. #13206 (Ferroin)
Add user plugin dirs to environment #13203 (vlvkobal)
Fix cgroups netdev chart labels #13200 (vlvkobal)
Add hostname in the worker structure to avoid constant lookups #13199 (stelfrag)
Rpm group creation #13197 (iigorkarpov)
Allow for an easy way to do metadata migrations #13196 (stelfrag)
Dictionaries with reference counters and full deletion support during traversal #13195 (ktsaou)
Add configuration for dbengine page fetch timeout and retry count #13194 (stelfrag)
Clean sqlite prepared statements on thread shutdown #13193 (stelfrag)
Update dashboard to version v2.26.5. #13192 (netdatabot)
chore(netdata-installer): remove a call to 'cleanup_old_netdata_updater()' because it is no longer exists #13189 (ilyam8)
feat(python.d/smartd_log): add 2nd job that tries to read from '/var/lib/smartmontools/' #13188 (ilyam8)
Add type label for network interfaces #13187 (vlvkobal)
fix(freebsd.plugin): fix wired/cached/avail memory calculation on FreeBSD with ZFS #13183 (ilyam8)
make configuration example clearer #13182 (andrewm4894)
add k8s_state dashboard_info #13181 (ilyam8)
Docs housekeeping #13179 (tkatsoulas)
Update dashboard to version v2.26.2. #13177 (netdatabot)
feat(proc/proc_net_dev): add dim per phys link state to the "Interface Physical Link State" chart #13176 (ilyam8)
set default for minimum num samples to train to 900 #13174 (andrewm4894)
Add ml alerts examples #13173 (andrewm4894)
Revert "Configurable storage engine for Netdata agents: step 3 (#12892)" #13171 (vkalintiris)
Remove warnings when openssl 3 is used. #13170 (thiagoftsm)
Don’t manipulate positional parameters in DEB postinst script. #13169 (Ferroin)
Fix coverity issues #13168 (stelfrag)
feat(proc/proc_net_dev): add dim per operstate to the "Interface Operational State" chart #13167 (ilyam8)
feat(proc/proc_net_dev): add dim per duplex state to the "Interface Duplex State" chart #13165 (ilyam8)
allow traversing null-value dictionaries #13162 (ktsaou)
Use memset to mark the empty words in the quoted_strings_splitter function #13161 (stelfrag)
Fix data query on stale chart #13159 (stelfrag)
enable ml by default #13158 (andrewm4894)
Fix labels unit test #13156 (stelfrag)
Query Engine multi-granularity support (and MC improvements) #13155 (ktsaou)
add CAP_SYS_RAWIO to Netdata's systemd unit CapabilityBoundingSet #13154 (ilyam8)
Update docs on what to do if collector not there #13152 (cakrit)
revert to default of host anomaly rate threshold=0.01 #13150 (andrewm4894)
fix conditions for nightly build triggers #13145 (maneamarius)
Add cargo/rustc/bazel/buck to apps_groups.conf #13143 (vkalintiris)
Add an option to use malloc for page cache instead of mmap #13142 (stelfrag)
Add mem.available chart to FreeBSD #13140 (MrZammler)
fix crashes due to misaligned allocations #13137 (ktsaou)
fix(python.d): urllib3 import collection for py3.10+ #13136 (ilyam8)
fix(python.d/mongodb): set serverSelectionTimeoutMS for pymongo4+ #13135 (ilyam8)
Use new mqtt implementation as default #13132 (underhood)
use ks2 as MC default #13131 (andrewm4894)
allow label names to have slashes #13125 (ktsaou)
fixed coveriry 379136 379135 379134 379133 #13123 (ktsaou)
buffer overflow detected by the compiler #13120 (ktsaou)
Ci coverage #13118 (maneamarius)
Add missing control to streaming #13112 (thiagoftsm)
Removes Legacy JSON Cloud Protocol Support In Agent #13111 (underhood)
Re-enable updates for systems using static builds. #13110 (Ferroin)
Add user netdata to secondary group in DEB package #13109 (iigorkarpov)
Remove pinned page reference #13108 (stelfrag)
73x times faster metrics correlations at the agent #13107 (ktsaou)
fix(updater): fix updating when using --force-update and new version of the updater script is available #13104 (ilyam8)
Remove unnescesary ‘cleanup’ code. #13103 (Ferroin)
Temporarily disable updates for static builds. #13100 (Ferroin)
docs(statsd.plugin): fix indentation #13096 (ilyam8)
Statistics on bytes recvd and sent #13091 (underhood)
fix virtualization detection on FreeBSD #13087 (ilyam8)
Update netdata commands #13080 (tkatsoulas)
fix: fix a base64_encode bug #13074 (kklionz)
Labels with dictionary #13070 (ktsaou)
Use a separate thread for slow mountpoints in the diskspace plugin #13067 (vlvkobal)
Remove official support for Debian 9. #13065 (Ferroin)
Fix coverity 378587 #13024 (MrZammler)
Remove Ubuntu 21.10 from CI and package builds. #12918 (Ferroin)
Configurable storage engine for Netdata agents: step 3 #12892 (aberaud)

v1.35.1 (2022-06-10)

Full Changelog

v1.35.0 (2022-06-08)

Full Changelog

Merged pull requests:

Update README.md #13089 (ktsaou)
Update README.md #13088 (ktsaou)
fix(updater): return 0 on successful update for native packages when running interactively #13083 (ilyam8)
Fix Coverity errors in mqtt_websockets submodule #13082 (underhood)
fix(updater): don't produce any output if binpkg update completed successfully #13081 (ilyam8)
Fix handling of DEB package naming in CI. #13076 (Ferroin)
Update default value for "host anomaly rate threshold" #13075 (shyamvalsan)
Fix locking access to chart labels #13064 (stelfrag)
fix(cgroup.plugin): read k8s_cluster_name label from the correct file #13062 (ilyam8)
Initialize chart label key parameter correctly #13061 (stelfrag)
Added Alma Linux 9 and RHEL 9 support to CI and packaging. #13058 (Ferroin)
Fix handling of temp directory in kickstart when uninstalling. #13056 (Ferroin)
Fix coverity 378625 #13055 (MrZammler)
add the ability to merge dictionary items #13054 (ktsaou)
Check for host labels when linking alerts for children #13053 (MrZammler)
dictionary improvements #13052 (ktsaou)
Fix dictionary crash walkthrough empty #13051 (ktsaou)
coverity fixes about statsd; removal of strsame #13049 (ktsaou)
Add improved reinstall documentation. #13047 (Ferroin)
Fix disabled apps (ebpf.plugin) #13044 (thiagoftsm)
add note about anomaly advisor #13042 (andrewm4894)
replace history with relevant dbengine params #13041 (andrewm4894)
Fix the retry count and netdata_exit check when running an sqlite3_step command #13040 (stelfrag)
Schedule retention message calculation to a worker thread #13039 (stelfrag)
Check return value and log an error on failure #13037 (stelfrag)
Add additional metadata to the data response #13036 (stelfrag)
When sending a dimension for the first time, make sure there is a non zero created_at timestamp #13035 (stelfrag)
Update apps_groups.conf #13033 (fqx)
Dictionary with JudyHS and double linked list #13032 (ktsaou)
add hostname to mirrored hosts #13030 (ktsaou)
Update dashboard to version v2.25.6. #13028 (netdatabot)
prevent gap filling on dbengine gaps #13027 (ktsaou)
Initialize a pointer and add a check for it #13023 (vlvkobal)
Fix coverity issue 378598 #13022 (MrZammler)
Skip collecting network interface speed and duplex if carrier is down #13019 (vlvkobal)
fix COVERITY_PATH added with INSTALL_DIR into PATH #13014 (maneamarius)
Only try to update repo metadata in updater script if needed. #13009 (Ferroin)
Treat dimensions as normal when we don't have enough/valid data. #13005 (vkalintiris)
Use printf instead of echo for printing collected warnings in kickstart.sh. #13002 (Ferroin)
Update dashboard to version v2.25.4. #13000 (netdatabot)
Run the /net/dev module of the proc plugin in a separate thread #12996 (vlvkobal)
Autodetect coverity install path to increase robustness #12995 (maneamarius)
Fix compilation warnings #12993 (vlvkobal)
Delay children chart obsoletion check #12992 (MrZammler)
Fix nanosleep on platforms other than Linux #12991 (vlvkobal)
Don't expose the chart definition to streaming if there is no metadata change #12990 (stelfrag)
Faster queries #12988 (ktsaou)
Improve reconnect node instructions #12987 (cakrit)
Make heartbeat a static chart #12986 (MrZammler)
chore(apps.plugin): change cpu_guest chart context #12983 (ilyam8)
fix: don't kill Netdata PIDs if successfully stopped Netdata #12982 (ilyam8)
add dictionary support to statsd #12980 (ktsaou)
fix(kickstart.sh): handle the case when tput colors doesn't return a number #12979 (ilyam8)
query engine optimizations and cleanup #12978 (ktsaou)
optimize poll_events() to spread the work over the threads more evenly #12975 (ktsaou)
chore: check link local address before querying cloud instance metadata #12973 (ilyam8)
Alarms py collector add filtering #12972 (andrewm4894)
Don't permanetly disable a destination because of denied access #12971 (MrZammler)
modify code to resolve compile warning issue #12969 (kklionz)
Return rc->last_update from alarms_values api #12968 (MrZammler)
cleanup and optimize rrdeng_load_metric_next() #12966 (ktsaou)
feat(charts.d/apcupds): add load usage chart (Watts) #12965 (ilyam8)
fix: keep virtualization unknown if all used commands are not available #12964 (ilyam8)
statsd sets should count unique values #12963 (ktsaou)
Add automatic retries fo static builds during nightly and release builds. #12961 (Ferroin)
Cleanup chart hash and map tables on startup #12956 (stelfrag)
Suppress warning when freeing a NULL pointer in onewayalloc_freez #12955 (stelfrag)
Trigger queue removed alerts on health log exchange with cloud #12954 (MrZammler)
Optimize the dimensions option store to the metadata database #12952 (stelfrag)
Defer the dimension payload check to the ACLK sync thread #12951 (stelfrag)
detailed dbengine stats #12948 (ktsaou)
Prevent command_to_be_logged from overflowing #12947 (MrZammler)
Update libbpf version #12945 (thiagoftsm)
Reduce timeout to 1 second for getting cloud instance info #12941 (MrZammler)
Stream and advertise metric correlations to the cloud #12940 (MrZammler)
feat: move dirs, logs, and env vars config options to separate sections #12935 (ilyam8)
Adjust the dimension liveness status check #12933 (stelfrag)
chore(fping.plugin): bump default fping version to 5.1 #12930 (ilyam8)
Restore a broken symbolic link #12923 (vlvkobal)
collectors: apps.plugin: apps_groups: update net, aws, ha groups #12921 (k0ste)
Remove Alpine 3.12 from CI. #12919 (Ferroin)
user configurable sqlite PRAGMAs #12917 (ktsaou)
fix [global statistics] section in netdata.conf #12916 (ilyam8)
chore(streaming): bump default "buffer size bytes" to 10MB #12913 (ilyam8)
fix(cgroups.plugin): improve check for uninitialized containers in k8s #12912 (ilyam8)
fix virtualization detection when systemd-detect-virt is not available #12911 (ilyam8)
added worker jobs for cgroup-rename, cgroup-network and cgroup-first-time #12910 (ktsaou)
Fix the log entry for incoming cloud start streaming commands #12908 (stelfrag)
chore(cgroups.plugin): remove "enable new cgroups detected at run time" config option #12906 (ilyam8)
Fix release channel in the node info message #12905 (stelfrag)
chore(worker_utilization): log an error when re-registering an already registered job #12903 (ilyam8)
fix(cgroups.plugin): use correct identifier when registering the main thread "chart" worker job #12902 (ilyam8)
Remove CPU-specific info from cpuidle dimensions #12898 (vlvkobal)
Adjust alarms count #12896 (MrZammler)
Return stable or nightly based on version if the file check fails #12894 (stelfrag)
Update reconnect node with kickstart info #12891 (cakrit)
Fix compilation warnings in FreeBSD #12887 (vlvkobal)
Fix compilation warnings #12886 (vlvkobal)
Take into account the in queue wait time when executing a data query #12885 (stelfrag)
Update dashboard to version v2.25.2. #12884 (netdatabot)
Consider ZFS ARC shrinkable as cache on FreeBSD #12879 (vlvkobal)
Remove Fedora 34 from CI and package builds. #12875 (Ferroin)
fix(health): change duplicate health template message logging level to 'info' #12873 (ilyam8)
docs: fix unresolved file references #12872 (ilyam8)
Set trust durations to have data from children properly aligned #12870 (stelfrag)
feat(proc/cgroups.plugin): add PSI stall time charts #12869 (ilyam8)
Update README.md #12868 (tkatsoulas)
fix for negative per job busy time #12867 (ktsaou)