notify v1.0.0

[ ] disk / 59% [!] mem 96% [ ] ct115-docker-host ok [ ] docker-npm ok [ ] docker-arcane ok [ ] prometheus-host ok [ ] alertmanager-host ok [ ] docker-grafana ok [ ] pbs-host ok [ ] pbs-service ok [ ] db108-host ok [ ] db108-mariadb ok [ ] db108-postgresql ok [ ] db108-redis ok [ ] mailcow-host ok [ ] nc103-host ok [ ] nc103-mariadb ok [ ] nc103-apache2 ok [ ] load 2.30 [ ] cert-tequeremos ok [ ] nc103-backup-fresh ok [ ] ct110-mssql-up ok [~] ct110-wioa-backup-fresh rc=1 [!] svc fail2ban activating

[ ] disk / 59% [!] mem 96% [~] cmd ct115-docker-host: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 115 | grep -q running && /usr/sbin/pct exec 115 -- docker info >/dev/null 2>&1 )' timed out after 20 seconds [ ] docker-npm ok [ ] docker-arcane ok [ ] prometheus-host ok [ ] alertmanager-host ok [~] cmd docker-grafana: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct exec 115 -- docker inspect -f '{{.State.Status}}' grafana-mon 2>/dev/null)" = running ] )' timed out after 20 seconds [ ] pbs-host ok [ ] pbs-service ok [ ] db108-host ok [ ] db108-mariadb ok [~] cmd db108-postgresql: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- sh -c "ps aux 2>/dev/null | grep -q '[p]ostgres'" )' timed out after 20 seconds [~] cmd db108-redis: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- rc-service redis status >/dev/null 2>&1 )' timed out after 20 seconds [ ] mailcow-host ok [ ] nc103-host ok [ ] nc103-mariadb ok [ ] nc103-apache2 ok [!] load 6.92 [ ] cert-tequeremos ok [ ] nc103-backup-fresh ok [ ] ct110-mssql-up ok [~] ct110-wioa-backup-fresh rc=1 [!] svc fail2ban activating

[ ] disk / 59% [!] mem 96% [ ] ct115-docker-host ok [ ] docker-npm ok [~] cmd docker-arcane: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct exec 115 -- docker inspect -f '{{.State.Status}}' arcane-agent 2>/dev/null)" = running ] )' timed out after 20 seconds [ ] prometheus-host ok [ ] alertmanager-host ok [ ] docker-grafana ok [ ] pbs-host ok [ ] pbs-service ok [ ] db108-host ok [ ] db108-mariadb ok [ ] db108-postgresql ok [~] cmd db108-redis: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- rc-service redis status >/dev/null 2>&1 )' timed out after 20 seconds [ ] mailcow-host ok [ ] nc103-host ok [ ] nc103-mariadb ok [ ] nc103-apache2 ok [!] load 5.11 [ ] cert-tequeremos ok [ ] nc103-backup-fresh ok [ ] ct110-mssql-up ok [~] ct110-wioa-backup-fresh rc=1 [!] svc fail2ban activating

Auto-paused a FLOODING content from 'agent:vmi2642308' after 3 identical URGENT alerts in 24h (threshold 3). Only THIS content is suppressed — other/new alerts from 'agent:vmi2642308' still deliver, and this one re-surfaces periodically as context. Resume by resolving this ticket (or clear [59bcf859e42f] from ~/.notify/.paused). Content: [agent:vmi2642308] URGENT vmi2642308 6/24 checks failing

[ ] disk / 59% [!] mem 96% [ ] ct115-docker-host ok [ ] docker-npm ok [ ] docker-arcane ok [ ] prometheus-host ok [ ] alertmanager-host ok [ ] docker-grafana ok [ ] pbs-host ok [ ] pbs-service ok [ ] db108-host ok [ ] db108-mariadb ok [ ] db108-postgresql ok [ ] db108-redis ok [ ] mailcow-host ok [ ] nc103-host ok [ ] nc103-mariadb ok [ ] nc103-apache2 ok [!] load 4.41 [ ] cert-tequeremos ok [ ] nc103-backup-fresh ok [~] cmd ct110-mssql-up: Command '/usr/sbin/pct config 110 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct status 110 2>/dev/null | awk '{print $2}')" = "running" ] && /usr/sbin/pct exec 110 -- systemctl is-active --quiet mssql-server )' timed out after 20 seconds [~] ct110-wioa-backup-fresh rc=1 [!] svc fail2ban activating

[ ] disk / 59% [!] mem 96% [~] cmd ct115-docker-host: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 115 | grep -q running && /usr/sbin/pct exec 115 -- docker info >/dev/null 2>&1 )' timed out after 20 seconds [~] cmd docker-npm: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct exec 115 -- docker inspect -f '{{.State.Status}}' npm 2>/dev/null)" = running ] )' timed out after 20 seconds [ ] docker-arcane ok [ ] prometheus-host ok [ ] alertmanager-host ok [ ] docker-grafana ok [ ] pbs-host ok [ ] pbs-service ok [ ] db108-host ok [ ] db108-mariadb ok [~] cmd db108-postgresql: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- sh -c "ps aux 2>/dev/null | grep -q '[p]ostgres'" )' timed out after 20 seconds [ ] db108-redis ok [ ] mailcow-host ok [ ] nc103-host ok [ ] nc103-mariadb ok [ ] nc103-apache2 ok [!] load 5.74 [ ] cert-tequeremos ok [ ] nc103-backup-fresh ok [ ] ct110-mssql-up ok [~] ct110-wioa-backup-fresh rc=1 [!] svc fail2ban activating

[ ] disk / 59% [!] mem 96% [ ] ct115-docker-host ok [ ] docker-npm ok [ ] docker-arcane ok [ ] prometheus-host ok [ ] alertmanager-host ok [ ] docker-grafana ok [ ] pbs-host ok [ ] pbs-service ok [ ] db108-host ok [ ] db108-mariadb ok [ ] db108-postgresql ok [ ] db108-redis ok [ ] mailcow-host ok [ ] nc103-host ok [ ] nc103-mariadb ok [ ] nc103-apache2 ok [ ] load 2.91 [ ] cert-tequeremos ok [ ] nc103-backup-fresh ok [ ] ct110-mssql-up ok [~] ct110-wioa-backup-fresh rc=1 [!] svc fail2ban activating

[ ] disk / 59% [!] mem 96% [~] cmd ct115-docker-host: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 115 | grep -q running && /usr/sbin/pct exec 115 -- docker info >/dev/null 2>&1 )' timed out after 20 seconds [~] cmd docker-npm: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct exec 115 -- docker inspect -f '{{.State.Status}}' npm 2>/dev/null)" = running ] )' timed out after 20 seconds [ ] docker-arcane ok [ ] prometheus-host ok [ ] alertmanager-host ok [ ] docker-grafana ok [ ] pbs-host ok [ ] pbs-service ok [~] cmd db108-host: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 108 | grep -q running )' timed out after 20 seconds [~] cmd db108-mariadb: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- sh -c "ps aux 2>/dev/null | grep -q '[m]ariadbd'" )' timed out after 20 seconds [~] cmd db108-postgresql: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- sh -c "ps aux 2>/dev/null | grep -q '[p]ostgres'" )' timed out after 20 seconds [~] cmd db108-redis: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- rc-service redis status >/dev/null 2>&1 )' timed out after 20 seconds [ ] mailcow-host ok [~] cmd nc103-host: Command '/usr/sbin/pct config 103 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 103 | grep -q running )' timed out after 20 seconds [ ] nc103-mariadb ok [ ] nc103-apache2 ok [!] load 14.04 [ ] cert-tequeremos ok [ ] nc103-backup-fresh ok [~] cmd ct110-mssql-up: Command '/usr/sbin/pct config 110 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct status 110 2>/dev/null | awk '{print $2}')" = "running" ] && /usr/sbin/pct exec 110 -- systemctl is-active --quiet mssql-server )' timed out after 20 seconds [~] ct110-wioa-backup-fresh rc=1 [!] svc fail2ban activating

[ ] disk / 59% [!] mem 97% [~] cmd ct115-docker-host: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 115 | grep -q running && /usr/sbin/pct exec 115 -- docker info >/dev/null 2>&1 )' timed out after 20 seconds [ ] docker-npm ok [~] cmd docker-arcane: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct exec 115 -- docker inspect -f '{{.State.Status}}' arcane-agent 2>/dev/null)" = running ] )' timed out after 20 seconds [ ] prometheus-host ok [ ] alertmanager-host ok [~] cmd docker-grafana: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct exec 115 -- docker inspect -f '{{.State.Status}}' grafana-mon 2>/dev/null)" = running ] )' timed out after 20 seconds [ ] pbs-host ok [ ] pbs-service ok [~] cmd db108-host: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 108 | grep -q running )' timed out after 20 seconds [~] cmd db108-mariadb: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- sh -c "ps aux 2>/dev/null | grep -q '[m]ariadbd'" )' timed out after 20 seconds [~] cmd db108-postgresql: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- sh -c "ps aux 2>/dev/null | grep -q '[p]ostgres'" )' timed out after 20 seconds [~] cmd db108-redis: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- rc-service redis status >/dev/null 2>&1 )' timed out after 20 seconds [~] cmd mailcow-host: Command '/usr/sbin/pct config 111 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 111 | grep -q running )' timed out after 20 seconds [~] cmd nc103-host: Command '/usr/sbin/pct config 103 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 103 | grep -q running )' timed out after 20 seconds [~] cmd nc103-mariadb: Command '/usr/sbin/pct config 103 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 103 -- systemctl is-active mariadb >/dev/null 2>&1 )' timed out after 20 seconds [~] cmd nc103-apache2: Command '/usr/sbin/pct config 103 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 103 -- systemctl is-active apache2 >/dev/null 2>&1 )' timed out after 20 seconds [!] load 40.80 [ ] cert-tequeremos ok [~] cmd nc103-backup-fresh: Command '/usr/sbin/pct config 103 2>/dev/null | grep -q '^lock: backup' || /usr/sbin/pct exec 103 -- /usr/local/sbin/backup-fresh-log.sh /var/log/mysql-backup-cron.log 30' timed out after 20 seconds [~] cmd ct110-mssql-up: Command '/usr/sbin/pct config 110 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct status 110 2>/dev/null | awk '{print $2}')" = "running" ] && /usr/sbin/pct exec 110 -- systemctl is-active --quiet mssql-server )' timed out after 20 seconds [~] ct110-wioa-backup-fresh rc=1 [!] svc fail2ban activating

[ ] disk / 59% [!] mem 96% [~] cmd ct115-docker-host: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct status 115 | grep -q running && /usr/sbin/pct exec 115 -- docker info >/dev/null 2>&1 )' timed out after 20 seconds [~] cmd docker-npm: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct exec 115 -- docker inspect -f '{{.State.Status}}' npm 2>/dev/null)" = running ] )' timed out after 20 seconds [~] cmd docker-arcane: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct exec 115 -- docker inspect -f '{{.State.Status}}' arcane-agent 2>/dev/null)" = running ] )' timed out after 20 seconds [ ] prometheus-host ok [ ] alertmanager-host ok [~] cmd docker-grafana: Command '/usr/sbin/pct config 115 2>/dev/null | grep -q '^lock: backup' || ( [ "$(/usr/sbin/pct exec 115 -- docker inspect -f '{{.State.Status}}' grafana-mon 2>/dev/null)" = running ] )' timed out after 20 seconds [ ] pbs-host ok [ ] pbs-service ok [ ] db108-host ok [ ] db108-mariadb ok [ ] db108-postgresql ok [~] cmd db108-redis: Command '/usr/sbin/pct config 108 2>/dev/null | grep -q '^lock: backup' || ( /usr/sbin/pct exec 108 -- rc-service redis status >/dev/null 2>&1 )' timed out after 20 seconds [ ] mailcow-host ok [ ] nc103-host ok [ ] nc103-mariadb ok [ ] nc103-apache2 ok [!] load 6.97 [ ] cert-tequeremos ok [ ] nc103-backup-fresh ok [ ] ct110-mssql-up ok [~] ct110-wioa-backup-fresh rc=1 [!] svc fail2ban activating