Seth Ryder sethryder

UDM-SE Network app watchdog

Problem

Every so often (roughly weekly) the UniFi Network app on the UDM-SE wedges: CPU sits near 100%, the UI hangs, metrics drop out, and devices get marked offline. systemctl restart unifi fixes it.

Cause, as far as we know

server.log fills with:

ERROR system - Execution failed, could not acquire lock by key[process-stat-<mac>] before timeout
com.ubnt.service.ai...: Failed to acquire lock before timeout

	import boto3
	import time
	from botocore.exceptions import ClientError

	# --- CONFIGURATION ---
	DATABASE_NAME = 'your_database_name'
	VERSIONS_TO_KEEP = 10 # Number of versions to keep per table
	DRY_RUN = True # Set to False to perform actual deletions
	# ---------------------

	#!/bin/bash
	# preprocessing.sh

	POSTGRES_VERSION=14
	POSTGRES_IMAGE="postgresai/extended-postgres:${POSTGRES_VERSION}"

	POOL_NAME=dblab_pool
	MOUNT_DIR=/var/lib/dblab/"${POOL_NAME}"

	# logical mode (with dataset)

	import boto3
	import datetime
	from dateutil.relativedelta import relativedelta
	import logging
	import sys

	logger = logging.getLogger()
	logger.setLevel(logging.INFO)

	def get_dates_to_keep(days_to_keep, weeks_to_keep, months_to_keep):

	{
	"Version": "2012-10-17",
	"Statement": [
	{
	"Effect": "Allow",
	"Action": [
	"ec2:DescribeInstances",
	"ec2:DescribeVolumes",
	"ec2:DescribeTags",
	"ec2:CreateTags"

	<?php

	$option_value_export_plain = file_get_contents('export_plain.txt');
	$option_value_base = file_get_contents('base.txt');

	$export_plain = unserialize($option_value_export_plain);
	$base = unserialize($option_value_base);

	$new_export_plain = [];

	from botocore.vendored import requests
	import json
	import boto3

	def get_cloudfront_ips():
	ip_list = ''
	d = requests.get('https://ip-ranges.amazonaws.com/ip-ranges.json').text
	l = json.loads(d)
	for ip_range in [x['ip_prefix'] for x in l['prefixes'] if x['service']=='CLOUDFRONT' ]:
	ip_list += ip_range + ','

	modules:
	https_2xx:
	prober: http
	timeout: 5s
	http:
	method: GET
	no_follow_redirects: false
	fail_if_ssl: false
	fail_if_not_ssl: true
	preferred_ip_protocol: "ipv4"

	### Keybase proof

	I hereby claim:

	* I am sethryder on github.
	* I am sethryder (https://keybase.io/sethryder) on keybase.
	* I have a public key whose fingerprint is F4E2 F6DC 5EB7 01DF B577 7628 B4F6 78C6 49B5 866D

	To claim this, I am signing this object: