Raw sensor data is noisy. A temperature probe that reads 1,847 times in an hour does not need 1,847 rows in a database. It needs a min, max, mean, count, and standard deviation. One row.
CollatrEdge runs processors and aggregators locally. Before the data leaves the device.
The basicstats aggregator uses Welford’s online algorithm for variance. One pass. Constant memory. No matter how many readings arrive in a window, memory usage stays flat.
The filter processor drops readings that match configurable rules. Six evaluation types. Glob patterns for names and tags. The rename processor rewrites metric names and tags in flight.
These run in a pipeline. Input, processor, processor, aggregator, output. Each stage isolated. If a processor throws an error, that metric is dropped. The rest of the pipeline keeps running.
Edge processing is the difference between a useful system and one that drowns in data.