Event-Driven Alert Pipeline

A research routine writes long-form reports to disk several times a day, and each one buries a handful of actionable items inside thousands of words of prose. Reading them end to end is the part nobody keeps doing. This pipeline watches the folder instead. The moment a report lands it extracts every qualifying item, decides whether that item is genuinely new, a material change to something already sent, or a repeat worth suppressing, and delivers the survivors as structured alerts with the relevant chart attached.

A file watcher fires on write rather than on a polling interval, so an alert lands about two seconds after a report is saved. A parser locates the relevant sections and splits them per item, using layered fallbacks for every field because the source formatting drifted repeatedly over months. Each field then passes a single redaction gate before it can be shipped. A three-layer dedup, combining a short burst guard, a per-item content fingerprint, and a rolling history, classifies each item, and the renderer builds the message and resolves a matching chart before delivery.

A condensed view of the real node graph.

Nearly a thousand unattended production runs with a single failure, over roughly three months. Alert latency fell from a five-minute polling window to about two seconds. Most runs deliberately resolve to suppression, which is the point: the dedup layers are what keep the destination readable rather than noisy.

• Deduplicating event bursts from a polling file watcher, where an atomic save emits several events for what is logically one write
• Parsing free-form generated prose whose formatting drifted over months, which forced layered fallbacks on nearly every extracted field
• Guaranteeing nothing sensitive reaches a shared destination by gating every outbound field through one redaction pass rather than filtering the finished message
• Keeping durable dedup state with no extra infrastructure, using the workflow's own static store with time-based pruning and bounded key sets