// the find
fluent/fluent-bit
Fast and Lightweight Logs, Metrics and Traces processor for Linux, BSD, OSX and Windows
Fluent Bit is a CNCF-graduated telemetry agent written in C that collects, transforms, and forwards logs, metrics, and traces. It sits in the same space as Logstash and Vector but trades flexibility for raw performance and a tiny memory footprint. If you're running a Kubernetes cluster and need a DaemonSet log shipper that won't eat your node resources, this is the default choice at this point.
The plugin architecture is genuinely well-designed — 70+ built-in input/output/filter plugins covering everything from tail to Kafka to S3, with extension points in C, Lua, Go, and Wasm without recompiling the core. The SQL stream processing feature is surprisingly useful: you can filter and aggregate log streams with actual SQL queries rather than bolting on a separate stream processor. The project has real CI discipline — unit tests, integration tests, ARM builds, package tests, and fuzz testing all running in CI, with a documented maintenance policy and version lifecycle. Deployment footprint is genuinely small; it's designed to run on embedded targets, which means it won't surprise you on a node with constrained memory.
The configuration format has a long history and it shows — you get both classic INI-style conf files and YAML, and the two don't fully overlap in what they support, which creates quiet gotchas when porting configs. The C codebase means debugging a misbehaving pipeline requires actually understanding C memory management and coroutines; when something goes wrong at high throughput, the error surfacing is often just a dropped message with a log line. The SQL stream processing, while clever, has significant gaps compared to what the docs imply — window functions and joins are limited, so complex real-time analytics will hit walls. The Wasm plugin path is interesting on paper but the toolchain friction (you need to produce a specific ABI target) makes it a rough experience in practice compared to just writing a Go output plugin.