finds.dev

confluentinc/librdkafka

The Apache Kafka C/C++ library

View on GitHub

★ 1,079CNOASSERTIONupdated Oct 2026

// the take

librdkafka is the C/C++ client for the Apache Kafka protocol that almost every non-JVM Kafka client wraps under the hood — confluent-kafka-python, confluent-kafka-go, node-rdkafka, rust-rdkafka, rdkafka-ruby, php-rdkafka, and more all sit on top of it. It's for anyone building a Kafka client in a language that isn't Java, or anyone embedding Kafka producer/consumer logic directly in a C/C++ application.

Protocol coverage is genuinely complete: full exactly-once semantics, idempotent and transactional producers, SASL (GSSAPI/PLAIN/SCRAM/OAUTHBEARER) and SSL, broker compatibility back to 0.8. The ABI stability guarantee for the C API matters in practice — it means the dozen-plus language bindings built on it can ship librdkafka upgrades without forcing a recompile of every downstream consumer. Performance claims (1M+ msgs/sec produce, 3M+ consume) aren't marketing fluff here; this is the library every other ecosystem benchmarks itself against. Packaging is broad — apt, yum, Homebrew, vcpkg, NuGet for Windows — so you're rarely building from source unless you need a specific patch version.

The raw C API is callback-driven with manual memory management (rd_kafka_message_destroy, queue polling, etc.) — it's easy to leak or misuse directly, which is why almost nobody uses it unwrapped; you're really evaluating whether to trust the binding built on top of it, not this repo itself. Community support is explicitly limited to the latest release only, so if a language binding pins an older version, you're on your own for bugs. The CMake build is flagged 'experimental (unsupported)', meaning the real supported path is the GNU-toolchain configure/make flow, which is a worse experience on Windows than the prebuilt NuGet package implies for anyone trying to build from source. Schema Registry isn't built in — the official example leans on a separate libschemaregistry + avro-cpp, so if you need schema validation you're wiring up another dependency yourself. The new Share Consumer / Queues for Kafka (KIP-932) support is explicitly Preview and requires a very recent broker (4.2+), so don't reach for it in production yet.

We read the README, the directory tree and a key source file in October 2026. Nobody pays to be listed. How we judge →

// at a glance

Stars
1,079
Forks
3,275
Language
C
License
NOASSERTION
Last commit
30 Oct 2026

// nearby

If librdkafka isn't quite it.

All repos →