finds.dev

huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

View on GitHubHomepage ↗

★ 161,547PythonApache-2.0updated Jun 2026

// compared · The Best Open Source Machine Learning FrameworksSee the alternatives →

// the take

Transformers is the de-facto standard library for loading, running, and fine-tuning pretrained ML models across text, vision, audio, and multimodal tasks. It acts as a shared model-definition layer that inference engines (vLLM, SGLang, TGI) and training frameworks (Axolotl, DeepSpeed, Unsloth) all build on top of. If you're doing anything with pretrained models in Python, you're probably already using this or will need to.

The Pipeline API is genuinely well-designed — three lines to run inference on any of 1M+ Hub checkpoints, with automatic tokenization and postprocessing handled for you. The intentional no-abstraction-in-model-files philosophy means you can read any model's forward pass as a self-contained file without tracing through five layers of inheritance. Framework interoperability (PyTorch ↔ JAX ↔ TF) is real and well-tested, not a checkbox feature. The ecosystem lock-in is actually a strength here: if your model definition is in Transformers, it just works with the rest of the HuggingFace stack without extra glue.

The Trainer API is a sprawling mess — it tries to cover distributed training, mixed precision, PEFT, deepspeed, and FSDP all in one class, and the result is a ~5000-line file with boolean flags that interact in ways that aren't documented. The library ships hundreds of model architectures, and many older ones are effectively unmaintained — you can load BERT but good luck getting a bug fixed in its tokenizer fast path. Installation with the right CUDA/PyTorch combination is still a ritual that regularly breaks; the extras matrix (`transformers[torch]`, `transformers[tf]`) doesn't protect you from version conflicts downstream. Memory usage at import time is heavy even when you only need one model class, because of the lazy-loading workarounds they've layered on over the years.

We read the README, the directory tree and a key source file in June 2026. Nobody pays to be listed. How we judge →

// at a glance

Stars
161,547
Forks
33,495
Language
Python
License
Apache-2.0
Last commit
12 Jun 2026

// nearby

If transformers isn't quite it.

All repos →