finds.dev

ray-project/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

View on GitHubHomepage ↗

★ 42,871PythonApache-2.0updated Jun 2026

// the take

Ray is a distributed computing framework for Python that lets you scale workloads from a laptop to a multi-node cluster with minimal code changes. It ships a core task/actor model plus higher-level libraries for training, serving, hyperparameter search, and RL. The target audience is ML engineers who have outgrown single-machine compute but don't want to write Spark or manage Kubernetes job orchestration themselves.

The core abstraction is genuinely good — decorating a function with @ray.remote and calling .remote() is about as low-friction as distributed computing gets. Ray Serve stands out for LLM serving: it handles model loading, replica autoscaling, and request batching in a way that would take weeks to build yourself. The object store uses shared memory for zero-copy reads between co-located workers, which matters a lot when you're passing large tensors around. The CI infrastructure (Buildkite, Bazel, per-library test sharding) is serious engineering — this is not a project that ships broken releases.

Debugging failures in a distributed Ray cluster is genuinely painful — the dashboard helps, but stack traces from remote tasks are truncated and error attribution across actor boundaries is still confusing after years of complaints. The library surface area (Data, Train, Tune, RLlib, Serve) means each sub-library is at a different maturity level; RLlib in particular has been through enough API breaks that production users tend to pin aggressively and dread upgrades. Local development on Windows is second-class — some features require WSL or simply don't work. Ray's head-node architecture is a single point of failure; if the head node dies, the whole cluster goes down, which surprises people coming from systems with proper HA built in.

We read the README, the directory tree and a key source file in June 2026. Nobody pays to be listed. How we judge →

// at a glance

Stars
42,871
Forks
7,684
Language
Python
License
Apache-2.0
Last commit
14 Jun 2026

// nearby

If ray isn't quite it.

All repos →