finds.dev

jina-ai/langchain-serve

⚡ Langchain apps in production using Jina & FastAPI

View on GitHubHomepage ↗

★ 1,643PythonApache-2.0updated Sep 2023

// the take

langchain-serve was a deployment wrapper that let you take a LangChain app and ship it to Jina AI Cloud (or self-host via Docker/k8s) by slapping a decorator on your function. The pitch was zero-infrastructure LLM APIs with WebSocket streaming and Slack bot support. It is explicitly abandoned as of September 2023.

The @serving decorator approach was genuinely low-friction for the time — one decorator and you had a REST or WebSocket endpoint without writing any FastAPI boilerplate. WebSocket streaming for LLM output was a real problem in 2023 and this solved it before most alternatives did. The human-in-the-loop WebSocket pattern for agents was a concrete, useful feature rather than a demo toy. Export to Kubernetes/Docker Compose YAML gave you an escape hatch from vendor lock-in.

Dead. The README leads with a deprecation warning and the last commit is September 2023 — LangChain has changed its API multiple times since then, so the code almost certainly doesn't run against current langchain versions without patches. It was tightly coupled to Jina AI Cloud's proprietary infrastructure, which means the self-hosted path was always second-class. Secrets handling by passing them in the request body JSON is a bad pattern that made it into the docs. The whole thing was solving a problem (deploying LangChain apps) that frameworks like LangServe and plain FastAPI now handle without any additional layer.

We read the README, the directory tree and a key source file in June 2026. Nobody pays to be listed. How we judge →

// at a glance

Stars
1,643
Forks
134
Language
Python
License
Apache-2.0
Last commit
20 Sep 2023

// nearby

If langchain-serve isn't quite it.

All repos →