finds.dev← search

// the find

dataprofessor/llama2

★ 379 · Python · updated Sep 2024

This chatbot app is built using the Llama 2 open source LLM from Meta.

A minimal Streamlit chatbot that wraps the Llama 2 model via Replicate's hosted API. It's a teaching demo, not a production tool — the whole point is showing students how to wire a hosted LLM into a Streamlit app in under 100 lines.

The simplicity is genuine: two dependencies, one file, deployable to Streamlit Community Cloud in minutes. Good starting point for Python beginners who want a tangible LLM project without local GPU setup. The notebook version lets you step through the logic interactively.

Hardcoded dependency on a16z's Replicate deployment, which is unmaintained and likely dead — the demo link is broken and the underlying model endpoint was deprecated. Llama 2 itself is now two generations behind; this code teaches patterns that were current in mid-2023. No conversation memory management, no token budget, no error handling — the kind of gaps that matter the moment you try to do anything real with it. Four nearly-identical files (app_v1.py, streamlit_app.py, streamlit_app_v2.py, llama2-local.py) with no explanation of what differs between them.

View on GitHub → Homepage ↗

// want more like this?

We dig through GitHub every week and send a few repos picked for what you actually care about — each with an honest take like this one.

Get finds in your inbox → Search again →