finds.dev← search

// the find

Germey/AwesomeWebScraping

★ 267 · Makefile · NOASSERTION · updated Mar 2026

List of libraries, tools and APIs for web scraping and data processing.

A Chinese-language fork of lorien/awesome-web-scraping, collecting libraries and tools for web scraping across Python, PHP, Ruby, JavaScript, and Go. It's a reference list, not a framework or tool itself. The target audience is developers who want a starting point for picking scraping dependencies.

Covers multiple languages in separate files, which is more navigable than one monolithic list. Links back to the original lorien/awesome-web-scraping so you can cross-reference. Includes a dedicated web services section for hosted scraping APIs, which saves time when you don't want to run your own infrastructure. Still receiving commits in 2026.

This is a fork of an existing list with 267 stars vs the original's thousands — you're better off going to the source. The README is entirely in Chinese with no English translation, which limits its reach. The actual content lives in markdown files that link to lorien's repo, so this is more a mirror than an independent resource. No quality signals on the listed tools — no indication of which libraries are actively maintained vs abandoned.

View on GitHub →

// want more like this?

We dig through GitHub every week and send a few repos picked for what you actually care about — each with an honest take like this one.

Get finds in your inbox → Search again →