Meet silkworm-rs: a fast, async web scraping framework for Python built on Rust components (rnet and scraper-rs). It features browser impersonation, typed spiders, and built-in pipelines (SQLite, CSV, Taskiq) without the boilerplate. With configurable concurrency and robust middleware, it’s designed for efficient, scalable crawlers.
2 comments
Show HN: Async web scraping framework on top of Rust | Heykuki News