Search: github.com/crawl | Heykuki News

Heykuki News

Top New Best Ask Show Jobs

Top New Best Ask Show Jobs

1.

Show HN: Crawlee for Python – a web scraping and browser automation library (crawlee.dev)

254 points

2 years ago

2.

Ask HN: How to approach writing a web crawler that can handle JavaScript?

4 points

10 years ago

3.

Show HN: Crawlee Cloud Self-hosted platform for running Crawlee and Apify actor (crawlee.cloud)

4 points

5 months ago

4.

Ask HN: What do you use (AI based) web crawlers for?

3 points

4 months ago

5.

Show HN: Crawlab: Open-Source Web Crawler Admin Platform That Runs Any Language (github.com/tikazyq)

116 points

7 years ago

6.

Dungeon Crawl: Stone Soup (github.com/crawl)

98 points

9 years ago

7.

Crawl4AI is an open-source, LLM-friendly web crawler and scraper (github.com/unclecode)

7 points

a year ago

8.

Crawly – Elixir web scraping framework (github.com/elixir-crawly)

7 points

3 years ago

9.

Distributed Web Crawler Management Platform (github.com/crawlab-team)

7 points

6 years ago

10.

Crawl4AI: Open-Source Web Crawler for Seamless AI Data Scraping (github.com/unclecode)

6 points

2 years ago

11.

Show HN: An open source web crawler for the Mwmbl non-profit search engine (github.com/mwmbl)

6 points

4 years ago

12.

Show HN: An open source web crawler for the Mwmbl non-profit search engine (github.com/mwmbl)

4 points

4 years ago

13.

crawl4ai: The Adaptive Intelligence Update (github.com/unclecode)

4 points

a year ago

14.

Announcing Crawler v1.0.0 – easy web crawling / scraping powered by Elixir (github.com/fredwu)

4 points

9 years ago

15.

Crawl Code – because prompting was a text adventure (github.com/machinarii)

3 points

2 months ago

16.

Automatic Web Content Detection (github.com/crawlab-team)

3 points

3 years ago

17.

Qcrawl: Fast async web crawling and scraping framework for Python (github.com/crawlcore)

2 points

6 months ago

18.

Launching Crawlee for Python v1.0 to simplify building web scrapers and crawlers (github.com/apify)

2 points

8 months ago

19.

Show HN: Crawl - python module for finding files in a set of paths. (github.com/OiNutter)

2 points

13 years ago

20.

Pythonic Crawling / Scraping Framework Built on Eventlet (github.com/jmg)

2 points

14 years ago

21.

Crawl4AI (github.com/unclecode)

2 points

2 years ago

22.

Crawlee: Crawlee–build reliable crawlers. Works with Puppeteer, Playwright, Ch (github.com/apify)

2 points

2 years ago

23.

Show HN: Mwmbl crawler extension: crawl the web from Firefox (github.com/mwmbl)

2 points

4 years ago

24.

Crawlab: Distributed web crawler admin platform for spiders management (github.com/crawlab-team)

2 points

6 years ago

25.

Crawlab: Crawler Admin Platform Managing Any Web Crawler (github.com/tikazyq)

2 points

7 years ago

26.

A golang crawler (github.com/kai712)

2 points

8 years ago

27.

Crawlpy: python crawler with login (handles CSRF), cust depth lvl and save to disk (github.com/cytopia)

2 points

10 years ago

28.

Crawlp (github.com/zzengineer)

2 points

10 years ago

29.

Rust Programmer Join the Party, first binary project "crawler" (github.com/ALAWIII)

1 point

a year ago

30.

Using GPT for Automated Crawling (github.com/gh18l)

1 point

3 years ago