Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Login
Top
New
Best
Ask
Show
Jobs
31.
▲
Crawl4AI: Open-Source LLM Friendly Web Crawler and Scraper
(github.com/unclecode)
1 point
zoooey
7 months ago
discuss
32.
▲
Crawl4ai – open-source web crawler for your AI agent
(github.com/unclecode)
1 point
basic_banana
a year ago
discuss
33.
▲
A Crawler Admin GitHub Project Reaching 5k Stars in 1 Year
(github.com/crawlab-team)
1 point
tikazyq
6 years ago
discuss
34.
▲
A 50 lines, minimalist Node.js crawler for GitHub-Trending,just try it
(github.com/ZY2071)
1 point
zy_2071
7 years ago
discuss
35.
▲
Crawlpy: python crawler with login (handles CSRF), dynamic depth and save to disk
(github.com/cytopia)
1 point
everythingcli
10 years ago
discuss
36.
▲
Crawlpy: python crawler with login (handles CSRF), dynamic depth and save to disk
(github.com/cytopia)
1 point
everythingcli
10 years ago
discuss
37.
▲
Quick but powerful research for AI agents with data scrapping and selenium
8 points
alexvomwald
a year ago
6 comments
38.
▲
Show HN: Flatagents: State machine orchestration with stateless LLM agents
(github.com/memgrafter)
4 points
beacon294
5 months ago
1 comment
39.
▲
Show HN: Ask questions to your tech stack documentation
(ask-your-stack.vercel.app)
4 points
tudorg
3 years ago
discuss
40.
▲
Show HN: Simple Crawling Server
(github.com/rumca-js)
2 points
renegat0x0
a year ago
1 comment
41.
▲
Show HN: ETL System to Extract Product Data from Websites and Upload to Shopify
(github.com/GustavoFortti)
2 points
gustavofortti
a year ago
discuss
42.
▲
Show HN: SiteOne Crawler – in-depth website analyzer and exporter (open-source)
(github.com/janreges)
32 points
janreges
2 years ago
2 comments
43.
▲
Ether Crawler – A dungeon crawler and challenge market based on Ethereum
(github.com/ConsenSys)
9 points
phodo
11 years ago
2 comments
44.
▲
Show HN: A Node.js script powered by Puppeteer for undetectable web scraping
(github.com/darkotodoric)
6 points
darkotodoric
2 years ago
2 comments
45.
▲
Show HN: Get paid for crawling the web
(github.com/datafiniti)
5 points
jdrock
12 years ago
7 comments
46.
▲
Show HN: Python Testing Crawler – spider your Flask or Django website in tests
(github.com/python-testing-crawler)
5 points
wodow
6 years ago
1 comment
47.
▲
Show HN: SiteOne Crawler – Single-binary CI/CD gate for web quality regressions
(github.com/janreges)
3 points
janreges
3 months ago
2 comments
48.
▲
Show HN: A Simple Web Crawler with Spring, Postgres and Redis
(github.com/firattamur)
3 points
engineerick
2 years ago
1 comment
49.
▲
Show HN: PDF Crawler
(github.com/zillabyte)
3 points
cblock811
12 years ago
discuss
50.
▲
Social crawler – Discover social share count of all pages on your website
(github.com/AbhishekGahlot)
3 points
abhishek_it
12 years ago
discuss
51.
▲
Kickstarter-crawler: 35+ data points. utilize 61,356 kickstarter urls (node)
(github.com/ghostsnstuff)
3 points
jaredhalpert
12 years ago
discuss
52.
▲
Open-source toolkit to download EDGAR financial reports
(github.com/nlpaueb)
3 points
pppoe
2 years ago
discuss
53.
▲
Amazon Web Crawler
(github.com/yashpokar)
3 points
yashpokar
8 years ago
discuss
54.
▲
Show HN: Domain Crawler
(github.com/zillabyte)
2 points
cblock811
12 years ago
2 comments
55.
▲
Turn any site into a custom GPT with just a URL
(github.com/BuilderIO)
2 points
steve8708
3 years ago
2 comments
56.
▲
Show HN: A super simple webcrawler framework written in Python
(github.com/mrafayaleem)
2 points
iamspoilt
10 years ago
2 comments
57.
▲
Node.js Web Crawler
(github.com/sylvinus)
2 points
jwdunne
12 years ago
discuss
58.
▲
Show HN: Turn Any Website into Clean Markdown for LLMs/RAG with SiteOne Crawler
(github.com/janreges)
2 points
janreges
6 months ago
discuss
59.
▲
GPT-crawler – generate knowledge files to create your own custom GPT from a URL
(github.com/BuilderIO)
2 points
javatuts
a year ago
discuss
60.
▲
GPT Crawler: Crawl a site to create your own custom GPT from URLs
(github.com/BuilderIO)
2 points
Gedxx
3 years ago
discuss
More