Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Login
Top
New
Best
Ask
Show
Jobs
151.
▲
sponge: A website crawler and links downloader command line tool
(github.com/spypunk)
6 points
spypunk
6 years ago
discuss
152.
▲
Show HN: The dht(distributed hash table) network crawler
(github.com/NanYoMy)
5 points
dingwangbin
11 years ago
1 comment
153.
▲
Show HN: CLI for crawling documentation sites into Markdown with defuddle
(github.com/artemnistuley)
5 points
nistuley
2 days ago
discuss
154.
▲
Show HN: Sukhoi A highly flexible Web Crawler in Python
(github.com/untwisted)
5 points
risinho
5 years ago
discuss
155.
▲
Show HN: A web app authorization crawler and scanner using Puppeteer
(github.com/authcov)
5 points
authcov
7 years ago
discuss
156.
▲
Show HN: Script on Top of Python Sukhoi Web Crawler Framework to Apply for Jobs
(github.com/iogf)
5 points
iogf
7 years ago
discuss
157.
▲
Show HN: A distributed and persistent web crawler written in Go
(github.com/schollz)
5 points
qrv3w
9 years ago
discuss
158.
▲
JDistiller, A DSL for web-crawling built on Node.js and jQuery
(github.com/bcoe)
4 points
BenjaminCoe
14 years ago
2 comments
159.
▲
GitHub prevents crawling of repository's Wiki pages – no Google search
(github.com/isaacs)
4 points
bondarchuk
3 years ago
2 comments
160.
▲
Anubis Solver: Can Anubis Prevent AI Crawlers?
(github.com/huzpsb)
4 points
huzpsb
9 months ago
1 comment
161.
▲
OpenAI ChatGPT Crawler Vulnerability: Unauthenticated Reflective DDoS
(github.com/bf)
4 points
blendergeek
a year ago
1 comment
162.
▲
Show HN: Exoskeleton – a framework for polite, but tenacious crawlers
(github.com/RuedigerVoigt)
4 points
RuedigerVoigt
6 years ago
1 comment
163.
▲
Anubis weighs the soul of incoming HTTP requests to stop AI crawlers
(github.com/TecharoHQ)
4 points
rzk
2 months ago
discuss
164.
▲
Sponge 1.30: A website crawler and links downloader command line tool
(github.com/spypunk)
4 points
spypunk
6 years ago
discuss
165.
▲
Show HN: Highly configurable web crawler focused on downloads
(github.com/ERap320)
4 points
ERap320
6 years ago
discuss
166.
▲
Geziyor, a fast web crawling and scraping framework for Go
(github.com/geziyor)
4 points
jinqueeny
7 years ago
discuss
167.
▲
Colly: Elegant Scraper and Crawler Framework for Golang
(github.com/gocolly)
4 points
timundo
8 years ago
discuss
168.
▲
Show HN: Python web crawling framework for everyone based on asyncio
(github.com/gaojiuli)
4 points
gaojiuli
9 years ago
discuss
169.
▲
Sponge 0.22: A website crawler and links downloader command line tool
(github.com/spypunk)
3 points
spypunk
6 years ago
3 comments
170.
▲
Simple Cloudflare Worker that serves Markdown to AI crawlers
(github.com/thekevinm)
3 points
thekevinm
8 months ago
2 comments
171.
▲
S0md3v/Photon: Incredibly fast crawler
(github.com/s0md3v)
3 points
axiomdata316
8 years ago
1 comment
172.
▲
Simple web crawler using python
(gist.github.com)
3 points
anujku
11 years ago
discuss
173.
▲
Show HN: Feedstock – Web Crawler for TypeScript Built on Bun and Playwright
(github.com/tylergibbs1)
3 points
tylergibbs1
2 months ago
discuss
174.
▲
Scouter – An open-source SEO crawler with a full analysis UI
(github.com/lokoe-mehdi)
3 points
lokoe
3 months ago
discuss
175.
▲
Show HN: My Python text-based dungeon crawler game engine
3 points
ruscoe
a year ago
discuss
176.
▲
AutoCrawler: A Progressive Understanding Web Agent for Web Crawler Generation
(github.com/EZ-hwh)
3 points
saeedesmaili
2 years ago
discuss
177.
▲
Show HN: Use GPT to chat with what you crawl
(github.com/leonid20000)
3 points
forgottPassword
2 years ago
discuss
178.
▲
Nebula – A Network Agnostic DHT Crawler (IPFS, Ethereum, Polkadot, and More))
(github.com/dennis-tra)
3 points
dennis-tra
3 years ago
discuss
179.
▲
Colly: Elegant Scraper and Crawler Framework for Golang
(github.com/gocolly)
3 points
throwoutway
3 years ago
discuss
180.
▲
Linkinator: A super simple site crawler and broken link checker
(github.com/JustinBeckwith)
3 points
breck
5 years ago
discuss
More