Heykuki News
Top
New
Best
Ask
Show
Jobs
Toggle theme
Login
Top
New
Best
Ask
Show
Jobs
Twitter.com/robots.txt # Crawl-delay: 10 -- Googlebot ignores crawl-delay ftl
twitter.com
2 points
guynamedloren
15 years ago
4 comments
Loading...
Twitter.com/robots.txt # Crawl-delay: 10 -- Googlebot ignores crawl-delay ftl | Heykuki News