Hey everyone,
I've been working on a tool called Web Speed. It takes web pages full of HTML and parses them into an easily readable sitemap for an AI agent. By ensuring the AI doesn't have to analyze the full HTML from the page or screenshots of the page, it makes the agent a lot cheaper and faster. It's MCP-native, so any AI that supports MCP can run it and take control of your browser for you. There are both “normal” and post-auth versions live on GitHub.
What I think is the coolest thing about the project is the global cache of sitemaps. When a user visits a site, it takes the sitemap and sends it up to the server so that later, a person can get that sitemap from the cache, further speeding up the agent. Right now, only the paid API version can access the cache.
I would love your thoughts on the project, any ideas, criticisms, or concerns. I really just want to see if people think that this would be a useful tool. Please reach out if you have any questions about Web Speed.
Repo (OSS): https://github.com/Dominic-Pi-Sunyer/web-speed-oss
Repo (Post-auth): https://github.com/Dominic-Pi-Sunyer
API and Docs: https://getwebspeed.io