I've been building MCPSpec, an open-source CLI for MCP server reliability. Record sessions, generate mock servers, catch Tool Poisoning, and fail your CI build when something's wrong — without writing test code.

There are ways to validate MCP servers today — the MCP Inspector, ad-hoc SDK scripts, unit tests for server internals — but nothing that handles regression detection, security auditing, mock generation, and CI pass/fail checks in one tool. MCPSpec does that:

1. Record a session against your real server, replay it after changes to catch regressions

2. Generate a standalone .js mock from any recording — no API keys, no live server needed in CI

3. Security audit with 8 rules including Tool Poisoning (prompt injection hidden in tool descriptions)

4. 0-100 quality score across documentation, schema quality, error handling, responsiveness, and security

5. One command to generate GitHub Actions / GitLab CI configs

No LLMs in the loop. Deterministic and fast. Ships with 70 ready-to-run tests for 7 popular MCP servers.

GitHub: https://github.com/light-handle/mcpspec Docs: https://light-handle.github.io/mcpspec/

Would love feedback or feature ideas.