Over the past few months, we’ve developed a new mutation testing tool that’s easy to use and compatible with any programming language. We believe LLM-based injections are the future for generating relevant faults and automating the process of analyzing surviving mutants to better fix bugs and improve test suites.
Our approach to mutation testing is as follows: first, use Extreme Mutation Testing to cover all pseudo-tested methods, and then use LLM to inject relevant mutants. LLMs will also specifically guide users on where to improve the test suite or fix the codebase so that developers don’t have to manually go through the surviving mutants. We envision mutation testing to be something like Netflix’s Chaos Monkey, injecting relevant faults and seeing how your system breaks. We are currently developing these features to make mutation testing more seamless and easier during the development process, so that more and more people get used to using mutation testing.
Please give it a try, and we’d appreciate any feedback from you guys. Excited to see how this turns out!