Show HN: Pull Request Reviewed by LLM

9 points

2 years ago

This year I’ve reviewed more than 1000 code changes. Most of the time was spent catching obvious mistakes rather than debating complex design decisions. If we estimate ~10 minutes per review, that’s 160+ hours spent reviewing code in just one year.

So I thought: could I get some of that time back using LLMs?

That's why I spent the last few weekends building an LLM-based prereviewer that should take a first pass before the actual human reviewer. The results so far are promising: I estimate it can reduce the review time by 50%, which in my case would mean I save 80hours (~10 working days) per year.

Linked above is an example of a PR where I'm testing the AI reviewer and it showcase how it can detect bugs, suggest best practices about token validity, generate summary and title, and even chat with me in review comments.

The AI reviewer is a simple Github action that runs everytime I open or synchronize a pull request and you can see the source code at https://github.com/presubmit/ai-reviewer.

5 comments