Readit News logoReadit News
Posted by u/bdstanga a year ago
Show HN: Pull Request Reviewed by LLMgithub.com/presubmit/eban...
This year I’ve reviewed more than 1000 code changes. Most of the time was spent catching obvious mistakes rather than debating complex design decisions. If we estimate ~10 minutes per review, that’s 160+ hours spent reviewing code in just one year.

So I thought: could I get some of that time back using LLMs?

That's why I spent the last few weekends building an LLM-based prereviewer that should take a first pass before the actual human reviewer. The results so far are promising: I estimate it can reduce the review time by 50%, which in my case would mean I save 80hours (~10 working days) per year.

Linked above is an example of a PR where I'm testing the AI reviewer and it showcase how it can detect bugs, suggest best practices about token validity, generate summary and title, and even chat with me in review comments.

The AI reviewer is a simple Github action that runs everytime I open or synchronize a pull request and you can see the source code at https://github.com/presubmit/ai-reviewer.

smcleod · a year ago
I use PR-Agent for this, it's great
bdstanga · a year ago
Cool! Curious what do you like most about it compared to other solutions?
smcleod · a year ago
Commenting on PRs with suggested improvements is a big win to reduce the context switching senior engineers face reviewing junior developers PRs all day, giving a review complexity rating that can be used to route PRs to the right people is good as all. Of course being open source, platform agnostic is a massive win.