Try out coderabbit.ai pull request reviewer

[pavelzw]

As everyone in the open source world, in rattler we are dealing with an increasing amount of AI-generated PRs.
I can notice some clear patterns that I would like to avoid. One pattern is that people are not using the PR template

conda/rattler#2183 (comment) for those kinds of tasks i think coderabbit could help out quite a lot.
Define some clear and easy-to-verify (for an AI) rules that must be followed, otherwise ci will stay red (see how the pre-merge checks change here: oven-sh/bun#26619 (comment))

[travishathaway]

I think this could be a nice addition, but I'm also concerned that we become overly reliant on a "free" service that could theoretically force OSS projects to pay for continuing to use the services in the future.

I think that risk is fairly low here because these additional checks are "nice to have" and not strictly necessary for maintaining a project. If code rabbit disappears over night, it likely wouldn't be a huge burden on the projects.

I think codspeed is the closest thing related to this service that the conda project currently uses (free for OSS with limited features).

Anyways, all of this is a long winded way of saying that I agree, but with a warning about becoming locked into something we may eventually be forced to pay for.

[travishathaway]

Maybe just to propose something that could be a free alternative: what about just having a "magic string" in our PR templates and then programming conda-bot to lint the PR based on finding that string? Or even just using a regex?

Seems like that wouldn't be too hard to add, right?

[pavelzw]

I think ai-based tools are the better way here. I don't want to bother writing arbitrary rules in code that check certain things, this is IMO done much better in free-text.

[pavelzw]

i'll try the tools out on my personal repos and report back