Headline finding
Across disciplines, AI reviews are more structured and engage more directly with a paper's major claims than human reviews, while human judgment remains essential for evaluating contribution and shaping editorial decisions, supporting a complementary model rather than AI replacement.
The manuscript's empirical results across 145,021 comments from three venues consistently support the complementary strengths of AI (structure, claim engagement, technical verification) and human reviewers (contribution, clarity, high-performing critical reviews).
“Together, these findings argue against framing AI as a replacement for human review and instead support a complementary model in which AI scales technical verification of major claims while human judgment remains essential for evaluating contribution and shaping editorial decisions.” · Show in paper