AI-generated peer review reports raise concerns over transparency and accountability in scholarly publishing

A PhD student in the US identified AI-written referee reports, highlighting growing challenges in enforcing policies against generative AI use and maintaining review integrity in scholarly journals.

A philosophy PhD student in the United States has described receiving a journal referee report that, on later inspection, appeared to have been written by an AI system rather than by a human reviewer. The case echoes an earlier warning from Daily Nous, which in 2024 highlighted a study suggesting that between 7% and 17% of sentences in computer science peer reviews may have been generated by large language models, pointing to a problem that appears to be spreading beyond one field.

The student said the first referee’s comments initially seemed thoughtful and constructive, but that another reader later flagged them as sounding machine-generated. After checking with AI detectors, the student said the text appeared highly likely to be fully AI-written. The concern is not just about tone or style. As the Daily Nous post argues, reviewers who upload manuscripts into chatbots may be breaching journal policies, author confidentiality and, in some cases, copyright and data-security obligations. Oxford Academic, for instance, says reviewers must not upload manuscripts or proposals into a generative AI tool for any purpose.

There is also a sharper issue of responsibility. A journal editor asks a named scholar to assess a paper, not to delegate the task to software. On that logic, using AI to draft a report without disclosure can amount to passing off another entity’s work as one’s own. Elsevier says reviewers should not use generative AI or AI-assisted tools to assist with scientific review, and it further warns that reviewers should not upload their own reports into AI systems for polishing, because the report may itself contain confidential material. Taylor & Francis takes a somewhat more permissive view, saying AI may be used to improve review language so long as the reviewer remains accountable for accuracy and integrity. Academic Medicine has likewise argued that any AI use in scholarly publishing needs transparency, editorial oversight and a firm commitment to confidentiality.

Even so, the practical problem of enforcement remains unresolved. A study in Research Evaluation found that some publisher policies allowing limited AI-assisted polishing of referee reports are difficult to police, because current detectors can misclassify mixed human-AI text as wholly machine-generated. A separate arXiv preprint reached a similar conclusion, warning that existing detection tools are not reliable enough to identify AI use with confidence and that public estimates of AI-written peer review should therefore be treated cautiously. For now, the simplest rule may be the most defensible one: if you agree to referee a paper, you should do the work yourself.

Source Reference Map

Inspired by headline at: ^[1]

Sources by paragraph:

Source: Noah Wire Services

Noah Fact Check Pro

The draft above was created using the information available at the time the story first
emerged. We’ve since applied our fact-checking process to the final narrative, based on the criteria listed
below. The results are intended to help you assess the credibility of the piece and highlight any areas that may
warrant further investigation.

Freshness check

Score:
10

Notes:
The article was published today, April 29, 2026, and presents a recent case of AI-generated referee reports in philosophy journals, indicating high freshness.

Quotes check

Score:
8

Notes:
The article includes direct quotes from a philosophy PhD student and references to AI detection tools. However, the specific AI detection tools used are not named, and the student’s identity is not disclosed, making independent verification challenging.

Source reliability

Score:
7

Notes:
The article is published on Daily Nous, a reputable platform within the philosophy community. However, it is a niche publication, and the content is authored by Justin Weinberg, whose individual credibility is not independently verified.

Plausibility check

Score:
9

Notes:
The scenario described aligns with known concerns about AI’s role in academic peer review. Similar issues have been reported in other fields, such as computer science, where AI-generated content in reviews has been documented. However, the specific case in philosophy lacks independent verification.

Overall assessment

Verdict (FAIL, OPEN, PASS): OPEN

Confidence (LOW, MEDIUM, HIGH): MEDIUM

Summary:
The article presents a recent case of alleged AI-generated referee reports in philosophy journals, citing policies from Elsevier and Oxford Academic on AI use in peer review. However, the primary source is an unverified account from a philosophy PhD student, and the specific AI detection tools used are not named, making independent verification challenging. Given these factors, the overall assessment is OPEN with medium confidence.