ArXiv, the well-known preprint research platform, has announced a policy shift to curb the submission of papers filled with AI-generated errors, commonly referred to as 'slop.' The new policy, as communicated by Thomas Dietterich, ArXiv’s computer science section chair, involves a one-year ban for authors who submit papers containing undeniable evidence of unchecked AI-generated content.
New Policy Details
According to Dietterich, if a paper includes elements like hallucinated references or comments left by a large language model (LLM), the authors will face a year-long suspension from ArXiv. Furthermore, any future submissions to ArXiv must first be accepted by a reputable peer-reviewed venue. The policy aims to uphold the integrity of scientific research and ensure accountability among authors.
Statement from Thomas Dietterich
In a statement on social media platform X, Dietterich emphasized the responsibility of authors to verify the content of their papers. He stated, "Our Code of Conduct requires each author to take full responsibility for all contents of a paper, regardless of how it was generated." He added that the inclusion of inappropriate language, plagiarism, or erroneous content due to AI tools reflects poorly on authors and the research community.
"If a submission contains incontrovertible evidence that authors did not check the results of LLM generation, we cannot trust the paper," Dietterich explained. "The penalty is a 1-year ban from ArXiv, with subsequent submissions requiring prior acceptance at a peer-reviewed venue."
Appeal Process and Policy Implementation
Dietterich noted that authors have the right to appeal ban decisions. The policy applies exclusively to cases with irrefutable evidence, and involves a thorough internal process where a moderator documents issues, followed by confirmation from the Section Chair before any penalty is imposed.
In line with previous efforts, ArXiv updated its guidelines last year, limiting computer science review articles and position papers to those that have undergone peer review and been accepted at conferences or journals. This measure was introduced to manage the surge of AI-generated content, which often lacked substantial academic discourse.
Industry Impact
The decision underscores the growing challenges posed by AI in academic publishing, where the ease of generating content can lead to diluted research quality. ArXiv's measures reflect a broader industry need to adapt to technological advancements while preserving scholarly standards.
Source: https://www.theverge.com/science/931766/arxiv-ai-slop-ban-researchers
