MétaCan
Menu
Retour à la cohorte
Enregistrement W4416390215 · doi:10.3389/frai.2025.1699373

Correction: AI for scientific integrity: detecting ethical breaches, errors, and misconduct in manuscripts

2025· article· en· W4416390215 sur OpenAlexaff
Diogo Pellegrina, Mohamed Helmy

Notice bibliographique

RevueFrontiers in Artificial Intelligence · 2025
Typearticle
Langueen
DomaineMedicine
ThématiqueArtificial Intelligence in Healthcare and Education
Établissements canadiensUniversity of Saskatchewan
Organismes subventionnairesnon disponible
Mots-clésMisconductScientific misconductInterrogationConfidentiality

Résumé

récupéré en direct d'OpenAlex

Frontiers' correction template for authors A correction refers to a change to their article that the author wishes to publish after publication. The publication of this article is subject to Frontiers' editorial approval. Instructions: ● Please read through all the templates before choosing ● Pick the most relevant text template(s) from the following page and delete all others. ● Edit the text as necessary, ensuring that the original incorrect text is included for the record, please see the below. ● Please do not use any extra formatting when editing the templates, and only modify the red text unless absolutely necessary ● Submit to Frontiers following the instructions on this page. When the original text contained incorrect information, to preserve the scientific record, please include that text when editing the below templates. For example: There was a mistake in the Funding statement, an incorrect number was used. The correct number is "2015C03Bd051.". The publisher apologizes for this mistake. The original version of this article has been updated. In the published article, there was a mistake in the Funding statement. The funding statement for the Key Development Project of the Department of Science and Technology was displayed as "2015CBd051". The correct statement is "Key Development Project of Department of Science and Technology (2015C03Bd051).'' Missing citation Wrong In the abstract, [we mention "industry initiatives to AI-driven papermills"]. This has been corrected to read: ["industry initiatives to [combat] AI-driven papermills"] The original version of this article has been updated. [The text contained a partial sentence that should have been removed from the final draft, the phrase "' looks better, but then again it might be due to my foreigner non-standard syntax" placed immediately before the reference for (Jiang et al., 2024). The correct text shouldn't have it removed]. A correction has been made to the section [the Introduction, GenAI detection tools, 5th Paragraph]: "This result, however, is counterintuitive. Non-native speakers are expected to use more loan words, construct sentences with non-standard syntax, and make more grammatical errors, traits that would typically increase perplexity, not decrease it. These features make their writing appear less natural and less similar to the LLMs' training corpus, and therefore harder to predict. A more recent and rigorous study used a larger dataset and perplexity estimations using unpublished detectors based on GPT-2 to revisit this issue (Jiang et al., 2024). It analyzed a mixed dataset of native and non-native English GRE writing assessments containing both HWT and MGT. Contrary to the earlier claims, this analysis showed that non-native texts had the highest perplexity, while MGTs consistently had much lower perplexity. Using this feature alone, the authors reported 99.9% accuracy in detecting MGTs. These conflicting findings may be explained by differences in dataset composition, detector models, or evaluation design. The earlier study might have used small or biased datasets, or misinterpreted correlations between writing style and perplexity. The later study's use of real educational writing and unpublished detectors with stricter evaluation may offer a more accurate reflection of cross-linguistic variation. This contrast highlights the need for careful consideration of language background in AI detector evaluation, and it raises important concerns about cross-linguistic generalizability and fairness in MGT detection." [The text mentions "BenchGPT" when it should be "MGTBench"]. A correction has been made to the section [the Introduction, GenAI detection tools, 3rd Paragraph]: "In order to compare how different detectors were able to differentiate HWT and MGT from different LLMs (ChatGLM, Dolly, ChatGPTturbo, GPT4All, StableLM, and Claude) and across different types of corpora (academic essays, short stories, and news articles), MGTBench (He et al., 2024) created datasets of each genus containing 1,000 HWT and 1,000 MGT (from those LLMs). The study showed that all detectors are sensitive to changes in the selection of their training dataset. There is a trade-off where detectors that are robust against genre changes like ConDA (Bhattacharjee et al., 2023) (F1-score when trained with news dropped from 0.99 to 0.67 when testing essays) are poor at detecting MGT created with a model different than the one it was trained on, when trained with StableLM (Hugging Face, n.d.) the F1-score testing Claude drops to 0.00. On the other hand, detectors like DEMASQ (Kumari et al., 2023) that are robust against changes in LLM (F0-score drop from 0.92 to 0.71 when trained in ChatGPT-Turbo testing MGT from StableLM) fail when there is a change in genre (F0-score of 0.23 when trained on news and testing essays)." Adding/removing text [The text mentions "BenchGPT" when it should be "MGTBench". On the same paragraph the text mentions F0-scores, when they should be F1-score]. A correction has been made to the section [the Introduction, GenAI detection tools, 3rd Paragraph]: "In order to compare how different detectors were able to differentiate HWT and MGT from different LLMs (ChatGLM, Dolly, ChatGPT-turbo, GPT4All, StableLM, and Claude) and across different types of corpora (academic essays, short stories, and news articles), MGTBench (He et al., 2024) created datasets of each genus containing 1,000 HWT and 1,000 MGT (from those LLMs). The study showed that all detectors are sensitive to changes in the selection of their training dataset. There is a trade-off where detectors that are robust against genre changes like ConDA (Bhattacharjee et al., 2023) (F1-score when trained with news dropped from 0.99 to 0.67 when testing essays) are poor at detecting MGT created with a model different than the one it was trained on, when trained with StableLM (Hugging Face, n.d.) the F1-score testing Claude drops to 0.00. On the other hand, detectors like DEMASQ (Kumari et al., 2023) that are robust against changes in LLM (F1-score drop from 0.92 to 0.71 when trained in ChatGPT-Turbo testing MGT from StableLM) fail when there is a change in genre (F1-score of 0.23 when trained on news and testing essays)."

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Comment cette classification a été obtenuedéplier

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,002
score de la tête « metaresearch » (Gemma)0,003
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesaucune
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Autre devis · Signal consensuel: aucune
GenreSignal candidat: Empirique · Signal consensuel: Empirique
Score de désaccord entre enseignants0,910
Score d'incertitude au seuil0,958

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0020,003
Méta-épidémiologie (sens strict)0,0000,000
Méta-épidémiologie (sens large)0,0000,000
Bibliométrie0,0010,001
Études des sciences et des technologies0,0000,001
Communication savante0,0000,000
Science ouverte0,0000,000
Intégrité de la recherche0,0010,002
Charge utile insuffisante (le modèle a refusé de juger)0,0000,000

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,193
Tête enseignante GPT0,432
Écart entre enseignants0,238 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle

Classification

machine, non validée

Prédiction automatique; un appel candidat d’une seule tête enseignante, pas un consensus.

Les modèles n’ont appliqué aucune catégorie : rien dans la taxonomie ne correspondait à ce travail.
Devis d'étudeAutre devis
Domainenon disponible
GenreEmpirique

Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».

En bref

Citations0
Publié2025
Routes d'admission1
Résumé présentoui

Explorer davantage

Même revueFrontiers in Artificial IntelligenceMême sujetArtificial Intelligence in Healthcare and EducationTravaux en français237 207