Open Access Works are as Reliable as Other Publishing Models at Retracting Flawed Articles from the Biomedical Literature
Bibliographic record
Abstract
A Review of: Peterson, G.M. (2013). Characteristics of retracted open access biomedical literature: a bibliographic analysis. Journal of the American Society for Information Science and Technology. 64(12), 2428-2436. doi: 10.1002/asi.22944 Abstract Objective – To investigate whether the rate of retracted articles and citation rates post-retraction in the biomedical literature are comparable across open access, free-to-access, or pay-to-access journals. Design – Citation analysis. Setting – Biomedical literature. Subjects – 160 retracted papers published between 1st January 2001 and 31st December 2010. Methods – For the retracted papers, 100 records were retrieved from the PubMed database and 100 records from the PubMed Central (PMC) open access subset. Records were selected at random, based on the PubMed identifier. Each article was assigned a number based on its accessibility using the specific criteria. Articles published in the PMC open access subset were assigned a 2; articles retrieved from PubMed that were freely accessible, but did not meet the criteria for open access were assigned a 1; and articles retrieved through PubMed which were pay-to-access were assigned a 0. This allowed articles to be grouped and compared by accessibility. Citation information was collected primarily from the Science Citation Index. Articles for which no citation information was available, and those with a lifetime citation of 0 (or 1 where the citation came from the retraction statement) were excluded, leaving 160 articles for analysis. Information on the impact factor of the journals was retrieved and the analysis was performed twice; first with the entire set, and second after excluding articles published in journals with an impact factor of 10 or above (14% of the total). The average number of citations per month was used to compare citation rates, and the percentage change in citation rate pre- and post-retraction was calculated. Information was also collected on the time between the date the original article was published and the date of retraction, and the availability of information on the reason for the retraction. Main results – The overall rate of retracted articles in the PMC open access subset compared with the wider PubMed dataset was similar (0.049% and 0.028% respectively). In the group with an accessibility rating of 0, the change in citation rate pre- and post-retraction was -41%. For the group with an accessibility rating of 1, the change was -47% and in those with a rating of 2, the change in citation rate was -59%. Removing articles published in high impact factor journals did not change the results significantly. Retractions were issued more slowly for free access papers compared with open or fee-based articles. The bibliographic records for open access articles disclosed details of the reason for the retraction more frequently than free, non-open papers (91% compared to 53%). Conclusion – Open access literature is similar in its rate of retraction and the reduction in post-retraction citations to the rest of the biomedical literature, and is actually more reliable at reporting the reason for the retraction.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.330 | 0.759 |
| Meta-epidemiology (narrow) | 0.002 | 0.003 |
| Meta-epidemiology (broad) | 0.005 | 0.005 |
| Bibliometrics | 0.068 | 0.066 |
| Science and technology studies | 0.005 | 0.010 |
| Scholarly communication | 0.044 | 0.049 |
| Open science | 0.006 | 0.016 |
| Research integrity | 0.009 | 0.008 |
| Insufficient payload (model declined to judge) | 0.050 | 0.033 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".