MétaCan
Menu
Back to cohort
Record W1556910453 · doi:10.1111/jep.12094

Testing search strategies for systematic reviews in the <scp>M</scp>edline literature database through <scp>P</scp>ub<scp>M</scp>ed

2013· article· en· W1556910453 on OpenAlexaff
Enilze de Souza Nogueira Volpato, Marluci Betini, Regina El Dib

Bibliographic record

VenueJournal of Evaluation in Clinical Practice · 2013
Typearticle
Languageen
FieldDecision Sciences
TopicMeta-analysis and systematic reviews
Canadian institutionsMcMaster University
FundersFundação de Amparo à Pesquisa do Estado de São Paulo
KeywordsDatabaseWorld Wide WebComputer science

Abstract

fetched live from OpenAlex

BACKGROUND: A high-quality electronic search is essential in ensuring accuracy and completeness in retrieved records for the conducting of a systematic review. OBJECTIVE: We analysed the available sample of search strategies to identify the best method for searching in Medline through PubMed, considering the use or not of parenthesis, double quotation marks, truncation and use of a simple search or search history. METHODS: In our cross-sectional study of search strategies, we selected and analysed the available searches performed during evidence-based medicine classes and in systematic reviews conducted in the Botucatu Medical School, UNESP, Brazil. RESULTS: We analysed 120 search strategies. With regard to the use of phrase searches with parenthesis, there was no difference between the results with and without parenthesis and simple searches or search history tools in 100% of the sample analysed (P = 1.0). The number of results retrieved by the searches analysed was smaller using double quotations marks and using truncation compared with the standard strategy (P = 0.04 and P = 0.08, respectively). CONCLUSIONS: There is no need to use phrase-searching parenthesis to retrieve studies; however, we recommend the use of double quotation marks when an investigator attempts to retrieve articles in which a term appears to be exactly the same as what was proposed in the search form. Furthermore, we do not recommend the use of truncation in search strategies in the Medline via PubMed. Although the results of simple searches or search history tools were the same, we recommend using the latter.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.271
metaresearch head score (Gemma)0.630
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesMetaresearch
DomainCandidate signal: Methods · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.729
Threshold uncertainty score0.899

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.2710.630
Meta-epidemiology (narrow)0.0040.004
Meta-epidemiology (broad)0.0150.020
Bibliometrics0.0520.063
Science and technology studies0.0020.003
Scholarly communication0.0080.012
Open science0.0070.009
Research integrity0.0050.004
Insufficient payload (model declined to judge)0.0770.010

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.808
GPT teacher head0.637
Teacher spread0.171 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; the direct Gemma label and the distilled Codex classifier agree on what is shown here.

Study designObservational
DomainMethods
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations12
Published2013
Admission routes1
Has abstractyes

Explore more

Same venueJournal of Evaluation in Clinical PracticeSame topicMeta-analysis and systematic reviewsFrench-language works237,207