De-duplication of database search results for systematic reviews in EndNote
Why is this work in the frame?
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Machine scores (provisional)
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
- Teacher spread
- 0.268 · how far apart the two teachers sit on this one work
- Validation status
score_only:v0-immature-baseline· verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it
Abstract
When conducting exhaustive searches for systematic reviews, information professionals search multiple databases with overlapping content [1][2][3][4].They typically remove duplicate records to reduce the reviewers' workload associated with screening titles and abstracts; sometimes the reviewers remove the duplicates.Several articles have been published recently on de-duplication methods.In the authors' opinion, these methods are either very time consuming [5] or impractical, as they require uploading large files to an online platform [6,7].A recent overview article compared existing software programs but found that none was truly satisfactory [8].Unique identifiers for journal articles are digital object identifiers (DOIs) and PubMed IDs (PMIDs).However, these identifiers are not present in every database.When they are present, they often cannot be exported easily.Thus, they cannot be relied upon to identify duplicates.An alternative involves using pagination, because the often large page numbers in scientific journals, in combination with other fields, can serve as a type of unique identifier.However, this is complicated by variations in the way page numbers are stored.Most biomedical databases use a long format (e.g.,
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
The record
- Venue
- Journal of the Medical Library Association JMLA
- Topic
- Data Quality and Management
- Field
- Decision Sciences
- Canadian institutions
- University of British Columbia Hospital
- Funders
- —
- Keywords
- Computer scienceWorld Wide WebInformation retrievalData scienceLibrary scienceDatabase
- Has abstract in OpenAlex
- yes