MétaCan
Menu
Back to cohort
Record W4389210999 · doi:10.7557/5.7275

Primed and ready?

2023· article· en· W4389210999 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

aboutThe title or abstract carries a Canadian signal from the geographic lexicon.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueSeptentrio Conference Series · 2023
Typearticle
Languageen
FieldMedicine
TopicArtificial Intelligence in Healthcare and Education
Canadian institutionsnot available
Fundersnot available
KeywordsEngineering ethicsAccountabilityRealmResearch ethicsProtocol (science)Political sciencePublic relationsSociologyEngineeringMedicineLaw

Abstract

fetched live from OpenAlex

The emergence and proliferation of artificial intelligence (AI) tools has left the realm of science fiction and the province of computer science research and has reached the everyday activities of academics and various support staff. AI promises to automate and facilitate a range of research tasks and increase scientific productivity, and can thus be expected to raise new questions and dilemmas that might challenge the systems of accountability currently in place to safeguard academic integrity.
 This poster presents preliminary results of an analysis of seven prominent ethical guidelines (international and Norwegian): the Vancouver protocol, ALLEA guidelines, NENT and NESH guidelines, professional codes of ethics from IFLA, ALA, and the Norwegian Union of Librarians. EBLIDA and LIBER were consulted, but do not offer their own ethical guidelines. The main research question is: to what extent do current ethical guidelines support researchers and librarians in dealing with ethical questions brought about by the proliferation of new AI tools?
 The concern that emergent technologies tend to challenge values, norms, and practices in academia is not new. For example, ALLEA (2017) acknowledges that the values and principles they lay out are “affected by social, political or technological developments and by changes in the research environment” (p.3). Nonetheless, only the Vancouver protocol (updated in May 2023) provides explicit recommendations on AI; it essentially prescribes that authors/reviewers disclose if and how they used AI tools. The other documents, ranging from 2008 to 2022, mention neither AI nor the possibility of automation technologies in academic/library work.
 Despite the absence of advice on AI, the analysis revealed interesting issues on ethical guidelines and emergent technologies. ALA (2017) makes extensive recommendations about social media, both as a tool for libraries’ own work and as a demand from patrons who require their expertise. Similar needs for new competencies and responsibilities can be expected from AI. Also, the Norwegian Union of Librarians (2008) encourages the adoption of free software, open standards, and open source codes; this can gain new momentum with the emergence of proprietary tools and algorithms, particularly if they are trained on public data curated by i.a. libraries.
 Ethical guidelines are general; they state a commitment to certain values and how they should guide certain tasks and practices. They do not prescribe how concrete tools should be employed. In this regard, the current ethical guidelines do offer a sound basis upon which new ethical questions can be assessed. Yet, unlike other types of tools employed in research and library work, AI poses challenges to things that are taken for granted by ethical guidelines, such as what constitutes information, or whether non-human entities can be considered authors, sources, or neither.
 In conclusion, it might be beneficial to revise ethical guidelines, less so because AI requires concrete recommendations, and more because they challenge substantive assumptions upon which guidelines rely. Also, new possibilities afforded by AI might put pressure on certain values, such as reproducibility and academic craftsmanship. Assuming that academia/library communities consider these important to preserve, it might be beneficial to reaffirm these values in light of the changing landscape.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Other design · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.763
Threshold uncertainty score0.676

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.226
GPT teacher head0.416
Teacher spread0.191 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it