MétaCan
Menu
Back to cohort
Record W1579766672 · doi:10.1108/10650740910967348

The quantitative crunch

2009· article· en· W1579766672 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueCampus-Wide Information Systems · 2009
Typearticle
Languageen
FieldDecision Sciences
TopicEvaluation and Performance Assessment
Canadian institutionsUniversity of the Fraser Valley
Fundersnot available
KeywordsOriginalityPublishingDisciplineTransparency (behavior)Leverage (statistics)Public relationsCitationResearch Assessment ExercisePolitical scienceEngineering ethicsSociologyComputer scienceLibrary scienceQualitative researchHigher educationEngineeringSocial science

Abstract

fetched live from OpenAlex

Purpose Small and specialist inter‐disciplinary conferences, particularly those relating to technology enhanced learning such as International Conference on Information and Communications Technology in Education, provide valuable opportunities for academics and academic‐related/professional staff to report upon their research and development activities, including their insights into teaching practice. However, the existence of such conferences is now under threat due to a global shift towards quantitative research assessment exercises, which favour bibliometrics, such as citation counts and impact factors, over peer review. The purpose of this paper is to contextualise the discussion by describing the nascent qualitative research assessment in Australia and its implications for small conferences. It also aims to present heuristic strategies to ensure that publications are recognised by quantitative research assessment exercises. Design/methodology/approach The authors draw on a wide literature base as well as their experience as academics, conference organizers, professional developers, and researchers to describe the changes to the culture of research assessment and research management and their observed implications for small and specialist inter‐disciplinary conferences. Findings Conference organizers and scientific committees should consider several strategies to maximise bibliometric impact of conference papers. These strategies include: transparency in reviewing processes; building alliances with peer‐reviewed journals; considering boutique “by invitation” conference formats; and publishing papers which are indexed and standards based. The authors also point out that small and specialist conferences should leverage their communities of practice to facilitate publication and research opportunities and thereby increase the tangible benefits of participation. Originality/value This paper is valuable to conference organizers and participants who are adjusting to a culture of bibliometrics. This paper highlights key issues as well as suggests strategies to improve impact values.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.008
metaresearch head score (Gemma)0.003
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScholarly communication, Insufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.856
Threshold uncertainty score0.999

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0080.003
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.001
Science and technology studies0.0010.000
Scholarly communication0.0020.003
Open science0.0010.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.005

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.124
GPT teacher head0.455
Teacher spread0.331 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it