MétaCan
Menu
Retour à la cohorte
Enregistrement W4413163669 · doi:10.1287/isre.2023.0257

The ITEM Ontology: A Tool to Elucidate the Anatomy of Psychometric Indicators

2025· article· en· W4413163669 sur OpenAlex
Kai R. Larsen, Roland M. Mueller, Dario Bonaretti, Diana Fischer-Preßler, James Burleson, Nimisha Singh, Jeffrey Parsons, Jean‐Charles Pillet, Lan Sang, Zhu Zhang

Pourquoi ce travail est dans la base

Une base qui oublie comment elle a trouvé un travail ne peut pas être vérifiée. Voici les voies qui ont admis celui-ci.

affAu moins un auteur déclare une institution canadienne dans l'instantané OpenAlex épinglé.
aboutLe titre ou le résumé porte un signal canadien du lexique géographique.

Notice bibliographique

RevueInformation Systems Research · 2025
Typearticle
Langueen
DomaineComputer Science
ThématiqueCognitive Science and Mapping
Établissements canadiensMemorial University of Newfoundland
Organismes subventionnairesNational Institute on Aging
Mots-clésOntologyComputer scienceKnowledge managementData sciencePsychology

Résumé

récupéré en direct d'OpenAlex

Article Title: “The ITEM Ontology: A Tool to Elucidate the Anatomy of Psychometric Indicators” Authors: Kai R. Larsen, University of Colorado Boulder Roland M. Mueller, Berlin School of Economics and Law Dario Bonaretti, NEOMA Business School Diana Fischer-Preßler, University of Applied Sciences Frankfurt James (Jim) Burleson, California Polytechnic State University Nimisha Singh, Bennett University, India Jeffrey Parsons, Memorial University of Newfoundland Jean-Charles Pillet, Toulouse Business School Lan Sang, University of Colorado Boulder Zhu (Drew) Zhang, University of Rhode Island Problem definition: For decades, scientists have treated the survey item as the atomic unit of psychological measurement, an indivisible entity to be validated primarily through statistics. But what if we have been looking at the wrong level of analysis? Despite sophisticated modeling techniques, even well-validated instruments often contain items that are vague, double-barreled, or semantically misaligned with their intended constructs. These flaws remain undetected because current methods ignore the semantic anatomy of items. There is no shared language for decomposing indicators into the elements that carry meaning. Relevance: We show that psychometric measurement cannot be understood at the item or construct level and, for the first time, demonstrate that problems such as double-barreled items, restriction of range, and double negation can now be operationally defined and automatically detected. We argue that without tools like the ITEM Ontology, psychological measurement will never be precise enough to match the precision required for tasks such as medication optimization, leadership evaluation, technology impact assessment, and political polling. Theoretical foundations: This paper advances a new theory of survey indicator design by proposing that indicators can—and should—be deconstructed into meaningful components such as objects, actions, attributes, qualifiers, and response formats. This component-level analysis reveals structural and semantic flaws that traditional psychometric techniques often miss. Although grounded in linguistic and cognitive theory, our framework also draws on principles from established ontologies, particularly DOLCE, to ensure conceptual rigor and consistency. By making the internal anatomy of indicators explicit, the approach offers a foundational shift in how we understand, evaluate, and improve survey-based measurement. Methodology: We used design science methodologies to develop, refine, and test the ontology. Results: In addition to the ITEM ontology, we also provide a website ( http://www.itemontology.org/ ) that enables researchers to code indicators within the ontology, along with the ITEMIZER tool, which highlights potential wording issues and construct validity concerns associated with coded indicators. Contributions: This paper enables researchers and survey writers to understand the underlying components and their relationships within and across survey indicators. With the ITEM ontology, not only can we enhance the quality of future surveys, but we also provide a language to discuss how indicators are written and how they can be improved. We demonstrate the value of the ITEM Ontology by presenting two use cases for evaluating item quality and validating content. Keywords: ontology, psychometrics, indicator evaluation, validity, scale development Problem definition: What is your research problem/question in simple terms? Relevance: Why is this problem relevant for research and/or practice? Theoretical foundations: What theory (theories) underlie this work (if applicable)? Methodology: What is the research approach used (if applicable)? Anything innovative? Results: What are the key findings that readers may find interesting or revelatory? Contributions: What is novel/impactful about the knowledge offered by this paper for scholars, practitioners, and policymakers? Short quote, video, or interview (optional): Send us anything additional that you would like to include in the social media post.

Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.

Prédiction distillée sur la base complète

Imitation des enseignants

Ni prévalence calibrée, ni vérité terrain. Validation humaine à venir. Apprise à partir de 10 348 étiquettes directes de Codex et de 10 348 étiquettes directes de Gemma. Le mode candidate est l'union des têtes enseignantes seuillées; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont ni des étiquettes humaines ni des étiquettes directes de modèles de pointe.

score de la tête « metaresearch » (Codex)0,006
score de la tête « metaresearch » (Gemma)0,002
Version: codex-gemma-dda1882f352aStatut de validation: machine_predicted_unvalidated
Catégories candidatesaucune
Catégories consensuellesaucune
DomaineSignal candidat: aucune · Signal consensuel: aucune
Devis d'étudeSignal candidat: Sans objet · Signal consensuel: aucune
GenreSignal candidat: Empirique · Signal consensuel: aucune
Score de désaccord entre enseignants0,923
Score d'incertitude au seuil0,629

Scores Codex et Gemma par catégorie

CatégorieCodexGemma
Métarecherche0,0060,002
Méta-épidémiologie (sens strict)0,0000,000
Méta-épidémiologie (sens large)0,0000,000
Bibliométrie0,0020,010
Études des sciences et des technologies0,0010,000
Communication savante0,0010,001
Science ouverte0,0020,000
Intégrité de la recherche0,0000,000
Charge utile insuffisante (le modèle a refusé de juger)0,0000,000

Scores machine (provisoires)

Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.

Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.

Tête enseignante Opus0,045
Tête enseignante GPT0,402
Écart entre enseignants0,357 · la distance entre les deux têtes enseignantes sur ce seul travail
Statut de validationscore_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découle