The ITEM Ontology: A Tool to Elucidate the Anatomy of Psychometric Indicators
Notice bibliographique
Résumé
Article Title: “The ITEM Ontology: A Tool to Elucidate the Anatomy of Psychometric Indicators” Authors: Kai R. Larsen, University of Colorado Boulder Roland M. Mueller, Berlin School of Economics and Law Dario Bonaretti, NEOMA Business School Diana Fischer-Preßler, University of Applied Sciences Frankfurt James (Jim) Burleson, California Polytechnic State University Nimisha Singh, Bennett University, India Jeffrey Parsons, Memorial University of Newfoundland Jean-Charles Pillet, Toulouse Business School Lan Sang, University of Colorado Boulder Zhu (Drew) Zhang, University of Rhode Island Problem definition: For decades, scientists have treated the survey item as the atomic unit of psychological measurement, an indivisible entity to be validated primarily through statistics. But what if we have been looking at the wrong level of analysis? Despite sophisticated modeling techniques, even well-validated instruments often contain items that are vague, double-barreled, or semantically misaligned with their intended constructs. These flaws remain undetected because current methods ignore the semantic anatomy of items. There is no shared language for decomposing indicators into the elements that carry meaning. Relevance: We show that psychometric measurement cannot be understood at the item or construct level and, for the first time, demonstrate that problems such as double-barreled items, restriction of range, and double negation can now be operationally defined and automatically detected. We argue that without tools like the ITEM Ontology, psychological measurement will never be precise enough to match the precision required for tasks such as medication optimization, leadership evaluation, technology impact assessment, and political polling. Theoretical foundations: This paper advances a new theory of survey indicator design by proposing that indicators can—and should—be deconstructed into meaningful components such as objects, actions, attributes, qualifiers, and response formats. This component-level analysis reveals structural and semantic flaws that traditional psychometric techniques often miss. Although grounded in linguistic and cognitive theory, our framework also draws on principles from established ontologies, particularly DOLCE, to ensure conceptual rigor and consistency. By making the internal anatomy of indicators explicit, the approach offers a foundational shift in how we understand, evaluate, and improve survey-based measurement. Methodology: We used design science methodologies to develop, refine, and test the ontology. Results: In addition to the ITEM ontology, we also provide a website ( http://www.itemontology.org/ ) that enables researchers to code indicators within the ontology, along with the ITEMIZER tool, which highlights potential wording issues and construct validity concerns associated with coded indicators. Contributions: This paper enables researchers and survey writers to understand the underlying components and their relationships within and across survey indicators. With the ITEM ontology, not only can we enhance the quality of future surveys, but we also provide a language to discuss how indicators are written and how they can be improved. We demonstrate the value of the ITEM Ontology by presenting two use cases for evaluating item quality and validating content. Keywords: ontology, psychometrics, indicator evaluation, validity, scale development Problem definition: What is your research problem/question in simple terms? Relevance: Why is this problem relevant for research and/or practice? Theoretical foundations: What theory (theories) underlie this work (if applicable)? Methodology: What is the research approach used (if applicable)? Anything innovative? Results: What are the key findings that readers may find interesting or revelatory? Contributions: What is novel/impactful about the knowledge offered by this paper for scholars, practitioners, and policymakers? Short quote, video, or interview (optional): Send us anything additional that you would like to include in the social media post.
Récupéré en direct depuis OpenAlex et désinversé. Les résumés ne sont pas conservés dans cette base de données : les index inversés représentent 8,6 Go des 9,3 Go de texte de la base, et le serveur dispose de 13 Go libres.
Comment cette classification a été obtenuedéplier
Prédiction machine sur la base complète
Imitation des enseignantsNi prévalence calibrée, ni vérité terrain. Validation humaine à venir. Le volet Gemma est une étiquette directe du modèle pour chaque travail de la base, lue sur la notice réduite au titre. Le volet Codex est un classifieur appris des 10 348 étiquettes directes de Codex et calibré sur les taux pondérés de l'échantillon; les champs sans appui suffisant ne portent aucun appel Codex. Le mode candidate est l'union des deux volets; le consensus est leur intersection. Ces sorties portent le statut machine_predicted_unvalidated et ne sont pas des étiquettes humaines.
Scores du classifieur distillé par catégorie (deux têtes)
| Catégorie | Codex | Gemma |
|---|---|---|
| Métarecherche | 0,033 | 0,148 |
| Méta-épidémiologie (sens strict) | 0,002 | 0,002 |
| Méta-épidémiologie (sens large) | 0,002 | 0,004 |
| Bibliométrie | 0,014 | 0,011 |
| Études des sciences et des technologies | 0,003 | 0,007 |
| Communication savante | 0,010 | 0,026 |
| Science ouverte | 0,003 | 0,010 |
| Intégrité de la recherche | 0,004 | 0,007 |
| Charge utile insuffisante (le modèle a refusé de juger) | 0,023 | 0,008 |
Scores machine (provisoires)
Les deux têtes enseignantes du modèle étudiant, lues sur ce travail. Un score ordonne la base pour la relecture; il n'affirme jamais une catégorie, et le statut de validation accompagne chaque rangée tel quel.
Scores de référence d'un modèle non mature (critères de maturité non atteints, 7 itérations). Un score ordonne; il n'affirme jamais une catégorie.
score_only:v0-immature-baseline · tel quel depuis la passe de notation : score_only signifie que le nombre peut ordonner les travaux, et qu'aucune étiquette de catégorie n'en découleClassification
machine, non validéePrédiction automatique; un appel candidat d’une seule source (Gemma direct ou Codex distillé), pas un consensus.
Le détail, modèle par modèle et score par score, se trouve en fin de page sous « Comment cette classification a été obtenue ».