MétaCan
Menu
Back to cohort
Record W4285059196 · doi:10.17705/1jais.00750

How Do Individuals Understand Multiple Conceptual Modeling Scripts?

2022· article· en· W4285059196 on OpenAlexaff
Mohammad Jabbari, Jan Recker, Peter Green, Karl Werder

Bibliographic record

VenueJournal of the Association for Information Systems · 2022
Typearticle
Languageen
FieldComputer Science
TopicSemantic Web and Ontologies
Canadian institutionsUniversité Laval
Fundersnot available
KeywordsScripting languageComputer scienceFocus (optics)Domain (mathematical analysis)Completeness (order theory)Human–computer interactionCognitionData sciencePsychologyProgramming language

Abstract

fetched live from OpenAlex

Because most real-world domains intended to be supported by an information system are complex, practitioners often use multiple different types of conceptual modeling scripts to understand them. We performed two experiments to examine how two theoretical factors of multiple scripts— combined ontological completeness and ontological overlap—influence how users develop an understanding of a real-world domain from multiple scripts. Results of the first experiment show that to some degree, ontological overlap improves participants’ understanding of a domain, more so than combined ontological completeness. In the second experiment, we tracked the eye movement data of participants to understand how ontological overlap between scripts impacts users’ information search and cognitive integration processes. We found that some occurrence of semantically similar constructs between scripts helps individuals to identify and relate constructs presented in different scripts. Users, therefore, can identify and focus on script areas that are relevant to their problem tasks. However, a high level of ontological overlap decreases the attention paid by participants to relevant task-specific areas because they spend more time searching for relevant information. Together, our findings both refine and extend existing conceptual modeling theory. We clarify the dialectics between the full and parsimonious real-world representations offered through multiple scripts and the individual’s understanding of the domain that is represented by those scripts.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.002
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: Simulation or modeling
GenreCandidate signal: Empirical · Consensus signal: none
Teacher disagreement score0.947
Threshold uncertainty score0.732

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0020.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0010.002
Open science0.0010.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.042
GPT teacher head0.232
Teacher spread0.190 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designSimulation or modeling
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations9
Published2022
Admission routes1
Has abstractyes

Explore more

Same venueJournal of the Association for Information SystemsSame topicSemantic Web and OntologiesFrench-language works237,207