MétaCan
Menu
Back to cohort
Record W2020412748 · doi:10.1186/1472-6920-7-16

Problem formulation by medical students: an observation study

2007· article· en· W2020412748 on OpenAlexafffund
François Auclair

Bibliographic record

VenueBMC Medical Education · 2007
Typearticle
Languageen
FieldMedicine
TopicClinical Reasoning and Diagnostic Skills
Canadian institutionsUniversity of Ottawa
FundersUniversity of Ottawa
KeywordsSchema (genetic algorithms)Medical diagnosisComputer scienceMathematics educationManagement scienceMedicinePsychologyInformation retrievalPathology

Abstract

fetched live from OpenAlex

BACKGROUND: Medical problems are often complex and ill-structured. In formulating the problem, one has to discriminate pertinent elements from irrelevant information in order to effectively find a solution. In this observation study, we describe how medical students formulate the problem of a complex case. METHODS: 32 third year medical students were presented with a complex case of endocarditis. They were asked to synthesize the case and give the best formulation of the problem. They were then asked to provide a diagnosis. A subsequent group of 25 students were presented with the problem already formulated and were also asked for the diagnosis. We analyzed the student's problem formulations using the presence or absence of essential elements of the case, the use of higher-order concepts and the use of relations between concepts. RESULTS: 12/32 students presented with the case made the correct diagnosis. Diagnostic accuracy was significantly associated with the use of higher-order concepts and relations between concepts. Establishing explicit relations was particularly important. Almost all students who missed the diagnosis could not elicit any relations between concepts but only reported factual observations. When presented with an already formulated problem, 19/25 students made the correct diagnosis. (p < 0.05) CONCLUSION: When faced with a complex new case, students may not have the structured knowledge to recognize the nature of the problem. They have to build new schema or problem representation. Our observations suggest that this process involves using higher-order concepts and establishing new relations between concepts. The fact that students could recognize the disease when presented with a formulated problem but had more difficulty when presented with the original complex case indicates that knowledge of the clinical features may be necessary but not sufficient for problem formulation. Our hypothesis is that problem formulation represents a distinct ability.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.005
metaresearch head score (Gemma)0.100
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Insufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.152
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0050.100
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.042
GPT teacher head0.447
Teacher spread0.406 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations28
Published2007
Admission routes2
Has abstractyes

Explore more

Same venueBMC Medical EducationSame topicClinical Reasoning and Diagnostic SkillsFrench-language works237,207