Identifying chemistry students’ baseline systems thinking skills when constructing systems for a topic on climate change
Bibliographic record
Abstract
Recently, increased attention towards systems thinking (ST) in chemistry education has aimed to bridge disciplines and equip citizens and scientists with skills needed to address global challenges such as sustainability and climate change. As a result, new resources have emerged for educators to implement systems thinking in chemistry education (STICE), including a proposed set of ST skills. While these efforts aim to make ST implementation easier, little is known about how to assess these skills in a chemistry context. Additionally, there are no studies that have investigated how chemistry students naturally engage with ST learning activities; such information would guide educators about where to place emphasis when teaching ST skills. In this study, we investigated ST skills employed by students who constructed visual representations (systems) of a topic related to climate change. Eighteen undergraduate chemistry students from first- to third-year participated in this study. We designed and implemented a ST intervention to capture how students engaged with three ST tasks, performed individually and collaboratively. In our analysis, we assessed eleven ST skills that aligned with the five characteristics of STICE proposed by York and Orgill. We found that most participants demonstrated these ST skills when assessing ST skills exactly as articulated in the literature. When further investigating the extent that participants demonstrated these skills, we identified aspects of these skills that participants did and did not demonstrate. We found that (1) participants’ systems lacked concepts and connections at the submicroscopic level, (2) participants’ systems included multiple types of connections in their systems but few circular loops and causal connections, (3) participants predicted how their systems changed over time but lacked multicomponent causal reasoning, and (4) participants’ systems demonstrated the breadth of connections but did not consider human connections to the underlying chemistry of climate change topics. These findings identify aspects of ST where chemistry educators need to place emphasis when teaching ST skills to chemistry students and when guiding learning activities and other assessments. Using our findings, we created a ST rubric for the chemistry community as a tool for assessing ST skills.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.000 |
| Bibliometrics | 0.000 | 0.000 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.001 | 0.002 |
| Research integrity | 0.000 | 0.001 |
| Insufficient payload (model declined to judge) | 0.001 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one teacher head, not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".