MétaCan
Menu
Back to cohort
Record W2097258116 · doi:10.1177/0092055x0803600306

The Evidence Matrix

2008· article· en· W2097258116 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

affAt least one author lists a Canadian institution in the pinned OpenAlex snapshot.

Bibliographic record

VenueTeaching Sociology · 2008
Typearticle
Languageen
FieldSocial Sciences
TopicLibrary Science and Information Literacy
Canadian institutionsCollege of Family Physicians of Canada
Fundersnot available
KeywordsEpistemologyDisciplineArgument (complex analysis)AbstractionCritical thinkingFocus (optics)WrightMatrix (chemical analysis)PsychologySimple (philosophy)CurriculumHeuristicSociologyComputer scienceMathematics educationPedagogyPhilosophySocial science

Abstract

fetched live from OpenAlex

THE DEBATE DEFINING THINKING, critical thinking, and higher-level thinking is expan sive. Geersteen (2003) provides an excellent review of this literature and suggests that one way to distinguish between lowerand higher-level thinking is based on the level of abstraction. In this article, we focus on analysis and synthesis or integration-that is, identifying parts and putting these parts together to form a coherent whole. We offer a simple heuristic device, the evidence ma trix, that helps students recognize the rela tionship between sources of evidence. Although analysis and synthesis are broad intellectual skills that transcend disciplinary boundaries, Grauerholz and Bouma-Holtrop (2003) and Geersteen (2003) argue that dif ferent types of higher-level thinking are more likely to be emphasized by some disci plines than others. Grauerholz and Bouma Holtrop (2003) conclude that there are two general types of higher-level thinking re quired by sociologists, conceptualizing and contextualizing. Contextualizing is most similar to C. Wright Mills's sociological imagination and emphasizes placing specific examples within larger contexts. Conceptu alizing involves the process of breaking concepts into their constituent parts, recog nizing commonalities and differences, and the ability to compare and contrast the com ponents of an argument. The evidence ma trix is a tool that is most helpful in develop ing conceptualizing skills. While the heuris tic device we suggest does tap broad cogni tive skills, these are a subset of skills that are especially relevant for sociologists. Analyzing evidence and recognizing the similarities and dissimilarities between sources is an example of a skill Geertsen (2003) calls referential thinking and Grauer holz and Bouma-Holtrop (2003) include as a part of sociological critical thinking. The evidence matrix is designed to foster critical sociological thinking by helping students integrate data and research findings from different modes of research and synthesize findings across multiple contexts. Using the evidence matrix helps students see the rela tionship among different sources of data and how to organize a more general argument around specific instances of evidence. Finding, reading, and evaluating the va lidity of research studies and synthesizing information from a variety of sources is sometimes referred to as information liter acy (Association of College and Research Libraries 2006; Grafstein 2002). Grafstein (2002:) explains, however, that instructors teach IL [information literacy] skills that are embedded within the research para digms and procedures of their disciplines (p. 202). Therefore, in this paper we con ceptualize certain information literacy skills, particularly synthesizing research evidence from multiple sources, as a component of sociological critical thinking more gener ally. *Please direct all correspondence to Maxine Atkinson, Department of Sociology and Anthro pology, North Carolina State University, Box 8107, Raleigh, NC 27695-8107; e-mail: Maxine_Atkinson@ncsu. edu. Editor's note: The reviewers were, in alpha betical order, Jill Bouma, Theodore D. Fuller, Kathy Rowell, and Stephen Sweet.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.002
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesScience and technology studies
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.942
Threshold uncertainty score0.997

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0020.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0040.001
Scholarly communication0.0000.003
Open science0.0000.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.064
GPT teacher head0.387
Teacher spread0.323 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it