From the Evaluator’s Perspective: A Functional Approach to Social Judgments
Why this work is in the frame
A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.
Bibliographic record
Abstract
To deepen understanding of social judgments of organizations, we build on work that has adopted the evaluator’s perspective to develop a comprehensive functional approach to social judgments. We identify a set of adaptive challenges faced by evaluators in their relationship with organizations and theorize how the judgments they make can help resolve those challenges. In doing so, we clarify how social judgments are rooted in comparisons between the organization’s properties and some social referent, and extend understanding of the interrelated nature and complementary role of diverse social judgments. We explain how social judgments—such as legitimacy, trustworthiness, reputation, status, and authenticity—form a robust system of interrelated judgments that allows evaluators to collect and triangulate multiple judgments of different types, using judgment inputs from three different sources: (1) first-hand inputs, based on the evaluator’s own observations and information about the organization; (2) borrowed inputs, based on judgments made by others; and (3) taken-for-granted judgment inputs acquired through the evaluator’s socialization and education. We conclude by suggesting ways to reorient research toward unduly neglected elements of social judgment theory through systematic examination of the functional utility that social judgments provide for evaluators.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
Full frame distilled prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.
Codex and Gemma teacher scores by category
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.001 | 0.000 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.000 | 0.001 |
| Science and technology studies | 0.000 | 0.000 |
| Scholarly communication | 0.000 | 0.000 |
| Open science | 0.000 | 0.000 |
| Research integrity | 0.000 | 0.000 |
| Insufficient payload (model declined to judge) | 0.000 | 0.000 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it