Cohort builder

4,299,418 works, Canadian by any of four routes.

Every filter state is a URL; the URL is the query; the query is citable via /q/⟨hash⟩. The page, the API and the export parse the same parameters.

Export CSV Export JSONAPI query

The current cohort, streamed from the database: every work column, the machine labels, the provisional scores, and the per-row validation status. Exports are capped at 100,000 rows. Mints a permanent /q/ link for this exact query. The same filters always produce the same link, whoever asks.

Search term

Author

Year range

→

Sort

Language

Type

Field

Venue

New Directions for Evaluation

Topic

Retraction

Abstract

Evidence source

Study design

Label agreement

Label status

Direct Codex and Gemma labels are unvalidated and sparse. Distilled predictions cover the full frame and are also unvalidated. Choose the evidence source explicitly; absence of a direct label is never a negative label.

affaffiliation

fundfunder

venuejournal

aboutaboutness

The four routes compose: require the funder route and exclude affiliation to get the funder-only stratum no affiliation-based frame ever sees.

73 results · 1 filter active ·

Results by year

20002025

Publication date

Categories

Machine labels · sparse coverage

Evidence

Language

Type

Citations

An unlabeled work is unknown, not a negative. Label coverage is reported on every query.

73 works in the cohort · of 4,299,418page 2 of 2

Labels cover 1 of 73 works in this cohort. The rest are unlabeled, which is not a negative label: the label table is sparse today and grows as labeling rounds land.

Distilled predictions cover 73 of 73 works in this cohort. Predictions are machine_predicted_unvalidated teacher distillation outputs. Candidate is the union; consensus is the intersection.

fundno affno abstractunlabeled

Issue Information

2016· paratext· en· New Directions for Evaluation· Engineering

distilled prediction:candidate · metaepi_narrow+insufficient_payloadconsensus · insufficient_payload

citations

affunlabeled

Postscript: That Was Then, This Is Now

J. Bradley Cousins, Isabelle Bourgeois

2014· article· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · insufficient_payloadconsensus · insufficient_payload

citations

afffundunlabeled

Community‐Based Research on Evaluation: Beyond Academic and Evaluator Perspectives

Amanda Demmer, Jennifer Yessis, Kelly Skinner, J. Bradley Cousins

2025· article· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · metaresearch+sts+insufficient_payloadconsensus · metaresearch

citations

fundaboutno affunlabeled

Issue Information

Leslie Fierro, Todd Franke

2018· paratext· en· New Directions for Evaluation· Economics, Econometrics and Finance

distilled prediction:candidate · insufficient_payloadconsensus · insufficient_payload

citations

aboutno affgpt · no categorygrok · insufficient_payloadopus · insufficient_payloadmodels split

Issue Information

Jennifer R. Brown, Urban Archibald, Monica Hargraves, Jane Buckley, Claire Hebbard, Miriam R. Linver +3 more

2021· paratext· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · metaepi_narrow+scholarly_communication+insufficient_payloadconsensus · insufficient_payload

citations

fundno affunlabeled

Issue Information

Leslie Fierro, Todd Franke

2020· paratext· en· New Directions for Evaluation· Economics, Econometrics and Finance

distilled prediction:candidate · metaepi_narrow+insufficient_payloadconsensus · insufficient_payload

citations

fundaboutno affunlabeled

Issue Information

Leslie Fierro, Todd Franke

2018· paratext· en· New Directions for Evaluation· Economics, Econometrics and Finance

distilled prediction:candidate · insufficient_payloadconsensus · insufficient_payload

citations

affunlabeled

A learning agenda for the advocacy evaluation field's future

Julia Coffman, Sarah Stachowiak, Jared Raynor

2021· article· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · metaresearch+insufficient_payloadconsensus · none

citations

aboutno affunlabeled

Guest Editors’ notes

John M. LaVelle, Leah C. Neubauer, Ayesha S. Boyce, Thomas Archibald

2023· article· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · metaresearch+insufficient_payloadconsensus · insufficient_payload

citations

fundaboutno affunlabeled

Issue Information

2018· paratext· en· New Directions for Evaluation· Economics, Econometrics and Finance

distilled prediction:candidate · insufficient_payloadconsensus · insufficient_payload

citations

fundno affunlabeled

Issue Information

2020· paratext· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · metaepi_narrow+insufficient_payloadconsensus · insufficient_payload

citations

aboutno affunlabeled

Issue Information

2019· paratext· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · metaepi_narrow+insufficient_payloadconsensus · insufficient_payload

citations

affaboutunlabeled

At the intersection of co‐creation: Exploring LGBTQ2S evaluation with youth

Jane Whynot, Sarah Heath, Larissa Silver, Charlie‐Rae Robin, Mathew Kent

2022· article· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · sts+insufficient_payloadconsensus · none

citations

fundno affunlabeled

Issue Information

2025· paratext· en· New Directions for Evaluation· Economics, Econometrics and Finance

distilled prediction:candidate · insufficient_payloadconsensus · insufficient_payload

citations

fundno affunlabeled

Issue Information

2025· article· en· New Directions for Evaluation· Engineering

distilled prediction:candidate · insufficient_payloadconsensus · insufficient_payload

citations

affunlabeled

My Entry to the Field

J. Bradley Cousins

2018· article· en· New Directions for Evaluation· Psychology

distilled prediction:candidate · insufficient_payloadconsensus · insufficient_payload

citations

fundno affunlabeled

Issue Information

Leslie Fierro, Todd Franke

2020· paratext· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · metaepi_narrow+insufficient_payloadconsensus · insufficient_payload

citations

aboutno affunlabeled

Evaluation at the Time of Health Systems Reform: Chinese Policymakers’ Need for a Robust System of Evaluations to Assess Progress in the Implementation of Reform Efforts

Kun Zhao, April Nakaima, Wudong Guo, Yingpeng Qiu, Sanjeev Sridharan

2017· article· en· New Directions for Evaluation· Economics, Econometrics and Finance

distilled prediction:candidate · noneconsensus · none

citations

affno abstractunlabeled

Editor's notes

Sandra Mathison

2007· article· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · insufficient_payloadconsensus · none

citations

affno abstractunlabeled

Editors' notes

Liesel A. Ritchie, Wayne MacDonald

2010· article· en· New Directions for Evaluation· Social Sciences

distilled prediction:candidate · noneconsensus · none

citations

affunlabeled

The partnership of <i>new directions for evaluation</i> and the American evaluation association

Sandra Mathison

2007· article· en· New Directions for Evaluation· Decision Sciences

distilled prediction:candidate · metaresearch+stsconsensus · metaresearch

citations

fundaboutno affunlabeled

Issue Information

2024· paratext· en· New Directions for Evaluation· Engineering

distilled prediction:candidate · metaepi_narrow+insufficient_payloadconsensus · insufficient_payload

citations

aboutno affunlabeled

Issue Information

2023· paratext· en· New Directions for Evaluation· Economics, Econometrics and Finance

distilled prediction:candidate · insufficient_payloadconsensus · insufficient_payload

citations

← previous

How this was built: Screen · Findings · About