1,000 works · Opus 4.8 · GPT-5.6 (high) · Grok 4.5 · one locked rubric
The field’s boundary is not a line. It is a region.
Three frontier models screened the same 1,000 works, drawn from the real frame with known selection probabilities, against the same locked rubric on its full eight-field payload. Of the 51 works any model called metaresearch, only 19 (37.3%) were called metaresearch by all three, and 24 (47.1%) rest on a single model's opinion.
Two screeners can agree on a rate while finding almost entirely different works. At a ~1% base rate, the settled rejects buy 98% agreement for free — which is why an agreement statistic computed over the whole sample tells you nothing about the boundary, and why the table below, not a percentage, is the deliverable.
The three models are not interchangeable
How many of the 1,000 works each model called metaresearch (tier T1 or T2), on identical input. T3 is adjacent and does not count as in scope, which is why a model's count can never exceed the 51 works in the dossier.
Swap which model you call “the screener” and the size of the field moves. That spread — not the binomial confidence interval on any one model's labels — is the honest uncertainty on how big Canadian metaresearch is.
The disagreement dossier
All three verdicts, confidences and reasons side by side. These are the works against which the inclusion criteria have to be written — because these are the works on which reasonable screeners, given the same rubric and the same evidence, disagree.
| Work | Stratum | n_in | Opus 4.8 | GPT-5.6 | Grok 4.5 |
|---|---|---|---|---|---|
| Replication Attempt: “Effect of BMAP-28 Antimicrobial Peptides on Leishmania Major Promastigote and Amastigote Growth: Role of Leishmanolysin in Parasite Survival” 2014 · letter · en · PLoS ONE | fund_new w=1679 | 3/3 | T1low empirical A direct replication submitted to the Reproducibility Initiative to independently validate a published result; framed as reproducibility work, though its immediate object is a specific biological claim. | T1high empirical This reports an attempted replication and independent validation of prior experiments, making reproducibility the object of study. | T1high empirical Independent replication attempt submitted to the Reproducibility Initiative; primary object is whether prior results replicate. |
| Using document delivery data for selecting medical titles in a large STM library: the experience of CISTI 2006 · article · en · Interlending & Document Supply | about_only w=3321 | 3/3 | T2high empirical Library and information science study using document delivery and serials usage data to guide collection development at Canada's national science library; the object is how a research library serves researchers. | T2high empirical It studies information-use and collection-development practices in the Canadian scientific research library system. | T2high empirical LIS collection-development study using document-delivery data at CISTI, a Canadian STM research library. |
| Do open label blinded outcome studies of novel anticoagulants versus warfarin have equivalent validity to those carried out under double-blind conditions? 2013 · review · en · Thrombosis and Haemostasis | aff_core w=5595 | 3/3 | T1high empirical Meta-epidemiological comparison of PROBE versus double-blind trial designs and whether design affects estimated effects; the object is study design and its validity. | T1high empirical The object is whether different clinical trial designs have equivalent validity, which directly studies research methods. | T1high empirical Primary object is clinical-trial design validity (PROBE vs double-blind), i.e. research methods properties. |
| Ethical issues in empirical studies of software engineering 2002 · article · en · IEEE Transactions on Software Engineering | fund_new w=1679 | 3/3 | T1high conceptual Article on the ethical issues raised by empirical research methods in software engineering; the object is research conduct and integrity in an empirical research literature. | T1high conceptual It directly examines ethical issues in empirical software-engineering research. | T1high conceptual Primary object is ethics of empirical software engineering research methods and human-subjects research practice. |
| Training graduate students and postdocs in course design: A workshop to bridge the gap between new professors’ pedagogical background and institutions’ teaching requirements 2017 · article · en · Scholarship@Western (Western University) | about_only w=3321 | 3/3 | T1medium empirical Evaluates a workshop preparing graduate students and postdocs for academic careers, with survey data on their readiness and competitiveness for academic positions; the object is the training and careers of the research workforce. | T1high empirical The work evaluates training and career preparation for graduate students and postdocs as members of the research workforce. | T1medium empirical Evaluates a workshop training graduate students and postdocs for academic teaching careers; research workforce training and capacity. |
| A bibliometric analysis of the research hotspots in the applications of internet searches in breast cancer patients (Preprint) 2018 · article · en · JMIR Cancer | venue_new w=2684 | 3/3 | T2medium empirical Bibliometric analysis of research hotspots in a literature on internet searches in breast cancer; the method is bibliometric and the object is a body of research output, matching the borderline bibliometric case. | T2medium empirical The bibliometric analysis studies a research literature and its hotspots, making research output the object rather than merely using bibliometrics. | T2medium empirical Bibliometric mapping of research hotspots on internet-search applications in breast cancer; studies a research literature, borderline T2. |
| Statute-Based Protections for Research Participant Confidentiality: Implications of the US Experience for Canada 2018 · article · en · Canadian Journal of Law and Society / Revue Canadienne Droit et Société | about_only w=3321 | 3/3 | T2medium conceptual Comparative legal analysis of statute-based protections for research participant confidentiality, drawing lessons from US instruments for the Canadian context; the object is how research is governed and regulated in Canada, which is research policy analysis (a reasonable coder could call this core T1). | T2medium policy The paper analyzes legal protections governing research participants and their application to the Canadian research context. | T1high conceptual Analyzes statute-based legal protections for research participant confidentiality, comparing US models for Canadian research governance. |
| Challenges in conducting long-term outcomes studies in critical care 2019 · review · en · Current Opinion in Critical Care | aff_core w=5595 | 3/3 | T1high conceptual Review of the methodological challenges of long-term follow-up studies in critical care: attrition, missing data, lack of standardized outcomes and covariate reporting, and proposed methodological solutions; the object is how this research is done. | T1high conceptual It directly examines methodological challenges in conducting long-term critical-care outcome studies. | T1high conceptual Review of methodological challenges in conducting and completing long-term critical care outcomes research. |
| Ethnic Ancestry, Culture, Identity, and Health: Using Ethnic Origin Data from the 2001 Canadian Census 2003 · article · en · Canadian ethnic studies | venue_new w=2684 | 3/3 | T1medium conceptual Analytic paper on the use of Canadian census ethnic origin data in health research: how the question is formulated, the conceptual and methodological challenges for data usage, and recommendations for future research. | T1medium conceptual It examines the definition, linkage, and methodological use of ethnicity data in health research. | T1medium conceptual Analyzes methods and uses of Canadian ethnic-origin census data as inputs to health research. |
| Green and Sustainable Life Insurance: A Bibliometric Review 2021 · review · en · Journal of risk and financial management | venue_new w=2684 | 3/3 | T2medium empirical Bibliometric co-word analysis of the published literature on risk management and sustainability in insurance; bibliometric method whose object is a research literature and its trends. | T2medium empirical It uses bibliometric analysis to study a body of published research, making it adjacent metaresearch. | T2medium empirical Bibliometric review maps a research literature on green life insurance; object is publication patterns, borderline domain map. |
| Generation X Global City Leaders: An emerging process for examining leadership experience in multi-national, multi-layer comparative perspective 2014 · article · en · Comparative and International Education | venue_new w=2684 | 3/3 | T1medium conceptual Methodological reflection on how to conduct multi-jurisdiction comparative leadership research: forming research consortia, designing the study, working with advisory groups; the object is research practice itself. | T1high conceptual The primary object is the practice and methods of conducting comparative educational leadership research. | T1high conceptual Primary object is methods and pragmatics of conducting comparative educational leadership research across jurisdictions. |
| Ophthalmology on social networking sites: an observational study of Facebook, Twitter, and LinkedIn 2015 · article · en · DOAJ (DOAJ: Directory of Open Access Journals) | about_only w=3321 | 3/3 | T1medium empirical Observational study of the social media presence and reach of ophthalmology journals, associations and publications; the object is scholarly and professional dissemination practice. | T1high empirical It studies how ophthalmology journals and professional organizations use social media for scholarly dissemination. | T1high empirical Observational study of ophthalmology journals and associations on social platforms; object is scholarly communication. |
| Enquête sur les initiatives canadiennes et internationales en matière de la gestion des données 2008 · report · fr · Zenodo (CERN European Organization for Nuclear Research) | french w=1554 | 3/3 | T2medium empirical Research library association survey of Canadian and international research data management initiatives and the roles open to libraries; LIS and research data infrastructure, with the Canadian landscape as a substantive object. | T2high conceptual This report maps Canadian and international research data management initiatives and library roles, making research infrastructure its object. | T2high policy Landscape report of Canadian and international research data management initiatives and library roles; research infrastructure/LIS with Canada as substantive object. |
| Les défis informationnels pour les étudiants au doctorat en médecine au Burkina Faso 2023 · article · fr · Canadian Journal of Information and Library Science | french w=1554 | 3/3 | T2medium empirical LIS study of the information behavior and information-seeking barriers of medical doctoral students writing their theses in Burkina Faso. | T2high empirical It studies how medical doctoral students, as researchers, find and use scholarly information. | T2high empirical LIS study of how medical doctoral students seek and access scholarly information for theses, squarely information behaviour of researchers. |
| Les grandes étapes du développement des sciences au Canada 2019 · book-chapter · fr · McGill-Queen's University Press eBooks | french w=1554 | 3/3 | T2medium conceptual Book chapter on the major stages of the development of science in Canada; the object is the Canadian science system itself, though no abstract is available. | T2low conceptual The title suggests a historical account of the development of science in Canada, but the abstract is missing. | T2low conceptual Title indicates history of science development in Canada (HPS/STS-adjacent study of science as a system); no abstract to confirm framing. |
| L’« oubli » des femmes comme sujets pensants 2024 · article · fr · Philosophiques | french w=1554 | 3/3 | T1medium empirical Analyzes the representation of women authors in the Quebec journal Philosophiques over fifty years through the lens of epistemic injustice; the object is authorship and workforce equity in a Canadian scholarly venue. | T1high empirical This examines women’s authorship and representation in a scholarly journal, making scholarly communication and research workforce equity the objects of study. | T1high conceptual Analyzes women's underrepresentation as authors in Philosophiques and epistemic injustice in scholarly publishing; equity of the research workforce and a Canadian journal as object. |
| Charity Open Access Fund (COAF) open access spend and compliance monitoring: 2017-18 2019 · dataset · en · Figshare | about_only w=3321 | 3/3 | T1high empirical Dataset of a funder consortium's open access spend, article processing charges, licences and repository compliance; the object is open access publishing and funder compliance. | T1high other The dataset studies open-access publishing expenditure and compliance practices. | T1high other Dataset of open-access spend and licence/repository compliance for funded papers; scholarly communication is the object. |
| Paulin Hountondji and the Science Question in Africa 2025 · book · en · PhilPapers (PhilPapers Foundation) | fund_new w=1679 | 3/3 | T2medium conceptual Philosophy/STS book reconstructing Hountondji's account of modern science in Africa, its entanglement with colonialism and the social organization of scientific knowledge; science as a social system is the object. | T2high conceptual The book examines modern science as a social and historical system in relation to colonialism. | T2high conceptual Philosophy/STS reconstruction of Hountondji on modern science, colonialism, and science in Africa. |
| Inventaire des profils et des spécialisations des professeurs évoluant au sein des facultés ou des départements des sciences de l’éducation au Québec 2024 · article · fr · Revue des sciences de l éducation | french w=1554 | 3/3 | T1high empirical Inventory of the training profiles and research specializations of professors in Quebec faculties of education, documenting shrinking disciplinary diversity and a shift away from the foundations; the object is the composition of an academic research workforce in Canada. | T1high empirical The primary object is the Canadian research workforce, including professors' training, research fields, and specialization patterns. | T1high empirical Inventory of Québec education-faculty professors’ profiles and research specializations; research workforce as object. |
What the screen actually found
Three frontier models (Opus 4.8, GPT-5.6 high, Grok 4.5) screened the same 1,000 works from the REAL 4.3M frame, on the rubric's FULL eight-field payload, with randomized manifest-logged chunks and harness-written labels: every defect D1, D2, D11 and finding 16 identified, repaired. Design-weighted base rates span 1.89% to 3.54% (1.9x). But the sets are the finding, as finding 16 predicted: of the 51 works ANY model called metaresearch, only 19 (37%) were called metaresearch by ALL THREE, and 24 (47%) rest on a single model's opinion. THE FIELD'S BOUNDARY IS NOT A LINE THE MODELS SHARE; IT IS A REGION THEY EACH CUT DIFFERENTLY. GPT-5.6 also violated the locked output schema on 18 of 1,000 records, writing genre values into the tier field, which the manifest validator caught. The deliverable is not the base rate: it is the disagreement dossier, the 51 works that mark the empirical boundary of the field and against which the inclusion criteria must actually be written.
Computed 2026-07-12T19:52:14Z · all 22 findings · this dossier as JSON