1 000 travaux · Opus 4.8 · GPT-5.6 (high) · Grok 4.5 · une seule grille verrouillée
La frontière du domaine n'est pas une ligne. C'est une région.
Trois modèles de pointe ont trié les mêmes 1 000 travaux, tirés de la vraie base avec des probabilités de sélection connues, selon la même grille verrouillée sur sa charge utile complète de huit champs. Parmi les 51 travaux qu'au moins un modèle a qualifiés de métarecherche, seulement 19 (37,3 %) l'ont été par les trois, et 24 (47,1 %) reposent sur l'avis d'un seul modèle.
Deux trieurs peuvent s'accorder sur un taux tout en repérant des travaux presque entièrement différents. À un taux de base d'environ 1 %, les rejets évidents offrent 98 % d'accord gratuitement ; c'est pourquoi une statistique d'accord calculée sur tout l'échantillon ne dit rien de la frontière, et pourquoi le livrable est le tableau ci-dessous, et non un pourcentage.
Les trois modèles ne sont pas interchangeables
Combien des 1 000 travaux chaque modèle a qualifiés de métarecherche (niveau T1 ou T2), sur des données identiques. T3 est adjacent et ne compte pas comme dans le champ ; c'est pourquoi le compte d'un modèle ne peut jamais dépasser les 51 travaux du dossier.
Changez le modèle que vous appelez « le trieur » et la taille du domaine bouge. Cet écart, et non l'intervalle de confiance binomial sur les étiquettes d'un seul modèle, est l'incertitude honnête sur la taille de la métarecherche canadienne.
Le dossier des désaccords
Les trois verdicts, confiances et motifs côte à côte. Ce sont les travaux sur lesquels les critères d'inclusion doivent être rédigés, parce que ce sont ceux sur lesquels des trieurs raisonnables, devant la même grille et les mêmes preuves, divergent.
| Travail | Strate | n_in | Opus 4.8 | GPT-5.6 | Grok 4.5 |
|---|---|---|---|---|---|
| Content validity for dementia of three generic preference based health related quality of life instruments 2002 · article · en · Quality of Life Research | aff_core w=5595 | 1/3 | T1medium empirical Assesses the content validity of three generic preference-based health-related quality of life instruments for dementia; the object is the measurement instruments that research and evaluation rely on, i.e., a research method and its properties, though a reasonable coder could read this as clinical measurement. | OUThigh empirical The work evaluates health-related quality-of-life instruments for dementia rather than research practice. | OUTmedium empirical Psychometric content validity of QoL instruments for dementia patients is clinical measurement work, not metaresearch. |
| Comparison between activity estimates obtained using bioenergetic and behavioural analysesContribution of the Groupe de Recherche Interuniversitaire en Limnologie (GRIL). 2008 · article · en · Canadian Journal of Fisheries and Aquatic Sciences | aff_core w=5595 | 1/3 | OUTmedium empirical Comparison of bioenergetic and behavioural techniques for estimating fish activity; domain measurement validation, not a study of research practice. | T1medium empirical The primary object is the comparative performance and robustness of two research methods for estimating fish activity. | OUTmedium empirical Compares measurement approaches for fish activity rates to answer an ecological question, not to study research practice. |
| The Mission of the University. Professional File. Number 26. 2005 · article · en · Canadian Society for the Study of Higher Education | venue_new w=2684 | 1/3 | T2low conceptual No abstract; a higher-education society paper on the mission of the university, which would place the academic institution (and its research mission) as the object, but the title alone cannot settle tier or whether Canadian academia is substantively studied. | OUTlow other The abstract is missing and the title alone does not establish that the work studies research itself. | OUTlow conceptual Title on university mission is higher-education general; abstract missing, so cannot establish research as the object. |
| Social impact assessments of large dams throughout the world: lessons learned over two decades 2003 · article · en · Impact Assessment and Project Appraisal | aff_core w=5595 | 1/3 | OUTlow conceptual Lessons on social impact assessment methods from large dam projects; the object is regulatory assessment practice rather than scholarly research practice, but the methodological framing puts it near the boundary. | T1medium empirical The work draws cross-case lessons about social impact assessment methods, monitoring, alternatives, and ethical practice. | OUThigh empirical Lessons on social impact assessment of large dams; project impact methods, not study of research itself. |
| Remaking the Self: Trauma, Teachable Moments, and the Biopolitics of Cancer Survivorship 2012 · article · en · Culture Medicine and Psychiatry | aff_core w=5595 | 1/3 | T2medium conceptual Critical analysis of how the psychosocial oncology literature constructs 'teachable moments' and 'post-traumatic growth' in cancer survivorship; an STS/medical-anthropology study of biomedical knowledge and its concepts, though survivorship itself is also an object. | OUThigh conceptual The article analyzes cancer-survivorship discourse and biopolitics, not research practice. | OUThigh conceptual Biopolitical reading of cancer survivorship discourse; object is patienthood and clinical culture, not research practice. |
| Comparison of a Manual and an Automated Method to Estimate the Number of Uterine Eggs in Anisakid Nematodes: To Coulter or Not to Coulter. Is That the Question? 2007 · article · en · Journal of Parasitology | aff_core w=5595 | 1/3 | OUTmedium empirical Comparison of two laboratory techniques for counting nematode eggs; this is assay/measurement validation within parasitology, the polysemy trap the rubric flags, not a study of research practice. | T1medium empirical The primary object is a comparison of two research measurement methods and their precision, although it is narrowly domain-specific. | OUThigh empirical Compares laboratory egg-counting techniques in parasitology; domain measurement methods, not research practice as object. |
| Assessment as a Learning Project: Online Surveys with Immediate Formative Feedback 2017 · article · en · Purdue e-Pubs (Purdue University System) | about_only w=3321 | 1/3 | T2low empirical Academic library study of information literacy instruction and assessment: how students find and evaluate sources; LIS work on information behaviour, though the object is student learning rather than researchers. | OUThigh empirical It evaluates students' information-literacy learning rather than researchers' information behavior. | OUTmedium empirical Student information-literacy pedagogy/assessment at a university, not information behaviour of researchers. |
| Achievements and Lessons Learned from Vietnam’s Higher Education Quality Assurance System after a Decade of Establishment 2017 · article · en · International Journal of Higher Education | venue_new w=2684 | 1/3 | OUTmedium empirical Analysis of Vietnam's higher education quality assurance and accreditation system; the object is educational accreditation and university governance rather than research evaluation, though the two are adjacent. | OUThigh empirical This study examines Vietnam's higher education accreditation system rather than research evaluation or practice. | T1medium empirical Object is higher-education quality assurance and accreditation as evaluation system, including self/external evaluation and quality culture. |
| Philosophical Apprenticeships: Contemporary Continental Philosophy in Canada 2009 · book · en · University of Ottawa Press eBooks | about_only w=3321 | 1/3 | T2low conceptual No abstract; the book appears to document the formation and trajectory of the contemporary continental philosophy community in Canada through scholars' apprenticeships, which would make Canadian academic careers and a discipline's development the object, but the title alone cannot settle it. | OUTlow conceptual The title suggests a work about philosophy in Canada, but the missing abstract prevents ruling out a study of the research field. | OUTmedium other Book on continental philosophy in Canada; intellectual history/philosophy scene, not contemporary research practice as object. |
| Research of the Students Volunteer Service and Management in University Library 2015 · article · en · Higher education of social science | venue_new w=2684 | 1/3 | T2low conceptual Analysis of student volunteer management in university libraries with proposed recruitment, training, and evaluation strategies; library and information science on an academic library's operations, but far from research practice, so genuinely borderline. | OUThigh conceptual This work addresses volunteer management in university libraries, not researchers' information behavior or research infrastructure. | OUThigh empirical Management of student volunteers in university libraries; operational library admin, not researcher information behaviour or scholarly communication as object. |
| Understanding the dynamic nature of risk in climate change assessments—A new starting point for discussion 2020 · article · en · Atmospheric Science Letters | aff_core w=5595 | 1/3 | T2low conceptual Critique of the risk framework the IPCC uses in climate assessments, calling for standardization of the methods used to quantify risk; borderline between assessment methodology and domain climate-risk theory. | OUThigh conceptual It develops a conceptual framework for climate risk rather than studying research practice. | OUThigh conceptual Conceptual paper on IPCC climate-risk frameworks, not metaresearch on how research is done or evaluated. |
| From Sustainable Global Value Chains to Circular Economy—Different Silos, Different Perspectives, but Many Opportunities to Build Bridges 2021 · article · en · Circular Economy and Sustainability | aff_core w=5595 | 1/3 | T2low conceptual Piece framed around two siloed research literatures and bridging them; the object may be the scholarly fields themselves, but no abstract is available to confirm. | OUThigh conceptual The article discusses sustainable value chains and circular economy perspectives. | OUTmedium conceptual Title on sustainable value chains and circular economy indicates business/supply-chain scholarship, not research as object. |
| Designing Space for Walking as the Primary Mode of Travel 2023 · other · en | aff_core w=5595 | 1/3 | T2low conceptual Chapter whose stated purpose is to discuss the diversity of research approaches to walking, comparing objective and subjective analytic traditions; boundary between a methods review and a domain review. | OUThigh conceptual This chapter examines walking and urban design, not research itself. | OUThigh conceptual Urban design chapter on walking as travel mode, not science-of-science. |
| Investigating the Readability and Linguistic, Psychological, and Emotional Characteristics of Digital Dementia Information Written in the English Language: Multitrait-Multimethod Text Analysis 2023 · article · en · JMIR Formative Research | venue_new w=2684 | 1/3 | T2low empirical Text analysis of the readability and linguistic accessibility of digital dementia information, including peer-reviewed research articles, for people with dementia; touches how research is communicated and discovered, but the primary object is consumer health information, so it sits on the boundary. | OUThigh empirical It studies readability and accessibility of dementia information, not scholarly communication as research practice. | OUTmedium empirical Health literacy readability of dementia info for patients; not research practice or researcher behaviour. |
| Robust joint modelling of sparsely observed paired functional data 2023 · article · en · Canadian Journal of Statistics | venue_new w=2684 | 1/3 | T1low empirical Develops and compares a robust statistical estimator for paired functional data, studying its properties via simulation against an existing method; borderline between statistical-methods research and pure domain statistics. | OUThigh empirical This develops a statistical model for functional data, not a study of how research is conducted. | OUThigh empirical Develops a robust statistical model for paired functional data (supernova light curves); domain methods development, not study of research. |
| Dietary interventions in cancer: a systematic review of all randomized controlled trials 2024 · review · en · JNCI Journal of the National Cancer Institute | aff_core w=5595 | 1/3 | T1medium empirical Systematic review characterizing all dietary intervention RCTs in cancer by sample size, endpoint choice, and design; the reported findings are about the state of the trial literature, though a clinical conclusion is also drawn. | OUThigh empirical The systematic review answers a clinical question about dietary interventions in cancer rather than studying synthesis methodology. | OUThigh empirical Systematic review of dietary RCTs in cancer answers a clinical effectiveness question; uses synthesis method rather than studying the method. |
| Reflections on co-researching AI literacy 2024 · article · en · International Journal for Students as Partners | venue_new w=2684 | 1/3 | T3low editorial/commentary Reflective case study on a students-as-partners co-research project, with recommendations on roles and recognizing student input; commentary touching on how collaborative inquiry is conducted, so contextual at most. | T1medium empirical The case study explicitly examines co-researching practices and the challenges of partnership in conducting research. | OUTmedium conceptual Case reflection on Students-as-Partners pedagogy for AI literacy teaching, not study of research as an object. |
| From the Enlightenment to Black Lives Matter: Tracing the Impacts of Racial Trauma in Black Communities from the Colonial Era to the Present 2024 · book · en | aff_core w=5595 | 1/3 | T2low conceptual Book critiquing the colonial legacy of psychiatry and how race politics shape psychiatric diagnosis; readable as a social study of a scientific discipline's knowledge (STS-adjacent), but the object is arguably clinical and historical rather than contemporary research practice, so genuinely on the boundary and the blurb is thin. | OUThigh conceptual The book examines race, psychiatry, and public health rather than research as an object. | OUThigh conceptual Historical and political analysis of racial trauma and psychiatry, not study of research systems. |
| “Unsure whether it feels like home anymore”: Unsettled feelings amongst former panel-block residents in Moscow and Berlin 2025 · article · en · Ethnography | fund_new w=1679 | 1/3 | T2low empirical Ethnography that turns substantially into reflexive analysis of ethnographic practice and research ethics under political violence; borderline, since the substantive object remains housing and home. | OUThigh empirical The ethnography studies residents' feelings and responses to urban renewal and war, not research itself. | OUThigh empirical Urban ethnography of housing and belonging, not science or research as objects. |
| From positionality statements to reflexive statements of principle-informed process 2025 · article · en · BMJ Global Health | aff_core w=5595 | 1/3 | T3low editorial/commentary Argues for moving from positionality statements to reflexive statements of principle-informed process in global health research outputs; the object is a research reporting and equity practice, but the payload is a single summary-box sentence and it reads as commentary/analysis rather than a study, so the T1/T3 line is genuinely uncertain. | T1high conceptual The work examines how positionality and reflexive processes are reported in research outputs. | T3medium editorial/commentary Normative commentary on positionality statements in research outputs, not an empirical study of research systems. |
| Le jeune téléspectateur, objet de discours social : le cas du Chili «post-1990» 2012 · other · fr · Library and Archives Canada (Government of Canada) | french w=1554 | 1/3 | T2low conceptual Foucauldian thesis treating the 'young television viewer' as a discursive formation and object of knowledge, explicitly folding into its problematic the research subfield (communication jeunesse) that the category helped create; that makes it a social study of how a knowledge object and its research field are constituted, but the broader object is social discourse in Chile, so it is genuinely on the STS boundary. | OUThigh conceptual The thesis studies social and discursive constructions of young television viewers rather than research practice. | OUThigh conceptual Discourse analysis of the child television viewer in post-1990 Chile; media studies, not metaresearch. |
| Le mythe des deux solitudes. Des relations entre les psychiatres francophones et anglophones dans le Montreal des annees 1950 2017 · article · fr · Project Muse (Johns Hopkins University) | french w=1554 | 1/3 | OUTlow empirical Archival history of relations between francophone and anglophone psychiatrists in 1950s Montreal; a professional community in the past, not contemporary research practice. | T2medium empirical The historical study examines professional and knowledge-making relations among psychiatrists as a scientific community. | OUTmedium empirical Historical study of Francophone–Anglophone psychiatrist relations in 1950s Montreal; professional medical history, not research practice as object. |
| Large language models in academic writing 2025 · article · en · Multiple Sclerosis and Related Disorders | aff_core w=5595 | 1/3 | T3low editorial/commentary Piece on large language models in academic writing, which is squarely a scholarly communication and research integrity topic; the abstract is absent and the clinical venue suggests a commentary or correspondence rather than a study, so the T1/T3 assignment cannot be settled from the payload. | T3low editorial/commentary The title indicates commentary about academic writing and scholarly communication, but the missing abstract prevents a firmer assessment. | T1high other Title unambiguously targets LLMs in academic writing, i.e. scholarly communication and research practice. |
| Joseph Bologne in an Atlantic View 2025 · article · en · ALTERNATIVE FRANCOPHONE | aff_core w=5595 | 1/3 | OUTlow conceptual Musicological essay that critiques how music-historical writing has framed Joseph Bologne while offering a new historical reading; the historiographic critique frames an object that remains the historical figure, so it sits near the T2 boundary. | OUThigh conceptual This essay reinterprets a historical musician in musicological writing and does not study research itself. | T2medium conceptual Meta-historiographic essay on how musicology has framed Bologne and Blackness; object is scholarly writing practices, generously adjacent STS/historiography of a field. |
Ce que le tri a réellement trouvé
Trois modèles de pointe (Opus 4.8, GPT-5.6 high, Grok 4.5) ont trié les mêmes 1 000 travaux de la VRAIE base de 4,3 M, sur la charge utile COMPLÈTE de huit champs de la grille, avec des lots randomisés consignés au manifeste et des étiquettes écrites par le dispositif : chaque défaut relevé par D1, D2, D11 et le constat 16, réparé. Les taux de base pondérés par le plan de sondage s'étendent de 1,89 % à 3,54 % (1,9 fois). Mais ce sont les ensembles qui font le constat, comme le constat 16 le prédisait : des 51 travaux qu'AU MOINS UN modèle a qualifiés de métarecherche, seulement 19 (37 %) l'ont été par LES TROIS, et 24 (47 %) reposent sur l'avis d'un seul modèle. LA FRONTIÈRE DU DOMAINE N'EST PAS UNE LIGNE QUE LES MODÈLES PARTAGENT ; C'EST UNE RÉGION QUE CHACUN DÉCOUPE À SA FAÇON. GPT-5.6 a de plus enfreint le schéma de sortie verrouillé sur 18 des 1 000 notices, en écrivant des valeurs de genre dans le champ du niveau, ce que le validateur de manifeste a détecté. Le livrable n'est pas le taux de base : c'est le dossier des désaccords, les 51 travaux qui marquent la frontière empirique du domaine et sur lesquels les critères d'inclusion doivent réellement être rédigés.
Calculé le 2026-07-12T19:52:14Z · les 22 constats · ce dossier en JSON