MétaCan
Menu
← Back to cohort
Record W7011078826

Le processus d'évaluation des projets de films francophones par quatre organismes subventionnaires public canadiens : une observation critique

2022· other· fr· W7011078826 on OpenAlexfundaboutno aff

Bibliographic record

VenueArchipelago (University of Quebec in Montreal) · 2022
Typeother
Languagefr
FieldArts and Humanities
TopicArtistic and Creative Research
Canadian institutionsnot available
FundersCanada Council for the Arts
KeywordsContext (archaeology)PublicsPublic informationOccupational training
DOInot available

Abstract

fetched live from OpenAlex

Au Canada, un système de préfinancement permet aux projets cinématographiques d’envergure d’être majoritairement financés par l’état. L’opacité du processus de sélection des projets de film par les organismes subventionnaires est connue et maintes fois décriée par les observateurs et les artisans. Cette opacité et ces critiques nous ont incité à examiner la mécanique d’évaluation des scénarios de films de Téléfilm Canada, la SODEC, le Conseil des arts du Canada et le Conseil des arts et des lettres du Québec et de proposer une comparaison de cette mécanique avec le système d’évaluation de projets de création mis en place par les professeurs aux études supérieures. Par l’observation, la consultation de documents et par entrevues semi-dirigées, nous avons analysé la formation et le travail des comités d’évaluation des projets cinématographiques et nous avons établi la différence entre les réunions de pairs au sens « d’égaux » et les regroupements d’experts. Nous avons aussi examiné les mécanismes de prise de décision à l’intérieur de ces comités et le processus de communication de leurs résultats. Toute cette mécanique a été comparée au système mis en place dans le milieu scolaire pour l’évaluation des travaux créatifs des étudiants. Nous cherchons dans cette recherche à établir comment la valeur d’un projet de film est déterminée par les organismes financiers publics canadiens. Par une observation critique, cette thèse témoigne de l’inégalité des critères et des méthodes d’évaluation des projets de films de même que l’absence d’introspection formelle des organismes subventionnaires. Cette recherche allègue également qu’un rapprochement des protocoles d’évaluation des organismes avec le protocole didactique serait profitable. _____________________________________________________________________________ In Canada, a pre-funding system makes it possible for major cinematographic projects to be mainly funded by the state. The opacity of the selection process of the film projects by the funding bodies is known and often denounced by observers and the artisans. That opacity and those criticisms prompted us to examine the mechanics of the evaluation of film scripts by Telefilm Canada, SODEC, the Canada Council for the Arts and the Conseil des arts et des lettres du Québec, and to offer a comparison of those mechanics with the system used to evaluate creative projects put in place by professors in graduate programs. Through observation, the consultation of documents, as well as semi-directed interviews, we analyzed the creation and the work of cinematographic project evaluation committees and we established the difference between meetings of peers in the sense of “equals” and gatherings of experts. We also examined the mechanics of decision-making within these committees and the process used to communicate their results. All of these mechanics were compared to the system set up in the educational community for evaluating the creative work of students. Through this research, we seek to establish how Canadian public funding bodies determine the value of a film project. By way of critical observation, this thesis reflects the inequality of the criteria and the methods used for evaluating film projects, as well as the lack of formal introspection on the part of the funding bodies. The research also suggests that bringing the bodies’ evaluation protocols and the didactic protocol closer together would prove to be beneficial. _____________________________________________________________________________ MOTS-CLÉS DE L’AUTEUR : évaluation, critère, subjectivité, contexte, pair, Evaluation, criterion, subjectivity, context, peer

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.014
metaresearch head score (Gemma)0.023
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch
Consensus categoriesnone
DomainCandidate signal: Evaluation · Consensus signal: none
Study designCandidate signal: Qualitative · Consensus signal: Qualitative
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.986
Threshold uncertainty score0.764

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0140.023
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0030.003
Science and technology studies0.0120.007
Scholarly communication0.0120.003
Open science0.0010.003
Research integrity0.0010.002
Insufficient payload (model declined to judge)0.0080.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.024
GPT teacher head0.228
Teacher spread0.203 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

Study designQualitative
DomainEvaluation
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2022
Admission routes2
Has abstractyes

Explore more

Same venueArchipelago (University of Quebec in Montreal)→Same topicArtistic and Creative Research→French-language works237,207→