A Question of Respect: A Qualitative Text Analysis of Canadian Parliamentary Committee Hearings on PCEPA
Bibliographic record
Abstract
Project Summary: The overarching research question that we address in our paper, “A Question of Respect: A Qualitative Text Analysis of the Canadian Parliamentary Committee Hearings on The Protection of Communities and Exploited Persons Act (PCEPA),” forthcoming Canadian Journal of Political Science/Revue canadienne de science politique (December 2017), centers on whether parliamentary committee members treated witnesses fairly and respectfully. To address this question, we engaged in a qualitative text analysis of the hearing transcripts of both the Standing Committee on Justice and Human Rights and the Senate Standing Committee on Legal and Constitutional Affairs on this bill that took place in the summer and fall of 2014. We found in this study that, on the whole, the vast majority of questions met this baseline, but that committee members were biased toward witnesses in agreement with their position and against witnesses in opposition to it. Our approach was based on grounded theory, and we inductively developed codes from an interpretation of the data. In this appendix, we present our coding scheme, including key assumptions, units of analysis, conceptualization and coding process, reliability and agreement measurements, and core and evaluative codes. We hope that other qualitative researchers will use and develop our codes. Data Abstract: Our data took the form of PDFs of official English-language transcripts of parliamentary hearings by both the House and Senate committees on Bill C-36. More specifically, our data units were questions posed by committee members to witnesses as articulated in the hearing transcripts. The hearings on Bill C-36 took place in July 2014 (House) sand September and October 2014 (Senate), and the transcripts are publicly accessible on government websites (full list of links provided in documentation). Our data collection strategy involved downloading PDF versions of each of the Commons and Senate hearings on the bill. We conducted an initial read of the transcripts to identify questions posed by committee members to witnesses (please see our coding scheme for a detailed discussion of how we identified questions for analysis). We organized the questions (i.e., our units of analysis) by assigning to each a unique number. This enabled us to systematically code each question in terms of its content, tone, and nature (see coding scheme for more details on our coding definitions). This deposit consists of our coding scheme, which we hope will provide other researchers with definitions of respectful/disrespectful, positive/negative/neutral tone, and sympathetic/combative/fair questions and with an approach to conducting qualitative text analysis of legislative hearings. It also consists of links directly to the hearing transcripts for Bill C-36, as well as the full-text version of all the transcripts we analyzed.
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.068 | 0.159 |
| Meta-epidemiology (narrow) | 0.001 | 0.001 |
| Meta-epidemiology (broad) | 0.001 | 0.001 |
| Bibliometrics | 0.012 | 0.020 |
| Science and technology studies | 0.036 | 0.028 |
| Scholarly communication | 0.011 | 0.007 |
| Open science | 0.005 | 0.011 |
| Research integrity | 0.003 | 0.006 |
| Insufficient payload (model declined to judge) | 0.006 | 0.001 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".