MétaCan
Menu
Back to cohort
Record W752406994

Assessment of a Master of Education Counselling Application Selection Process Using Rasch Analysis and Generalizability Theory/évaluation D'un Processus De Sélection De Candidats Pour Un Programme De Maîtrise En éDucation En Counseling En Utilisant L'analyse Rasch et la Théorie De la Généralisabilité

2014· article· fr· W752406994 on OpenAlexvenueaboutno aff
Stefanie S. Sebok‐Syer, Peter D. MacMillan

Bibliographic record

VenueCanadian Journal of Counselling and Psychotherapy · 2014
Typearticle
Languagefr
FieldDecision Sciences
TopicPsychometric Methodologies and Testing
Canadian institutionsnot available
Fundersnot available
KeywordsGeneralizability theoryPsychologyValuation (finance)Selection (genetic algorithm)Medical educationInterpersonal communicationProcess (computing)Quality (philosophy)Social psychologyMedicineComputer scienceBusiness
DOInot available

Abstract

fetched live from OpenAlex

Departments and faculties in universities everywhere are faced with the challenge of deciding, usually on an annual or semiannual basis, which individuals should be offered the opportunity to study at their particular institution. The application selection process has become even more challenging for highly com- petitive graduate and professional programs where there are a large number of individuals applying for a limited number of available spaces. Given that the pressure to select the best possible candidates without bias continues to grow, graduate and professional schools are becoming increasingly interested in evaluating the effectiveness of their own admissions processes to help ensure that their admissions processes are fair and accurate. Furthermore, not only do universities want selection methods that offer admission to those prospective students who have the desired qualities and characteristics needed for success in a particular program, but they also want to deny admission to applicants who may be problematic (Homrich, 2009). These dual purposes for admissions procedures exist because, in many graduate and professional programs, failure of candidates is not an option.University counselling programs provide one example of a professional program where the admission decisions are stakes. In Canada, over 40 universities have master's-level programs in counselling and admit students annually (Canadian Counselling and Psychotherapy Association, 2013). At most institutions, a large number of quality applicants vie for a limited number of spaces; therefore, selecting individuals who have strong interpersonal skills and are likely to complete the program within a timely fashion is challenging because the decisions are often based on fine distinctions. Due to the high-stakes competitive nature of graduate programs, many applicants likely employ the strategy of applying to multiple institutions. However, some applicants may receive multiple rejections as they are not ranked favourably according to any university's admissions standards. Given that a master's degree is typically required to become certified as a counsellor, an inability to secure an admissions offer ends, at least temporarily, the applicant's chances of a career in counselling. The possibility of never working in a career that one had hoped and prepared for makes the application process high-stakes. Typically, the preadmissions criteria used to screen potential counselling students are previous academic performance, writing ability, goals of the applicant, professional experience, and letters of reference (Corey, Corey, & Callanan, 2007; Nelson, Canada, & Lancaster, 2003).Unlike many other graduate programs that select applicants based solely on academic performance and research potential, the counselling application process includes a combination of academic and nonacademic admissions criteria in the selection process, which at times can be difficult to accurately measure. Furthermore, given the responsibilities of the profession, there is a need to ensure that those students entering counselling programs, and subsequently the counselling profession, have a specific set of qualities and characteristics. Previous research examining the selection criteria for counselling admissions in Canadian contexts has largely focused on doctoral programs in counselling (Pass & Scherer, 1979). Current research investigating the admissions process of master's-level counselling programs within Canadian institutions is essentially nonexistent, which is problematic given that within Canada only a master's degree in an accredited counselling program is required to become certified as a counsellor. Therefore, admissions decisions made at the masters level are a crucial form of gatekeeping because, once an applicant enters the program, the impetus is to keep the individual in the program, using mechanisms to remediate any deficiencies. Instances where programs have high proportions of individuals requiring remediation are problematic because time and resources are redirected toward supporting those requiring remediation. …

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.063
metaresearch head score (Gemma)0.001
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesMetaresearch, Meta-epidemiology (narrow)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Simulation or modeling · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.501
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0630.001
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0010.003
Science and technology studies0.0000.000
Scholarly communication0.0000.000
Open science0.0000.000
Research integrity0.0000.001
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.088
GPT teacher head0.445
Teacher spread0.357 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designSimulation or modeling
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2014
Admission routes2
Has abstractyes

Explore more

Same venueCanadian Journal of Counselling and PsychotherapySame topicPsychometric Methodologies and TestingFrench-language works237,207