MétaCan
Menu
Back to cohort
Record W3041574562 · doi:10.11575/prism/37985

Designing a Protocol for Developmental Observation of Online Teaching

2020· dissertation· en· W3041574562 on OpenAlexaboutno aff
Flora Mahdavi

Bibliographic record

VenueOpen MIND · 2020
Typedissertation
Languageen
FieldSocial Sciences
TopicHigher Education Learning Practices
Canadian institutionsnot available
Fundersnot available
KeywordsProtocol (science)Computer scienceMathematics educationPsychologyMedicineAlternative medicine

Abstract

fetched live from OpenAlex

Many higher education institutions in Canada have identified a lack of professional development and pedagogical support for faculty and their resistance as significant barriers to implementation and growth of online education. This study focused on the observation of online teaching as a way of providing ongoing pedagogical support to online instructors to enhance their professional development. Though teaching observation in face-to-face classrooms for purposes of evaluation or development has received extensive attention from scholars, this method of support in the online learning environments is novel and understudied. Using an iterative design-based research methodology, a protocol for developmental observation of online teaching (DOOT) was designed, refined and evaluated. This process aimed to respond to the question of how such a protocol supports the professional growth of online instructors at a community college setting. The study was conducted at a community college in Western Canada involving the participation of online instructors from the School of Business of the college, as observed instructors, and educational developers from the Teaching and Learning unit of the college, as observers. During different stages of the study, participants provided feedback on the feasibility of the DOOT Protocol, identified their contextual needs, and took part in piloting the initial Protocol and evaluating the Protocol at the last phase of the study. The six key elements of the DOOT Protocol were identified as 1) a clear developmental purpose, 2) clarity of process design and scope, 3) a definition of observable online teaching, 4) observer skills and orientation, 5) engaging in critical reflection, and 6) planning follow-up steps. To effectively facilitate the DOOT process, educational developers need to have skills and knowledge in theory and practice of online teaching, navigating technology that is the medium of the online education, and facilitation. Though all participants reported benefits from taking part in the DOOT observations during the pilot and evaluation of the Protocol, critical reflection and successful follow-up planning was evident when online instructors recognized reflection as a means for incremental improvements and educational developers demonstrated strong facilitation skills. The main contribution of the study is an evidence-based protocol that could be used for developmental observation of online teaching within a relatively short time frame that leads to incremental developmental plans. This study has responded to the challenge of elasticity of time in observation of online teaching, which is not limited to the traditional classroom time frames. Further, observable online teaching for the context of the study was defined based on the Community of Inquiry (CoI) theoretical framework for online education (Garrison, Anderson, & Archer, 2000). More research in other contexts can increase transferability of the findings of this study to other types of higher education institutions to adopt the DOOT Protocol as a means for providing ongoing pedagogical support to online instructors.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.001
metaresearch head score (Gemma)0.002
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesInsufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: none
Teacher disagreement score0.941
Threshold uncertainty score1.000

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0010.002
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.001
Open science0.0010.000
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0010.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.231
GPT teacher head0.518
Teacher spread0.287 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

Study designNot applicable
Domainnot available
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2020
Admission routes1
Has abstractyes

Explore more

Same venueOpen MINDSame topicHigher Education Learning PracticesFrench-language works237,207