MétaCan
Menu
Back to cohort
Record W4295249206 · doi:10.2196/38759

American Anesthesiology Residency Programs: Website Usability Analysis

2022· article· en· W4295249206 on OpenAlex

Why this work is in the frame

A frame that forgets how it found something cannot be audited. These are the routes that admitted this work.

venuePublished in a venue whose home country is Canada.
no affNo Canadian affiliation: this work is invisible to an affiliation-only frame.
No Canadian affiliation. An affiliation-only frame, the usual design, would never have seen this work. It is one of the works that make the case for inverting the frame.

Bibliographic record

VenueInteractive Journal of Medical Research · 2022
Typearticle
Languageen
FieldComputer Science
TopicUsability and User Interface Design
Canadian institutionsnot available
Fundersnot available
KeywordsUsabilityAnesthesiologyWeb usabilityMedical educationWorld Wide WebQuality (philosophy)Computer scienceMedicine

Abstract

fetched live from OpenAlex

BACKGROUND: The Association of American Medical Colleges has recently issued recommendations for the upcoming 2022-2023 application cycle that residency programs should conduct all interviews for this upcoming application cycle over the web. In light of these recommendations, many students will have limited exposure to anesthesiology programs and will rely on information gleaned digitally. This change means that the aspects of program websites used to provide information, such as size, structure, location, requirements, and contact information, will be crucial in helping prospective residents decide where and how to apply in the future. An evaluation of website usability, which includes initial appearance along with factors that influence its ease of navigation and convenience of use, can thus be applied to anesthesiology residency websites. Areas of need can be targeted to increase web presence and provide effective pathways to exhibit the different attributes of their programs to future applicants. OBJECTIVE: This study aimed to compile a list of US anesthesiology residency programs and their websites while objectively analyzing the websites using a formally published usability scoring system, as well as to identify positive and negative trends to offer areas of improvement among anesthesiology residency websites. METHODS: We included only 114 US anesthesiology residency program websites in our sample set, since some websites we analyzed showed errors or inconclusive. Website usability was separated into 4 distinct categories for analysis based on methodology outlined in previous literature on both health care website usability and residency website usability. The 4 categories were Accessibility, Marketing, Content Quality, and Technology. Each website was then analyzed and scored based on key components highlighted within the 4 categories. The multiple factors were then graded using a percentage system to create a comprehensive score for each program. RESULTS: The highest scoring category was Content Quality (mean 4.7, SD 2.48, SE 0.23). The lowest scoring category was Technology (mean 0.9, SD 0.38, SE 0.04). CONCLUSIONS: Through the application of a health care website usability framework, multiple anesthesiology residency programs were analyzed and scored in the areas of Accessibility, Marketing, Content Quality, and Technology, which allowed us to determine the effectiveness of the usability of these websites to convey information to their end user. Websites must communicate vital information, with usability at the forefront, to continue to grow, especially as the United States faces challenges due to the COVID-19 pandemic. Our recommendation is that anesthesiology programs should strive to improve website usability to increase the ease by which applicants can collect vital information about anesthesiology programs. A few proposed solutions include making changes such as decreasing error pages on websites, migrating away from using in-line cascading style sheets, and improving web page loading speeds to improve the Technology category.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.021
metaresearch head score (Gemma)0.007
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesResearch integrity, Insufficient payload (model declined to judge)
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: none
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.711
Threshold uncertainty score0.999

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0210.007
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0010.000
Bibliometrics0.0010.004
Science and technology studies0.0000.001
Scholarly communication0.0000.001
Open science0.0040.001
Research integrity0.0000.003
Insufficient payload (model declined to judge)0.0020.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.092
GPT teacher head0.444
Teacher spread0.352 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it