MétaCan
Menu
Back to cohort
Record W4403646761 · doi:10.1145/3691621.3694942

A First Look at Self-Admitted Miscommunications in GitHub Issues

2024· article· en· W4403646761 on OpenAlexaff
Kazi Amit Hasan, Vu Thanh Loc, C Wang, Yuan Tian, Steven H. H. Ding

Bibliographic record

Venuenot available
Typearticle
Languageen
FieldComputer Science
TopicDistributed systems and fault tolerance
Canadian institutionsMcGill UniversityQueen's University
Fundersnot available
KeywordsComputer science

Abstract

fetched live from OpenAlex

Effective communication is crucial for the success of open-source software development, particularly within distributed and asynchronous working environments on collaborative coding supporting platforms like GitHub. However, these environments often present significant communication challenges due to various factors, leading to project delays and wasted efforts. Despite prior research on collaboration challenges in software teams, there is a notable gap in understanding what, when, and where miscommunications occur in open-source projects. To address this gap, we mined 6,444 GitHub issues where developers explicitly admitted to miscommunication (using keywords such as "miscommunication") and manually analyzed the types, timing, and root causes of these self-admitted instances on a statistically significant sample set (363). Our findings are: (1) we developed a taxonomy of 12 issue types where miscommunications frequently occur, with bug reporting and feature requests being the most common; (2) we identified that most miscommunications occur before issue closure, but post-closure miscommunications, though less frequent, pose significant challenges; and (3) we uncovered five primary root causes of miscommunication, with technical misunderstandings being the most prevalent. This study provides the first comprehensive examination of miscommunication in open-source software development, offering insights and recommendations for researchers and practitioners to improve communication practices in GitHub issue discussions.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.011
metaresearch head score (Gemma)0.110
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Observational · Consensus signal: Observational
GenreCandidate signal: Empirical · Consensus signal: Empirical
Teacher disagreement score0.015
Threshold uncertainty score0.057

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0110.110
Meta-epidemiology (narrow)0.0010.001
Meta-epidemiology (broad)0.0010.001
Bibliometrics0.0150.010
Science and technology studies0.0040.003
Scholarly communication0.0050.008
Open science0.0010.006
Research integrity0.0020.002
Insufficient payload (model declined to judge)0.0020.001

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.014
GPT teacher head0.267
Teacher spread0.254 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designObservational
Domainnot available
GenreEmpirical

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations0
Published2024
Admission routes1
Has abstractyes

Explore more

Same topicDistributed systems and fault toleranceFrench-language works237,207