MétaCan
Menu
Back to cohort
Record W2792248403 · doi:10.11575/prism/25515

Data Analytics for Optimized Matching in Software Development

2017· dissertation· en· W2792248403 on OpenAlexfundno aff
Muhammad Irfan Karim

Bibliographic record

VenuePRISM (University of Calgary) · 2017
Typedissertation
Languageen
FieldComputer Science
TopicSoftware Engineering Research
Canadian institutionsnot available
FundersNatural Sciences and Engineering Research Council of CanadaAlberta InnovatesAlberta Innovates - Technology Futures
KeywordsComputer scienceMatching (statistics)AnalyticsData scienceSoftware analyticsSoftwareSoftware engineeringSoftware developmentData miningSoftware development processStatisticsMathematicsProgramming language

Abstract

fetched live from OpenAlex

Decision-making in various forms of software development is challenging, as the environment and context where decisions are made is complex, uncertain and/or dynamic. Because of the associated complexity, decision making based on prior experience and gut feelings often lead to sub-optimal decisions. Among the various decision-making activities, stakeholders often need to match one entity (e.g. software artifact, human resource) with another (e.g. human resource, software artifact). Data analytics has the potential to generate insights, extract patterns and trends from data to guide the decision makers to make better and informed decisions under various complex decision scenarios involving matching. To prove the benefits of data analytics in matching, we have used five matching decision problems from open source, closed-source and crowdsourced software development context. First, with the use of predictive analytics, we have shown how the success and failure of crowd workers in a new task can be predicted by learning patterns from their and their competitors’ past behaviors. Based on the predicted success chance, we have also designed a task recommendation system to prescribe best suited tasks to crowd workers (task-worker matching). Second, by integrating crowd workers’ learning preference with predictive analytics, we have demonstrated how task recommendations can be generated from historical data taking workers personal learning and earning goals into account. The conducted user evaluation shows very positive feedback about the usefulness of the recommendations. Third, we have designed a theme (semantic cohesiveness) based approach for feature-release matching to prescribe features for the next release of iterative and incremental software development, considering multiple objectives, constraints and stakeholders preference data. Fourth, we have presented a multi-objective developer-bug matching technique that can prescribe developers for a batch of bugs balancing bug fix time and bug fix cost utilizing data mined from version control repository. Finally, using textual data extracted from issue tracking systems, we have proposed a collaborative filtering and bi-term topic modeling based recommendation system for tagging issues (tag-issue matching). The conducted quantitative and qualitative evaluation shows that data from various sources can be utilized for effective matching in various forms of software development.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame distilled prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. Learned from the 10,348 direct Codex labels and 10,348 direct Gemma labels. Candidate is the union of thresholded teacher heads; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels or direct frontier model labels.

metaresearch head score (Codex)0.000
metaresearch head score (Gemma)0.000
Version: codex-gemma-dda1882f352aValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Other design · Consensus signal: none
GenreCandidate signal: Methods · Consensus signal: Methods
Teacher disagreement score0.985
Threshold uncertainty score0.897

Codex and Gemma teacher scores by category

CategoryCodexGemma
Metaresearch0.0000.000
Meta-epidemiology (narrow)0.0000.000
Meta-epidemiology (broad)0.0000.000
Bibliometrics0.0000.000
Science and technology studies0.0000.000
Scholarly communication0.0000.001
Open science0.0040.001
Research integrity0.0000.000
Insufficient payload (model declined to judge)0.0000.000

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.040
GPT teacher head0.274
Teacher spread0.234 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one teacher head, not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designOther design
Domainnot available
GenreMethods

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations1
Published2017
Admission routes1
Has abstractyes

Explore more

Same venuePRISM (University of Calgary)Same topicSoftware Engineering ResearchFrench-language works237,207