Voices of Her: Analyzing Gender Differences in the AI Publication World
Bibliographic record
Abstract
While several previous studies have analyzed gender bias in research, we are still missing a comprehensive analysis of gender differences in the AI community, covering diverse topics and different development trends.Using the AI SCHOLAR dataset of 78K researchers in the field of AI, we identify several gender differences: (1) Although female researchers tend to have fewer overall citations than males, this citation difference does not hold for all academic-age groups; (2) There exist large gender homophily in co-authorship on AI papers;(3) Female first-authored papers show distinct linguistic styles, such as longer text, more positive emotion words, and more catchy titles than male first-authored papers.Our analysis provides a window into the current demographic trends in our AI community, and encourages more gender equality and diversity in the future. 1 2 Data Collection and Cleaning AI SCHOLAR.We use all the scholar information from the most recent collection of researchers in the field of AI, i.e., the AI SCHOLAR dataset (Jin et al., 2022), 3 which contains all the scholars in the field of AI with at least 100 citations according to Google Scholar.The data consists of 78K scholars with tags related to AI such as artificial intelligence (AI) and machine learning (ML), or subdomains of AI such as computer vision (CV) and natural language processing (NLP).It only includes scholars with at least 100 citations, an approximate cut-off for the long-tail since it is not feasible to include all scholar profiles.We discuss the limitations of using this dataset in Section 7. Throughout the paper, we use the term "AI researchers" to denote the set of scholars in the AI SCHOLAR dataset.For each AI researcher, the AI SCHOLAR dataset collects information such as the name, affiliation, up to five domain tags, total citations, citations by year, and all their papers with title, year, and the number of citations.Since the total number of papers is massive (2.8M papers for the 78K AI researchers), we use the random subset of papers provided by Jin et al. (2022).They collect 100K papers with detailed information such as abstracts and full names of all the coauthors.Among the 100K papers with detailed information, we further filter out papers with
Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.
How this classification was reachedexpand
Full frame machine prediction
Teacher imitationNot calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.
Distilled classifier scores by category (both heads)
| Category | Codex | Gemma |
|---|---|---|
| Metaresearch | 0.005 | 0.040 |
| Meta-epidemiology (narrow) | 0.000 | 0.000 |
| Meta-epidemiology (broad) | 0.000 | 0.000 |
| Bibliometrics | 0.006 | 0.008 |
| Science and technology studies | 0.001 | 0.001 |
| Scholarly communication | 0.004 | 0.005 |
| Open science | 0.001 | 0.002 |
| Research integrity | 0.001 | 0.000 |
| Insufficient payload (model declined to judge) | 0.008 | 0.003 |
Machine scores (provisional)
The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.
Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.
score_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from itClassification
machine, unvalidatedMachine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.
How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".