MétaCan
Menu
Back to cohort

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts

2022· paratext· en· W4285160596 on OpenAlexaff

Bibliographic record

Venuenot available
Typeparatext
Languageen
FieldComputer Science
TopicNatural Language Processing Techniques
Canadian institutionsMcGill University
FundersNIH Office of the DirectorNational Science FoundationOffice of the Director of National IntelligenceAdvanced Research Projects AgencyDefense Advanced Research Projects AgencyIntelligence Advanced Research Projects Activity
KeywordsAssociation (psychology)Computational linguisticsComputer scienceCognitive scienceNatural language processingLinguisticsPsychologyPhilosophyEpistemology

Abstract

fetched live from OpenAlex

This year, as has been the tradition over the past few years, the call, submission, reviewing and selection of tutorials were coordinated jointly for multiple conferences: ACL, NAACL, COLING and EMNLP.We formed a review committee of 34 members, including the ACL tutorial chairs (Luciana Benotti (then), Naoaki Okazaki, and Marcos Zampieri), the NAACL tutorial chairs (Cecilia O. Alm, Yulia Tsetkov, and Miguel Ballesteros), the COLING tutorial chairs (Heng Ji, Hsin-Hsi Chen, and Lucia Donatelli), the EMNLP tutorial chairs (Samhaa R. El-Beltagy and Xipeng Qiu), and 23 external reviewers (see Program Committee for the full list).A reviewing process was organised so that each proposal received 3 reviews.The selection criteria included clarity and preparedness, novelty or timely character of the topic, instructors' experience, likely audience interest, open access of the tutorial instructional material, and diversity and inclusion.A total of 47 tutorial submissions were received, of which 8 were selected for presentation at ACL.We solicited two types of tutorials, namely cutting-edge themes and introductory themes.The 8 tutorials for ACL include 2 introductory tutorials and 6 cutting-edge tutorials.The introductory tutorials are dedicated to deep neural networks and reproducibility in NLP.The cutting-edge discussions address knowledge-augmented methods, non-autoregressive sequence generation, learning with limited data, zero-and few-shot learning with pretrained language models, vision-language pretraining, and multilingual task-oriented dialogue.We would like to thank the tutorial authors for their contributions and flexibility while organising the conference in the hybrid mode.We are also grateful to the 23 external reviewers for their generous help in the decision process.Our thanks go to the conference organizers for effective collaboration, and in particular to the general chair Bernardo Magnini, the publication chair Danilo Croce, the handbook chair Marco Polignano, and the authors of aclpub2.Finally, special thanks go to Luciana Benotti, who worked hard as a tutorial chair of ACL especially maintaining the reviewing process (including the administrative work with OpenReview) but later resigned from this position when she was elected to the NAACL executive board as the NAACL chair for 2022.We hope you enjoy the tutorials.

Fetched live from OpenAlex and de-inverted. Abstracts are not stored in this database: the inverted indexes are 8.6 GB of the frame’s 9.3 GB of text, and the host has 13 GB free.

How this classification was reachedexpand

Full frame machine prediction

Teacher imitation

Not calibrated prevalence, not ground truth. Human validation pending. The Gemma side is a direct model label for every work in the frame, read from the title-only record. The Codex side is a classifier learned from the 10,348 direct Codex labels and calibrated to design-weighted sample rates; fields without enough sample support carry no Codex call. Candidate is the union of the two sides; consensus is their intersection. These outputs are machine_predicted_unvalidated and are not human labels.

metaresearch head score (Codex)0.014
metaresearch head score (Gemma)0.021
Version: metacan-v3-hybrid-931329e0061cValidation status: machine_predicted_unvalidated
Candidate categoriesnone
Consensus categoriesnone
DomainCandidate signal: none · Consensus signal: none
Study designCandidate signal: Not applicable · Consensus signal: Not applicable
GenreCandidate signal: Other · Consensus signal: none
Teacher disagreement score0.162
Threshold uncertainty score0.544

Distilled classifier scores by category (both heads)

CategoryCodexGemma
Metaresearch0.0140.021
Meta-epidemiology (narrow)0.0020.001
Meta-epidemiology (broad)0.0030.001
Bibliometrics0.0050.003
Science and technology studies0.0020.002
Scholarly communication0.0070.008
Open science0.0030.004
Research integrity0.0030.004
Insufficient payload (model declined to judge)0.1620.136

Machine scores (provisional)

The two teacher heads of the student model, read on this work. A score orders the frame for review; it never asserts a category, and the validation status ships verbatim with every row.

Baseline scores from an immature model (maturity gate not passed, 7 training rounds). Scores rank; they never assert a category.

Opus teacher head0.009
GPT teacher head0.270
Teacher spread0.261 · how far apart the two teachers sit on this one work
Validation statusscore_only:v0-immature-baseline · verbatim from the scoring run: score_only means the number may rank works, and no category label ships from it

Classification

machine, unvalidated

Machine predicted; a candidate call from one source (direct Gemma or distilled Codex), not a consensus.

The models applied no category: nothing in the taxonomy fit this work.
Study designNot applicable
Domainnot available
GenreOther

How this classification was reached, model by model and score by score, is at the end of the page under "How this classification was reached".

Quick stats

Citations4
Published2022
Admission routes1
Has abstractyes

Explore more

Same topicNatural Language Processing TechniquesFrench-language works237,207