English
Related papers

Related papers: Towards transparency in NLP shared tasks

200 papers

Greenwashing refers to practices by corporations or governments that intentionally mislead the public about their environmental impact. This paper provides a comprehensive and methodologically grounded survey of natural language processing…

Computation and Language · Computer Science 2026-01-30 Tom Calamai , Oana Balalau , Théo Le Guenedal , Fabian M. Suchanek

State-of-the-art natural language processing (NLP) models are trained on massive training corpora, and report a superlative performance on evaluation datasets. This survey delves into an important attribute of these datasets: the dialect of…

Computation and Language · Computer Science 2024-12-10 Aditya Joshi , Raj Dabre , Diptesh Kanojia , Zhuang Li , Haolan Zhan , Gholamreza Haffari , Doris Dippold

In Natural Language Processing (NLP), one traditionally considers a single task (e.g. part-of-speech tagging) for a single language (e.g. English) at a time. However, recent work has shown that it can be beneficial to take advantage of…

Computation and Language · Computer Science 2018-09-10 Johannes Bjerva

This paper presents the results of the SHROOM, a shared task focused on detecting hallucinations: outputs from natural language generation (NLG) systems that are fluent, yet inaccurate. Such cases of overgeneration put in jeopardy many NLG…

While research has focused on surfacing and auditing algorithmic bias to ensure equitable AI development, less is known about how NLP practitioners - those directly involved in dataset development, annotation, and deployment - perceive and…

Computers and Society · Computer Science 2025-08-19 Jay L. Cunningham , Kevin Zhongyang Shao , Rock Yuren Pang , Nathaniel Mengist

As natural language processing (NLP) has recently seen an unprecedented level of excitement, and more people are eager to enter the field, it is unclear whether current research reproducibility efforts are sufficient for this group of…

Computation and Language · Computer Science 2023-06-06 Shane Storks , Keunwoo Peter Yu , Ziqiao Ma , Joyce Chai

Questions of fairness, robustness, and transparency are paramount to address before deploying NLP systems. Central to these concerns is the question of reliability: Can NLP systems reliably treat different demographics fairly and function…

Machine Learning · Computer Science 2021-06-02 Samson Tan , Shafiq Joty , Kathy Baxter , Araz Taeihagh , Gregory A. Bennett , Min-Yen Kan

Transliteration has emerged as a promising means to bridge the gap between various languages in multilingual NLP, showing promising results especially for languages using non-Latin scripts. We investigate the degree to which shared script,…

Computation and Language · Computer Science 2026-03-25 Haeji Jung , Jinju Kim , Kyungjin Kim , Youjeong Roh , David R. Mortensen

Natural language processing (NLP) systems have become a central technology in communication, education, medicine, artificial intelligence, and many other domains of research and development. While the performance of NLP methods has grown…

Computation and Language · Computer Science 2021-10-14 Damián Blasi , Antonios Anastasopoulos , Graham Neubig

Multi-task learning (MTL) has become increasingly popular in natural language processing (NLP) because it improves the performance of related tasks by exploiting their commonalities and differences. Nevertheless, it is still not understood…

Computation and Language · Computer Science 2023-02-16 Zhihan Zhang , Wenhao Yu , Mengxia Yu , Zhichun Guo , Meng Jiang

Natural Language Processing (NLP) aims to analyze text or speech via techniques in the computer science field. It serves applications in the domains of healthcare, commerce, education, and so on. Particularly, NLP has been widely applied to…

Computation and Language · Computer Science 2025-10-14 Yunshi Lan , Xinyuan Li , Hanyue Du , Xuesong Lu , Ming Gao , Weining Qian , Aoying Zhou

Peer review constitutes a core component of scholarly publishing; yet it demands substantial expertise and training, and is susceptible to errors and biases. Various applications of NLP for peer reviewing assistance aim to support reviewers…

Computation and Language · Computer Science 2023-05-22 Nils Dycke , Ilia Kuznetsov , Iryna Gurevych

Clinical NLP has an immense potential in contributing to how clinical practice will be revolutionized by the advent of large scale processing of clinical records. However, this potential has remained largely untapped due to slow progress…

Computation and Language · Computer Science 2017-03-30 Simon Šuster , Stéphan Tulkens , Walter Daelemans

Counterspeech, i.e. the practice of responding to online hate speech, has gained traction in NLP as a promising intervention. While early work emphasised collaboration with non-governmental organisation stakeholders, recent research trends…

Computation and Language · Computer Science 2025-08-07 Tanvi Dinkar , Aiqi Jiang , Simona Frenda , Poppy Gerrard-Abbott , Nancie Gunson , Gavin Abercrombie , Ioannis Konstas

The research project aims to apply an integrated approach to natural language processing NLP to satisfaction surveys. It will focus on understanding and extracting relevant information from survey responses, analyzing feelings, and…

Computation and Language · Computer Science 2023-08-03 Edson B. Pinto-Luque

This paper addresses challenges of Natural Language Processing (NLP) on non-canonical multilingual data in which two or more languages are mixed. It refers to code-switching which has become more popular in our daily life and therefore…

Computation and Language · Computer Science 2016-10-10 Özlem Çetinoğlu , Sarah Schulz , Ngoc Thang Vu

Attention-Aware Social Choice tackles the fundamental conflict faced by some agent communities between their desire to include all members in the decision making processes and the limited time and attention that are at the disposal of the…

Computers and Society · Computer Science 2023-09-25 Lior Ashkenazy , Nimrod Talmon

The burgeoning field of Natural Language Processing (NLP) stands at a critical juncture where the integration of fairness within its frameworks has become an imperative. This PhD thesis addresses the need for equity and transparency in NLP…

Computation and Language · Computer Science 2024-10-17 Fanny Jourdan

AI and NLP publication venues have increasingly encouraged researchers to reflect on possible ethical considerations, adverse impacts, and other responsible AI issues their work might engender. However, for specific NLP tasks our…

Computation and Language · Computer Science 2023-11-21 Yu Lu Liu , Meng Cao , Su Lin Blodgett , Jackie Chi Kit Cheung , Alexandra Olteanu , Adam Trischler

Natural-language-facilitated human-robot cooperation (NLC) refers to using natural language (NL) to facilitate interactive information sharing and task executions with a common goal constraint between robots and humans. Recently, NLC…

Robotics · Computer Science 2017-08-21 Rui Liu , Xiaoli Zhang