English
Related papers

Related papers: Evaluating the Robustness of Neural Language Model…

200 papers

Contrastive learning has proven to be an effective method for pre-training models using weakly labeled data in the vision domain. Sentence transformers are the NLP counterparts to this architecture, and have been growing in popularity due…

Computation and Language · Computer Science 2023-11-30 Tanmay Chavan , Shantanu Patankar , Aditya Kane , Omkar Gokhale , Geetanjali Kale , Raviraj Joshi

Large Language Models (LLMs) are increasingly used as proxies for human subjects in social science surveys, but their reliability and susceptibility to known human-like response biases, such as central tendency, opinion floating and primacy…

Computation and Language · Computer Science 2025-10-17 Jens Rupprecht , Georg Ahnert , Markus Strohmaier

Models that adapt their predictions based on some given contexts, also known as in-context learning, have become ubiquitous in recent years. We propose to study the behavior of such models when data is contaminated by noise. Towards this…

Machine Learning · Computer Science 2024-11-05 Chen Shapira , Dan Rosenbaum

Neural machine translation systems typically are trained on curated corpora and break when faced with non-standard orthography or punctuation. Resilience to spelling mistakes and typos, however, is crucial as machine translation systems are…

Computation and Language · Computer Science 2020-09-15 Toms Bergmanis , Artūrs Stafanovičs , Mārcis Pinnis

Existing evaluation methods largely rely on clean, static benchmarks, which can overestimate true model performance by failing to capture the noise and variability inherent in real-world user inputs. This is especially true for language…

The Arabic language is a morphologically rich language with relatively few resources and a less explored syntax compared to English. Given these limitations, Arabic Natural Language Processing (NLP) tasks like Sentiment Analysis (SA), Named…

Computation and Language · Computer Science 2021-03-09 Wissam Antoun , Fady Baly , Hazem Hajj

Large language models (LLMs) have demonstrated impressive performance on a number of natural language processing tasks, such as question answering and text summarization. However, their performance on sequence labeling tasks such as intent…

Computation and Language · Computer Science 2024-02-27 Yao Qiang , Subhrangshu Nandi , Ninareh Mehrabi , Greg Ver Steeg , Anoop Kumar , Anna Rumshisky , Aram Galstyan

Deep Contextual Language Models (LMs) like ELMO, BERT, and their successors dominate the landscape of Natural Language Processing due to their ability to scale across multiple tasks rapidly by pre-training a single model, followed by…

Computation and Language · Computer Science 2021-12-21 Shaily Bhatt , Poonam Goyal , Sandipan Dandapat , Monojit Choudhury , Sunayana Sitaram

Despite the remarkable success of pre-trained language models (PLMs), they still face two challenges: First, large-scale PLMs are inefficient in terms of memory footprint and computation. Second, on the downstream tasks, PLMs tend to rely…

Computation and Language · Computer Science 2022-10-12 Yuanxin Liu , Fandong Meng , Zheng Lin , Jiangnan Li , Peng Fu , Yanan Cao , Weiping Wang , Jie Zhou

Large Language Models (LLMs) have emerged as a promising cornerstone for the development of natural language processing (NLP) and artificial intelligence (AI). However, ensuring the robustness of LLMs remains a critical challenge. To…

Computation and Language · Computer Science 2025-11-07 Pankaj Kumar , Subhankar Mishra

The performance of Large Language Models (LLMs) degrades from the temporal drift between data used for model training and newer text seen during inference. One understudied avenue of language change causing data drift is the emergence of…

Computation and Language · Computer Science 2024-08-14 Jonathan Zheng , Alan Ritter , Wei Xu

Multilingual Language Models (MLLMs) exhibit robust cross-lingual transfer capabilities, or the ability to leverage information acquired in a source language and apply it to a target language. These capabilities find practical applications…

Computation and Language · Computer Science 2024-04-01 Shadi Manafi , Nikhil Krishnaswamy

As machine learning models become increasingly prevalent in critical decision-making models and systems in fields like finance, healthcare, etc., ensuring their robustness against adversarial attacks and changes in the input data is…

Machine Learning · Statistics 2024-08-05 Arun Prakash R , Anwesha Bhattacharyya , Joel Vaughan , Vijayan N. Nair

Pre-trained LMs have shown impressive performance on downstream NLP tasks, but we have yet to establish a clear understanding of their sophistication when it comes to processing, retaining, and applying information presented in their input.…

Computation and Language · Computer Science 2021-09-28 Lalchand Pandia , Allyson Ettinger

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

Transfer learning from pre-trained neural language models towards downstream tasks has been a predominant theme in NLP recently. Several researchers have shown that deep NLP models learn non-trivial amount of linguistic knowledge, captured…

Computation and Language · Computer Science 2021-06-01 Nadir Durrani , Hassan Sajjad , Fahim Dalvi

Pre-trained language models (PLMs) have consistently demonstrated outstanding performance across a diverse spectrum of natural language processing tasks. Nevertheless, despite their success with unseen data, current PLM-based…

Computation and Language · Computer Science 2024-03-19 Javad Rafiei Asl , Prajwal Panzade , Eduardo Blanco , Daniel Takabi , Zhipeng Cai

Fine-tuning a pre-trained model (such as BERT, ALBERT, RoBERTa, T5, GPT, etc.) has proven to be one of the most promising paradigms in recent NLP research. However, numerous recent works indicate that fine-tuning suffers from the…

Machine Learning · Computer Science 2023-12-08 Zihao Fu , Anthony Man-Cho So , Nigel Collier

Pre-trained language models have been dominating the field of natural language processing in recent years, and have led to significant performance gains for various complex natural language tasks. One of the most prominent pre-trained…

Computation and Language · Computer Science 2020-09-17 Pieter Delobelle , Thomas Winters , Bettina Berendt

Referring perception, which aims at grounding visual objects with multimodal referring guidance, is essential for bridging the gap between humans, who provide instructions, and the environment where intelligent systems perceive. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Xiang Li , Kai Qiu , Jinglu Wang , Xiaohao Xu , Rita Singh , Kashu Yamazak , Hao Chen , Xiaonan Huang , Bhiksha Raj