English
Related papers

Related papers: Perturbation Sensitivity Analysis to Detect Uninte…

200 papers

Large Language Models (LLMs) have recently displayed their extraordinary capabilities in language understanding. However, how to comprehensively assess the sentiment capabilities of LLMs continues to be a challenge. This paper investigates…

Computation and Language · Computer Science 2025-02-17 Yang Liu , Xichou Zhu , Zhou Shen , Yi Liu , Min Li , Yujun Chen , Benzi John , Zhenzhen Ma , Tao Hu , Zhi Li , Zhiyang Xu , Wei Luo , Junhui Wang

The dominating NLP paradigm of training a strong neural predictor to perform one task on a specific dataset has led to state-of-the-art performance in a variety of applications (eg. sentiment classification, span-prediction based question…

Computation and Language · Computer Science 2021-09-06 Paul Michel

A standard paradigm for sentiment analysis is to rely on a singular LLM and makes the decision in a single round under the framework of in-context learning. This framework suffers the key disadvantage that the single-turn output generated…

Computation and Language · Computer Science 2023-11-06 Xiaofei Sun , Xiaoya Li , Shengyu Zhang , Shuhe Wang , Fei Wu , Jiwei Li , Tianwei Zhang , Guoyin Wang

Rigorous evaluation of the causal effects of semantic features on language model predictions can be hard to achieve for natural language reasoning problems. However, this is such a desirable form of analysis from both an interpretability…

Computation and Language · Computer Science 2024-04-04 Julia Rozanova , Marco Valentino , Andre Freitas

The most prominent tasks in emotion analysis are to assign emotions to texts and to understand how emotions manifest in language. An observation for NLP is that emotions can be communicated implicitly by referring to events, appealing to an…

Computation and Language · Computer Science 2022-10-10 Enrica Troiano , Laura Oberländer , Roman Klinger

Sentiment analysis is a branch of Natural Language Processing (NLP) which goal is to assign sentiments or emotions to particular sentences or words. Performing this task is particularly useful for companies wishing to take into account…

Computation and Language · Computer Science 2022-09-08 Victor Martinez , Guilhaume Leroy-Meline

High-performance neural language models have obtained state-of-the-art results on a wide range of Natural Language Processing (NLP) tasks. However, results for common benchmark datasets often do not reflect model reliability and robustness…

Computation and Language · Computer Science 2021-08-30 Milad Moradi , Matthias Samwald

Many models in natural language processing define probabilistic distributions over linguistic structures. We argue that (1) the quality of a model' s posterior distribution can and should be directly evaluated, as to whether probabilities…

Computation and Language · Computer Science 2015-09-03 Khanh Nguyen , Brendan O'Connor

A wide range of NLP tasks benefit from the fine-tuning of pretrained language models (PLMs). However, a number of redundant parameters which contribute less to the downstream task are observed in a directly fine-tuned model. We consider the…

Computation and Language · Computer Science 2022-10-26 Yupeng Zhang , Hongzhi Zhang , Sirui Wang , Wei Wu , Zhoujun Li

NLP datasets are richer than just input-output pairs; rather, they carry causal relations between the input and output variables. In this work, we take sentiment classification as an example and look into the causal relations between the…

Computation and Language · Computer Science 2023-05-04 Zhiheng Lyu , Zhijing Jin , Justus Mattern , Rada Mihalcea , Mrinmaya Sachan , Bernhard Schoelkopf

Post-Traumatic Stress Disorder (PTSD) remains underdiagnosed in clinical settings, presenting opportunities for automated detection to identify patients. This study evaluates natural language processing approaches for detecting PTSD from…

Computation and Language · Computer Science 2026-01-08 Feng Chen , Dror Ben-Zeev , Gillian Sparks , Arya Kadakia , Trevor Cohen

We consider the distinction between intended and perceived sarcasm in the context of textual sarcasm detection. The former occurs when an utterance is sarcastic from the perspective of its author, while the latter occurs when the utterance…

Computation and Language · Computer Science 2020-05-05 Silviu Oprea , Walid Magdy

Pre-training by language modeling has become a popular and successful approach to NLP tasks, but we have yet to understand exactly what linguistic capacities these pre-training processes confer upon models. In this paper we introduce a…

Computation and Language · Computer Science 2020-07-14 Allyson Ettinger

Interpretability remains a key difficulty in sentiment analysis with Large Language Models (LLMs), particularly in high-stakes applications where it is crucial to comprehend the rationale behind forecasts. This research addressed this by…

Computation and Language · Computer Science 2025-03-18 Thivya Thogesan , Anupiya Nugaliyadde , Kok Wai Wong

One way to interpret neural model predictions is to highlight the most important input features---for example, a heatmap visualization over the words in an input sentence. In existing interpretation methods for NLP, a word's importance is…

Computation and Language · Computer Science 2022-09-07 Shi Feng , Eric Wallace , Alvin Grissom , Mohit Iyyer , Pedro Rodriguez , Jordan Boyd-Graber

Understanding how individuals with Parkinson's disease (PD) describe cognitive experiences in their daily lives can offer valuable insights into disease-related cognitive and emotional changes. However, extracting such information from…

Computation and Language · Computer Science 2025-11-13 Varada Khanna , Nilay Bhatt , Ikgyu Shin , Sule Tinaz , Yang Ren , Hua Xu , Vipina K. Keloth

With the advent of deep learning methods, Neural Machine Translation (NMT) systems have become increasingly powerful. However, deep learning based systems are susceptible to adversarial attacks, where imperceptible changes to the input can…

Computation and Language · Computer Science 2023-06-27 Vyas Raina , Mark Gales

Language models trained on large-scale unfiltered datasets curated from the open web acquire systemic biases, prejudices, and harmful views from their training data. We present a methodology for programmatically identifying and removing…

Computation and Language · Computer Science 2021-11-30 Helen Ngo , Cooper Raterink , João G. M. Araújo , Ivan Zhang , Carol Chen , Adrien Morisot , Nicholas Frosst

Large language models (LLMs) achieve strong performance across many natural language processing tasks, yet their decision processes remain difficult to interpret. This lack of transparency creates challenges for trust, debugging, and…

Computation and Language · Computer Science 2026-04-20 Venkata Abhinandan Kancharla

Recently natural language processing (NLP) tools have been developed to identify and extract salient risk indicators in electronic health records (EHRs). Sentiment analysis, although widely used in non-medical areas for improving decision…

Computation and Language · Computer Science 2019-04-09 Eben Holderness , Philip Cawkwell , Kirsten Bolton , James Pustejovsky , Mei-Hua Hall