English
Related papers

Related papers: Do we still need Human Annotators? Prompting Large…

200 papers

Variation in human annotation (i.e., disagreements) is common in NLP, often reflecting important information like task subjectivity and sample ambiguity. Modeling this variation is important for applications that are sensitive to such…

Computation and Language · Computer Science 2026-01-13 Jingwei Ni , Yu Fan , Vilém Zouhar , Donya Rooein , Alexander Hoyle , Mrinmaya Sachan , Markus Leippold , Dirk Hovy , Elliott Ash

Aspect-based sentiment analysis (ABSA) aims to identify four sentiment elements, including aspect term, aspect category, opinion term, and sentiment polarity. These elements construct a complete picture of sentiments. The most challenging…

Computation and Language · Computer Science 2026-02-09 Wenna Lai , Haoran Xie , Guandong Xu , Qing Li

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

Artificial Intelligence · Computer Science 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

Recent studies have used both automatic metrics and human evaluations to assess the simplification abilities of LLMs. However, the suitability of existing evaluation methodologies for LLMs remains in question. First, the suitability of…

Computation and Language · Computer Science 2025-07-15 Xuanxin Wu , Yuki Arase

Deep-learning pipelines for microscopy image classification often require expensive, labor- and time-intensive expert annotation to produce high-quality ground truth for training. Recent work has shown that prompt tuning of vision-language…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Abhiram Kandiyana , Ankur Mali , Lawrence O. Hall , Peter R. Mouton , Dmitry Goldgof

Cross-lingual aspect-based sentiment analysis (ABSA) involves detailed sentiment analysis in a target language by transferring knowledge from a source language with available annotated data. Most existing methods depend heavily on often…

Computation and Language · Computer Science 2025-08-14 Jakub Šmíd , Pavel Přibáň , Pavel Král

Financial sentiment analysis is crucial for trading and investment decision-making. This study introduces an adaptive retrieval augmented framework for Large Language Models (LLMs) that aligns with human instructions through Instruction…

Computational Engineering, Finance, and Science · Computer Science 2024-10-22 Zijie Zhao , Roy E. Welsch

Public Narratives (PNs) are key tools for leadership development and civic mobilization, yet their systematic analysis remains challenging due to their subjective interpretation and the high cost of expert annotation. In this work, we…

Computation and Language · Computer Science 2025-11-18 Elinor Poole-Dayan , Daniel T Kessler , Hannah Chiou , Margaret Hughes , Emily S Lin , Marshall Ganz , Deb Roy

Large language models (LLMs) are increasingly being used in a zero-shot fashion to assess mental health conditions, yet we have limited knowledge on what factors affect their accuracy. In this study, we utilize a clinical dataset of natural…

This paper explores a simple method for improving the zero-shot learning abilities of language models. We show that instruction tuning -- finetuning language models on a collection of tasks described via instructions -- substantially…

Computation and Language · Computer Science 2022-02-10 Jason Wei , Maarten Bosma , Vincent Y. Zhao , Kelvin Guu , Adams Wei Yu , Brian Lester , Nan Du , Andrew M. Dai , Quoc V. Le

Large language models (LLMs) have been proposed as scalable tools to address the gap between the importance of individualized written feedback and the practical challenges of providing it at scale. However, concerns persist regarding the…

Other Statistics · Statistics 2025-11-12 Niklas Ippisch , Markus Herklotz , Anna-Carolina Haensch , Carsten Schwemmer

Assessing learners in ill-defined domains, such as scenario-based human tutoring training, is an area of limited research. Equity training requires a nuanced understanding of context, but do contemporary large language models (LLMs) have a…

Human-Computer Interaction · Computer Science 2025-01-14 Sanjit Kakarla , Conrad Borchers , Danielle Thomas , Shambhavi Bhushan , Kenneth R. Koedinger

Aspect-based sentiment analysis (ABSA) has been extensively studied in recent years, which typically involves four fundamental sentiment elements, including the aspect category, aspect term, opinion term, and sentiment polarity. Existing…

Computation and Language · Computer Science 2021-10-05 Wenxuan Zhang , Yang Deng , Xin Li , Yifei Yuan , Lidong Bing , Wai Lam

Aspect-based sentiment analysis (ABSA) aims to predict fine-grained sentiments of comments with respect to given aspect terms or categories. In previous ABSA methods, the importance of aspect has been realized and verified. Most existing…

Computation and Language · Computer Science 2019-07-09 Bowen Xing , Lejian Liao , Dandan Song , Jingang Wang , Fuzheng Zhang , Zhongyuan Wang , Heyan Huang

Large Language Models (LLMs) are increasingly deployed in roles requiring nuanced psychological understanding, such as emotional support agents, counselors, and decision-making assistants. However, their ability to interpret human…

Computation and Language · Computer Science 2025-09-17 Jianfeng Zhu , Julina Maharjan , Xinyu Li , Karin G. Coifman , Ruoming Jin

We introduce a deep memory network for aspect level sentiment classification. Unlike feature-based SVM and sequential neural models such as LSTM, this approach explicitly captures the importance of each context word when inferring the…

Computation and Language · Computer Science 2016-09-27 Duyu Tang , Bing Qin , Ting Liu

This paper investigates the automation of qualitative data analysis, focusing on inductive coding using large language models (LLMs). Unlike traditional approaches that rely on deductive methods with predefined labels, this research…

Computation and Language · Computer Science 2025-12-02 Angelina Parfenova , Andreas Marfurt , Alexander Denzler , Juergen Pfeffer

LLM use in annotation is becoming widespread, and given LLMs' overall promising performance and speed, simply "reviewing" LLM annotations in interpretive tasks can be tempting. In subjective annotation tasks with multiple plausible answers,…

Computers and Society · Computer Science 2025-07-22 Hope Schroeder , Deb Roy , Jad Kabbara

Language models (LMs) trained on large amounts of data have shown impressive performance on many NLP tasks under the zero-shot and few-shot setup. Here we aim to better understand the extent to which such models learn commonsense knowledge…

Computation and Language · Computer Science 2022-11-02 Xiang Lorraine Li , Adhiguna Kuncoro , Jordan Hoffmann , Cyprien de Masson d'Autume , Phil Blunsom , Aida Nematzadeh

With the development of the Internet, natural language processing (NLP), in which sentiment analysis is an important task, became vital in information processing.Sentiment analysis includes aspect sentiment classification. Aspect sentiment…

Computation and Language · Computer Science 2018-07-06 Yongping Xing , Chuangbai Xiao , Yifei Wu , Ziming Ding