中文
相关论文

相关论文: Do we still need Human Annotators? Prompting Large…

200 篇论文

Variation in human annotation (i.e., disagreements) is common in NLP, often reflecting important information like task subjectivity and sample ambiguity. Modeling this variation is important for applications that are sensitive to such…

计算与语言 · 计算机科学 2026-01-13 Jingwei Ni , Yu Fan , Vilém Zouhar , Donya Rooein , Alexander Hoyle , Mrinmaya Sachan , Markus Leippold , Dirk Hovy , Elliott Ash

Aspect-based sentiment analysis (ABSA) aims to identify four sentiment elements, including aspect term, aspect category, opinion term, and sentiment polarity. These elements construct a complete picture of sentiments. The most challenging…

计算与语言 · 计算机科学 2026-02-09 Wenna Lai , Haoran Xie , Guandong Xu , Qing Li

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

人工智能 · 计算机科学 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

Recent studies have used both automatic metrics and human evaluations to assess the simplification abilities of LLMs. However, the suitability of existing evaluation methodologies for LLMs remains in question. First, the suitability of…

计算与语言 · 计算机科学 2025-07-15 Xuanxin Wu , Yuki Arase

Deep-learning pipelines for microscopy image classification often require expensive, labor- and time-intensive expert annotation to produce high-quality ground truth for training. Recent work has shown that prompt tuning of vision-language…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Abhiram Kandiyana , Ankur Mali , Lawrence O. Hall , Peter R. Mouton , Dmitry Goldgof

Cross-lingual aspect-based sentiment analysis (ABSA) involves detailed sentiment analysis in a target language by transferring knowledge from a source language with available annotated data. Most existing methods depend heavily on often…

计算与语言 · 计算机科学 2025-08-14 Jakub Šmíd , Pavel Přibáň , Pavel Král

Financial sentiment analysis is crucial for trading and investment decision-making. This study introduces an adaptive retrieval augmented framework for Large Language Models (LLMs) that aligns with human instructions through Instruction…

计算工程、金融与科学 · 计算机科学 2024-10-22 Zijie Zhao , Roy E. Welsch

Public Narratives (PNs) are key tools for leadership development and civic mobilization, yet their systematic analysis remains challenging due to their subjective interpretation and the high cost of expert annotation. In this work, we…

计算与语言 · 计算机科学 2025-11-18 Elinor Poole-Dayan , Daniel T Kessler , Hannah Chiou , Margaret Hughes , Emily S Lin , Marshall Ganz , Deb Roy

Large language models (LLMs) are increasingly being used in a zero-shot fashion to assess mental health conditions, yet we have limited knowledge on what factors affect their accuracy. In this study, we utilize a clinical dataset of natural…

This paper explores a simple method for improving the zero-shot learning abilities of language models. We show that instruction tuning -- finetuning language models on a collection of tasks described via instructions -- substantially…

计算与语言 · 计算机科学 2022-02-10 Jason Wei , Maarten Bosma , Vincent Y. Zhao , Kelvin Guu , Adams Wei Yu , Brian Lester , Nan Du , Andrew M. Dai , Quoc V. Le

Large language models (LLMs) have been proposed as scalable tools to address the gap between the importance of individualized written feedback and the practical challenges of providing it at scale. However, concerns persist regarding the…

其他统计学 · 统计学 2025-11-12 Niklas Ippisch , Markus Herklotz , Anna-Carolina Haensch , Carsten Schwemmer

Assessing learners in ill-defined domains, such as scenario-based human tutoring training, is an area of limited research. Equity training requires a nuanced understanding of context, but do contemporary large language models (LLMs) have a…

人机交互 · 计算机科学 2025-01-14 Sanjit Kakarla , Conrad Borchers , Danielle Thomas , Shambhavi Bhushan , Kenneth R. Koedinger

Aspect-based sentiment analysis (ABSA) has been extensively studied in recent years, which typically involves four fundamental sentiment elements, including the aspect category, aspect term, opinion term, and sentiment polarity. Existing…

计算与语言 · 计算机科学 2021-10-05 Wenxuan Zhang , Yang Deng , Xin Li , Yifei Yuan , Lidong Bing , Wai Lam

Aspect-based sentiment analysis (ABSA) aims to predict fine-grained sentiments of comments with respect to given aspect terms or categories. In previous ABSA methods, the importance of aspect has been realized and verified. Most existing…

计算与语言 · 计算机科学 2019-07-09 Bowen Xing , Lejian Liao , Dandan Song , Jingang Wang , Fuzheng Zhang , Zhongyuan Wang , Heyan Huang

Large Language Models (LLMs) are increasingly deployed in roles requiring nuanced psychological understanding, such as emotional support agents, counselors, and decision-making assistants. However, their ability to interpret human…

计算与语言 · 计算机科学 2025-09-17 Jianfeng Zhu , Julina Maharjan , Xinyu Li , Karin G. Coifman , Ruoming Jin

We introduce a deep memory network for aspect level sentiment classification. Unlike feature-based SVM and sequential neural models such as LSTM, this approach explicitly captures the importance of each context word when inferring the…

计算与语言 · 计算机科学 2016-09-27 Duyu Tang , Bing Qin , Ting Liu

This paper investigates the automation of qualitative data analysis, focusing on inductive coding using large language models (LLMs). Unlike traditional approaches that rely on deductive methods with predefined labels, this research…

计算与语言 · 计算机科学 2025-12-02 Angelina Parfenova , Andreas Marfurt , Alexander Denzler , Juergen Pfeffer

LLM use in annotation is becoming widespread, and given LLMs' overall promising performance and speed, simply "reviewing" LLM annotations in interpretive tasks can be tempting. In subjective annotation tasks with multiple plausible answers,…

计算机与社会 · 计算机科学 2025-07-22 Hope Schroeder , Deb Roy , Jad Kabbara

Language models (LMs) trained on large amounts of data have shown impressive performance on many NLP tasks under the zero-shot and few-shot setup. Here we aim to better understand the extent to which such models learn commonsense knowledge…

With the development of the Internet, natural language processing (NLP), in which sentiment analysis is an important task, became vital in information processing.Sentiment analysis includes aspect sentiment classification. Aspect sentiment…

计算与语言 · 计算机科学 2018-07-06 Yongping Xing , Chuangbai Xiao , Yifei Wu , Ziming Ding