English
Related papers

Related papers: From Prediction to Justification: Aligning Sentime…

200 papers

The correct specification of reward models is a well-known challenge in reinforcement learning. Hand-crafted reward functions often lead to inefficient or suboptimal policies and may not be aligned with user values. Reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-24 Muhan Lin , Shuyang Shi , Yue Guo , Behdad Chalaki , Vaishnav Tadiparthi , Ehsan Moradi Pari , Simon Stepputtis , Joseph Campbell , Katia Sycara

We define a novel neuro-symbolic framework, argumentative reward learning, which combines preference-based argumentation with existing approaches to reinforcement learning from human feedback. Our method improves prior work by generalising…

Artificial Intelligence · Computer Science 2022-10-05 Francis Rhys Ward , Francesco Belardinelli , Francesca Toni

Reward models play a critical role in guiding large language models toward outputs that align with human expectations. However, an open challenge remains in effectively utilizing test-time compute to enhance reward model performance. In…

Computation and Language · Computer Science 2025-05-21 Jiaxin Guo , Zewen Chi , Li Dong , Qingxiu Dong , Xun Wu , Shaohan Huang , Furu Wei

Aspect-based sentiment analysis (ABSA) aims to associate a text with a set of aspects and infer their respective sentimental polarities. State-of-the-art approaches are built on fine-tuning pre-trained language models, focusing on learning…

Computation and Language · Computer Science 2024-08-26 Murtadha Ahmed , Bo Wen , Shengfeng Pan , Jianlin Su , Luo Ao , Yunfeng Liu

Semi-structured explanation depicts the implicit process of a reasoner with an explicit representation. This explanation highlights how available information in a specific query is utilised and supplemented with information a reasoner…

Computation and Language · Computer Science 2024-01-25 Jiuzhou Han , Wray Buntine , Ehsan Shareghi

Reinforcement learning (RL) for large language models (LLMs) increasingly relies on sparse, outcome-level rewards -- yet determining which actions within a long trajectory caused the outcome remains difficult. This credit assignment (CA)…

Computation and Language · Computer Science 2026-04-14 Chenchen Zhang

Reinforcement learning (RL), a common tool in decision making, learns control policies from various experiences based on the associated cumulative return/rewards without treating them differently. Humans, on the contrary, often learn to…

Machine Learning · Computer Science 2025-11-25 Mingkang Wu , Devin White , Vernon Lawhern , Nicholas R. Waytowich , Yongcan Cao

Reinforcement learning (RL) has become a promising paradigm for optimizing Retrieval-Augmented Generation (RAG) in complex reasoning tasks. However, traditional outcome-based RL approaches often suffer from reward sparsity and inefficient…

Artificial Intelligence · Computer Science 2026-01-30 Zhao Wang , Ziliang Zhao , Zhicheng Dou

Aspect-based sentiment analysis (ABSA) predicts sentiment polarity towards a specific aspect in the given sentence. While pre-trained language models such as BERT have achieved great success, incorporating dynamic semantic changes into ABSA…

Computation and Language · Computer Science 2022-11-24 Kai Zhang , Kun Zhang , Mengdi Zhang , Hongke Zhao , Qi Liu , Wei Wu , Enhong Chen

Predictive modeling on tabular data is the cornerstone of many real-world applications. Although gradient boosting machines and some recent deep models achieve strong performance on tabular data, they often lack interpretability. On the…

Machine Learning · Computer Science 2025-07-01 Tommy Xu , Zhitian Zhang , Xiangyu Sun , Lauren Kelly Zung , Hossein Hajimirsadeghi , Greg Mori

Reinforcement learning with verifiable rewards (RLVR) has shown promise in enhancing the reasoning capabilities of large language models by learning directly from outcome-based rewards. Recent RLVR works that operate under the zero setting…

Machine Learning · Computer Science 2025-10-17 Andrew Zhao , Yiran Wu , Yang Yue , Tong Wu , Quentin Xu , Yang Yue , Matthieu Lin , Shenzhi Wang , Qingyun Wu , Zilong Zheng , Gao Huang

Aspect-Based Sentiment Analysis (ABSA) predicts sentiment polarity for specific aspect terms, a task made difficult by conflicting sentiments across aspects and the sparse context of short texts. Prior graph-based approaches model only…

Computation and Language · Computer Science 2025-11-19 Omkar Mahesh Kashyap , Padegal Amit , Madhav Kashyap , Ashwini M Joshi , Shylaja SS

A hallmark of human language is the ability to effectively and efficiently convey contextually relevant information. One theory for how humans reason about language is presented in the Rational Speech Acts (RSA) framework, which captures…

Computation and Language · Computer Science 2020-06-02 Julia White , Jesse Mu , Noah D. Goodman

Aspect-based sentiment analysis aims to identify the sentiment polarity of a specific aspect in product reviews. We notice that about 30% of reviews do not contain obvious opinion words, but still convey clear human-aware sentiment…

Computation and Language · Computer Science 2021-11-04 Zhengyan Li , Yicheng Zou , Chong Zhang , Qi Zhang , Zhongyu Wei

With the rapid development of the internet, the richness of User-Generated Contentcontinues to increase, making Multimodal Aspect-Based Sentiment Analysis (MABSA) a research hotspot. Existing studies have achieved certain results in MABSA,…

Artificial Intelligence · Computer Science 2024-10-21 Xiaoyong Huang , Heli Sun , Qunshu Gao , Wenjie Huang , Ruichen Cao

Aspect-based sentiment analysis (ABSA), a sequence labeling task, has attracted increasing attention in multilingual contexts. While previous research has focused largely on fine-tuning or training models specifically for ABSA, we evaluate…

Computation and Language · Computer Science 2025-06-25 Chengyan Wu , Bolei Ma , Zheyu Zhang , Ningyuan Deng , Yanqing He , Yun Xue

Targeted sentiment analysis (TSA), also known as aspect based sentiment analysis (ABSA), aims at detecting fine-grained sentiment polarity towards targets in a given opinion document. Due to the lack of labeled datasets and effective…

Computation and Language · Computer Science 2019-05-10 Jiaxin Pei , Aixin Sun , Chenliang Li

Aspect-based sentiment analysis (ABSA) generally requires a deep understanding of the contextual information, including the words associated with the aspect terms and their syntactic dependencies. Most existing studies employ advanced…

Computation and Language · Computer Science 2025-06-17 Yuanhe Tian , Xu Li , Wei Wang , Guoqing Jin , Pengsen Cheng , Yan Song

Aspect-based sentiment analysis (ABSA), a popular research area in NLP has two distinct parts -- aspect extraction (AE) and labeling the aspects with sentiment polarity (ALSA). Although distinct, these two tasks are highly correlated. The…

Computation and Language · Computer Science 2020-05-15 Navonil Majumder , Rishabh Bhardwaj , Soujanya Poria , Amir Zadeh , Alexander Gelbukh , Amir Hussain , Louis-Philippe Morency

Reinforcement Learning (RL) has enabled Large Language Models (LLMs) to achieve remarkable reasoning in domains like mathematics and coding, where verifiable rewards provide clear signals. However, extending this paradigm to financial…

Artificial Intelligence · Computer Science 2026-01-09 Rui Sun , Yifan Sun , Sheng Xu , Li Zhao , Jing Li , Daxin Jiang , Cheng Hua , Zuo Bai