English
Related papers

Related papers: Intent-Aware Self-Correction for Mitigating Social…

200 papers

Large Reasoning Models (LRMs) exhibit backtracking and self-verification mechanisms that enable them to revise intermediate steps and reach correct solutions, yielding strong performance on complex logical benchmarks. We hypothesize that…

Machine Learning · Computer Science 2026-05-25 Hoang Phan , Quang H. Nguyen , Hung T. Q. Le , Xiusi Chen , Heng Ji , Khoa D. Doan

Existing studies on bias mitigation methods for large language models (LLMs) use diverse baselines and metrics to evaluate debiasing performance, leading to inconsistent comparisons among them. Moreover, their evaluations are mostly based…

Computation and Language · Computer Science 2026-02-17 Xin Xu , Xunzhi He , Churan Zhi , Ruizhe Chen , Julian McAuley , Zexue He

In this paper, we investigate the degree to which fine-tuning in Large Language Models (LLMs) effectively mitigates versus merely conceals undesirable behavior. Through the lens of semi-realistic role-playing exercises designed to elicit…

Computation and Language · Computer Science 2024-07-01 Florin Pop , Judd Rosenblatt , Diogo Schwerz de Lucena , Michael Vaiana

Self-training approach for large language models (LLMs) improves reasoning abilities by training the models on their self-generated rationales. Previous approaches have labeled rationales that produce correct answers for a given question as…

Machine Learning · Computer Science 2025-02-07 Jaehyeok Lee , Keisuke Sakaguchi , JinYeong Bak

Self-correction has demonstrated potential in code generation by allowing language models to revise and improve their outputs through successive refinement. Recent studies have explored prompting-based strategies that incorporate…

Computation and Language · Computer Science 2025-08-26 Jeonghun Cho , Deokhyung Kang , Hyounghun Kim , Gary Geunbae Lee

Large language models (LLMs) are increasingly utilized in various complex reasoning tasks due to their excellent instruction following capability. However, the model's performance is highly dependent on the open-ended characteristics of the…

Computation and Language · Computer Science 2026-04-28 Zhenzhen Huang , Chaoning Zhang , Fachrina Dewi Puspitasari , Jiaquan Zhang , Yitian Zhou , Shuxu Chen , Yang Yang

Large language models (LLMs) have achieved impressive performance on various natural language generation tasks. Nonetheless, they suffer from generating negative and harmful contents that are biased against certain demographic groups (e.g.,…

Machine Learning · Computer Science 2024-06-05 Tianci Liu , Haoyu Wang , Shiyang Wang , Yu Cheng , Jing Gao

Large language models (LLMs) can exhibit advanced reasoning yet still generate incorrect answers. We hypothesize that such errors frequently stem from spurious beliefs, propositions the model internally considers true but are incorrect. To…

Computation and Language · Computer Science 2025-06-18 Ayana Niwa , Masahiro Kaneko , Kentaro Inui

Recent advances in speech large language models (speech LLMs) have enabled seamless spoken interactions, but these systems still struggle with complex reasoning tasks. Previously, chain-of-thought (CoT) prompting or fine-tuning has been to…

Computation and Language · Computer Science 2025-10-10 Yi-Jen Shih , Desh Raj , Chunyang Wu , Wei Zhou , SK Bong , Yashesh Gaur , Jay Mahadeokar , Ozlem Kalinli , Mike Seltzer

Large Language Models (LLMs) are intended to reflect human linguistic competencies. But humans have access to a broad and embodied context, which is key in detecting and resolving linguistic ambiguities, even in isolated text spans. A…

Computation and Language · Computer Science 2025-10-22 Amber Shore , Russell Scheinberg , Ameeta Agrawal , So Young Lee

Empathetic response generation endows agents with the capability to comprehend dialogue contexts and react to expressed emotions. Previous works predominantly focus on leveraging the speaker's emotional labels, but ignore the importance of…

Computation and Language · Computer Science 2024-08-22 Xinhao Chen , Chong Yang , Man Lan , Li Cai , Yang Chen , Tu Hu , Xinlin Zhuang , Aimin Zhou

Large Language Models (LLMs) inherit societal biases from their training data, potentially leading to harmful or unfair outputs. While various techniques aim to mitigate these biases, their effects are often evaluated only along the…

Computation and Language · Computer Science 2025-11-25 Shireen Chand , Faith Baca , Emilio Ferrara

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

Computation and Language · Computer Science 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu

Large Language Models (LLMs) have acquired ubiquitous attention for their performances across diverse domains. Our study here searches through LLMs' cognitive abilities and confidence dynamics. We dive deep into understanding the alignment…

Computation and Language · Computer Science 2023-09-29 Aniket Kumar Singh , Suman Devkota , Bishal Lamichhane , Uttam Dhakal , Chandra Dhakal

The ability of Large Language Models (LLMs) to extract context from natural language problem descriptions naturally raises questions about their suitability in autonomous decision-making settings. This paper studies the behaviour of these…

Artificial Intelligence · Computer Science 2025-07-22 Xiao Yang , Juxi Leitner , Michael Burke

Cheap-to-Build Very Large-Language Models (CtB-LLMs) with affordable training are emerging as the next big revolution in natural language processing and understanding. These CtB-LLMs are democratizing access to trainable Very Large-Language…

Computation and Language · Computer Science 2024-11-12 Leonardo Ranaldi , Elena Sofia Ruzzetti , Davide Venditti , Dario Onorati , Fabio Massimo Zanzotto

A central piece in enabling intelligent agentic behavior in foundation models is to make them capable of introspecting upon their behavior, reasoning, and correcting their mistakes as more computation or interaction is available. Even the…

Machine Learning · Computer Science 2024-07-29 Yuxiao Qu , Tianjun Zhang , Naman Garg , Aviral Kumar

As large language models (LLMs) become more integrated into societal systems, the risk of them perpetuating and amplifying harmful biases becomes a critical safety concern. Traditional methods for mitigating bias often rely on data…

Artificial Intelligence · Computer Science 2025-08-13 Shivam Dubey

Chain-of-thought prompting (CoT) has the potential to improve the explainability of language model reasoning. But CoT can also systematically misrepresent the factors influencing models' behavior -- for example, rationalizing answers in…

Computation and Language · Computer Science 2025-06-30 James Chua , Edward Rees , Hunar Batra , Samuel R. Bowman , Julian Michael , Ethan Perez , Miles Turpin

The rapid advancement of large language models (LLMs) and their growing integration into daily life underscore the importance of evaluating and ensuring their fairness. In this work, we examine fairness within the domain of emotional theory…

Computation and Language · Computer Science 2026-03-03 Maureen Herbert , Katie Sun , Angelica Lim , Yasaman Etesam