English
Related papers

Related papers: Self-correction is Not An Innate Capability in Lan…

200 papers

Large Language Models (LLMs) have recently displayed their extraordinary capabilities in language understanding. However, how to comprehensively assess the sentiment capabilities of LLMs continues to be a challenge. This paper investigates…

Computation and Language · Computer Science 2025-02-17 Yang Liu , Xichou Zhu , Zhou Shen , Yi Liu , Min Li , Yujun Chen , Benzi John , Zhenzhen Ma , Tao Hu , Zhi Li , Zhiyang Xu , Wei Luo , Junhui Wang

Large Language Models (LLMs) have achieved excellent performances in various tasks. However, fine-tuning an LLM requires extensive supervision. Human, on the other hand, may improve their reasoning abilities by self-thinking without…

Computation and Language · Computer Science 2022-10-26 Jiaxin Huang , Shixiang Shane Gu , Le Hou , Yuexin Wu , Xuezhi Wang , Hongkun Yu , Jiawei Han

Self-reflection -- the ability of a large language model (LLM) to revisit, evaluate, and revise its own reasoning -- has recently emerged as a powerful behavior enabled by reinforcement learning with verifiable rewards (RLVR). While…

Machine Learning · Computer Science 2025-06-17 Xudong Zhu , Jiachen Jiang , Mohammad Mahdi Khalili , Zhihui Zhu

Large Language Models (LLMs) have become powerful tools for automated code generation. However, these models often overlook critical security practices, which can result in the generation of insecure code that contains…

Software Engineering · Computer Science 2025-07-01 Hao Yan , Swapneel Suhas Vaidya , Xiaokuan Zhang , Ziyu Yao

Are Large language models (LLMs) temporally grounded? Since LLMs cannot perceive and interact with the environment, it is impossible to answer this question directly. Instead, we provide LLMs with textual narratives and probe them with…

Computation and Language · Computer Science 2023-11-17 Yifu Qiu , Zheng Zhao , Yftah Ziser , Anna Korhonen , Edoardo M. Ponti , Shay B. Cohen

Large language models (LLMs) such as ChatGPT have demonstrated superior performance on a variety of natural language processing (NLP) tasks including sentiment analysis, mathematical reasoning and summarization. Furthermore, since these…

Computation and Language · Computer Science 2023-10-18 Shiyuan Huang , Siddarth Mamidanna , Shreedhar Jangam , Yilun Zhou , Leilani H. Gilpin

The ability of critique is vital for models to self-improve and serve as reliable AI assistants. While extensively studied in language-only settings, multimodal critique of Large Multimodal Models (LMMs) remains underexplored despite their…

Computation and Language · Computer Science 2025-11-13 Gailun Zeng , Ziyang Luo , Hongzhan Lin , Yuchen Tian , Kaixin Li , Ziyang Gong , Jianxiong Guo , Jing Ma

Recent advancements in self-improvement for Large Language Models (LLMs) have efficiently enhanced model capabilities without significantly increasing costs, particularly in terms of human effort. While this area is still relatively young,…

Computation and Language · Computer Science 2025-10-06 Shijian Deng , Kai Wang , Tianyu Yang , Harsh Singh , Yapeng Tian

Deploying large language models (LLMs) with agency in real-world applications raises critical questions about how these models will behave. In particular, how will their decisions align with humans when faced with moral dilemmas? This study…

Computers and Society · Computer Science 2025-04-16 Jiseon Kim , Jea Kwon , Luiz Felipe Vecchietti , Alice Oh , Meeyoung Cha

Generative Language Models (LMs) such as ChatGPT have exhibited remarkable performance across various downstream tasks. Nevertheless, one of their most prominent drawbacks is generating inaccurate or false information with a confident tone.…

Computation and Language · Computer Science 2024-05-14 Haixia Han , Jiaqing Liang , Jie Shi , Qianyu He , Yanghua Xiao

Massively multilingual sentence representations are trained on large corpora of uncurated data, with a very imbalanced proportion of languages included in the training. This may cause the models to grasp cultural values including moral…

Computation and Language · Computer Science 2022-03-21 Katharina Hämmerl , Björn Deiseroth , Patrick Schramowski , Jindřich Libovický , Alexander Fraser , Kristian Kersting

Large language models (LLMs) have become essential tools in software development, widely used for requirements engineering, code generation and review tasks. Software engineers often rely on LLMs to verify if code implementation satisfy…

Software Engineering · Computer Science 2026-03-03 Haolin Jin , Huaming Chen

Recent breakthroughs in Large Language Models (LLMs) have revealed remarkable generative capabilities and emerging self-regulatory mechanisms, including self-correction and self-rewarding. However, current detoxification techniques rarely…

Computation and Language · Computer Science 2026-01-21 Kaituo Zhang , Zhimeng Jiang , Na Zou

Large language models (LLMs) are increasingly examined as both behavioral subjects and decision systems, yet it remains unclear whether observed cognitive biases reflect surface imitation or deeper probability shifts. Anchoring bias, a…

Artificial Intelligence · Computer Science 2025-11-11 Felipe Valencia-Clavijo

Large language models (LLMs) have demonstrated impressive capabilities in various reasoning tasks, aided by techniques like chain-of-thought prompting that elicits verbalized reasoning. However, LLMs often generate text with obvious…

Artificial Intelligence · Computer Science 2024-12-06 Zhihui Xie , Jizhou Guo , Tong Yu , Shuai Li

Large language models (LLMs) have offered new opportunities for emotional support, and recent work has shown that they can produce empathic responses to people in distress. However, long-term mental well-being requires emotional…

Computation and Language · Computer Science 2024-08-09 Hongli Zhan , Allen Zheng , Yoon Kyung Lee , Jina Suh , Junyi Jessy Li , Desmond C. Ong

Large language models (LLMs) have demonstrated robust capabilities across various natural language tasks. However, producing outputs that are consistently honest and helpful remains an open challenge. To overcome this challenge, this paper…

Computation and Language · Computer Science 2025-06-23 Duc Hieu Ho , Chenglin Fan

The recent rise in popularity of large language models (LLMs) has prompted considerable concerns about their moral capabilities. Although considerable effort has been dedicated to aligning LLMs with human moral values, existing benchmarks…

Artificial Intelligence · Computer Science 2025-08-19 Alessio Galatolo , Luca Alberto Rappuoli , Katie Winkle , Meriem Beloucif

Previous research has primarily focused on the cognitive error detection capabilities of Large Language Models (LLMs), often prompting them to analyze mistakes in reasoning chains. However, few studies have examined the meta-cognitive…

Computation and Language · Computer Science 2025-10-31 Ziyang Ma , Qingyue Yuan , Zhenglin Wang , Deyu Zhou

Self-critic has become a crucial mechanism for enhancing the reasoning performance of LLMs. However, current approaches mainly involve basic prompts for intuitive instance-level feedback, which resembles System-1 processes and limits the…

Computation and Language · Computer Science 2025-06-12 Xin Zheng , Jie Lou , Boxi Cao , Xueru Wen , Yuqiu Ji , Hongyu Lin , Yaojie Lu , Xianpei Han , Debing Zhang , Le Sun