English
Related papers

Related papers: The Hawthorne Effect in Reasoning Models: Evaluati…

200 papers

Can emergent language models faithfully model the intelligence of decision-making agents? Though modern language models exhibit already some reasoning ability, and theoretically can potentially express any probable distribution over tokens,…

Machine Learning · Computer Science 2024-06-27 Wenhao Lu , Xufeng Zhao , Josua Spisak , Jae Hee Lee , Stefan Wermter

Vision-language models (VLMs) show promise for autonomous driving but often lack transparent reasoning capabilities that are critical for safety. We investigate whether explicitly modeling reasoning during fine-tuning enhances VLM…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Amirhosein Chahe , Lifeng Zhou

Large language models (LLMs) achieve state-of-the-art performance on multiple language tasks, yet their safety guardrails can be circumvented, leading to harmful generations. In light of this, recent research on safety mechanisms has…

Computation and Language · Computer Science 2025-02-25 Zhenhong Zhou , Haiyang Yu , Xinghua Zhang , Rongwu Xu , Fei Huang , Kun Wang , Yang Liu , Junfeng Fang , Yongbin Li

Existing tasks fall short in evaluating reasoning ability of Large Language Models (LLMs) in an interactive, unknown environment. This deficiency leads to the isolated assessment of deductive, inductive, and abductive reasoning, neglecting…

Artificial Intelligence · Computer Science 2026-05-07 Congchi Yin , Tianyi Wu , Yankai Shu , Alex Gu , Yunhan Wang , Jun Shao , Xun Jiang , Piji Li

Recent advancements in Large Language Models (LLMs) have significantly enhanced their ability to perform complex reasoning tasks, transitioning from fast and intuitive thinking (System 1) to slow and deep reasoning (System 2). While System…

Computation and Language · Computer Science 2025-04-01 Rui Wang , Hongru Wang , Boyang Xue , Jianhui Pang , Shudong Liu , Yi Chen , Jiahao Qiu , Derek Fai Wong , Heng Ji , Kam-Fai Wong

This paper investigates the influence of cognitive biases on Large Language Models (LLMs) outputs. Cognitive biases, such as confirmation and availability biases, can distort user inputs through prompts, potentially leading to unfaithful…

Computation and Language · Computer Science 2025-06-17 Yan Sun , Stanley Kok

The shift toward interacting with frozen, "black-box" Large Language Models (LLMs) has transformed prompt engineering from a heuristic exercise into a critical optimization challenge. We propose a Reinforcement Learning (RL) framework for…

Artificial Intelligence · Computer Science 2026-05-15 Krishna Sayana , Ketan Todi , Ambarish Jash

The advent of Large Language Models (LLMs) has revolutionized product recommenders, yet their susceptibility to adversarial manipulation poses critical challenges, particularly in real-world commercial applications. Our approach is the…

Computation and Language · Computer Science 2025-10-23 Giorgos Filandrianos , Angeliki Dimitriou , Maria Lymperaiou , Konstantinos Thomas , Giorgos Stamou

The pretrained large language models (LLMs) are finetuned with labeled data for better instruction following ability and alignment with human values. In this paper, we study the learning dynamics of LLM finetuning on reasoning tasks and…

Computation and Language · Computer Science 2025-09-30 Zhiwen Ruan , Yun Chen , Yutao Hou , Peng Li , Yang Liu , Guanhua Chen

Previous studies proposed that the reasoning capabilities of large language models (LLMs) can be improved through self-reflection, i.e., letting LLMs reflect on their own output to identify and correct mistakes in the initial responses.…

Computation and Language · Computer Science 2025-02-18 Fengyuan Liu , Nouar AlDahoul , Gregory Eady , Yasir Zaki , Talal Rahwan

The releases of powerful open-weight large language models (LLMs) are often not accompanied by access to their full training data. Existing interpretability methods, particularly those based on activations, often require or assume…

Machine Learning · Computer Science 2026-04-22 Ziqian Zhong , Aditi Raghunathan

Large language models (LLMs) are increasingly examined as both behavioral subjects and decision systems, yet it remains unclear whether observed cognitive biases reflect surface imitation or deeper probability shifts. Anchoring bias, a…

Artificial Intelligence · Computer Science 2025-11-11 Felipe Valencia-Clavijo

Large Language Models (LLMs) display strikingly different generalization behaviors: supervised fine-tuning (SFT) often narrows capability, whereas reinforcement-learning (RL) tuning tends to preserve it. The reasons behind this divergence…

Machine Learning · Computer Science 2026-01-01 Haoyue Bai , Yiyou Sun , Wenjie Hu , Shi Qiu , Maggie Ziyu Huan , Peiyang Song , Robert Nowak , Dawn Song

LLMs are emerging tools for simulating human behavior in business, economics, and social science, offering a lower-cost complement to laboratory experiments, field studies, and surveys. This paper evaluates how well LLMs replicate human…

Machine Learning · Computer Science 2025-10-07 Runze Zhang , Xiaowei Zhang , Mingyang Zhao

Sentence stress refers to emphasis on words within a spoken utterance to highlight or contrast an idea. It is often used to imply an underlying intention not explicitly stated. Recent speech-aware language models (SLMs) have enabled direct…

Computation and Language · Computer Science 2026-04-08 Iddo Yosha , Gallil Maimon , Yossi Adi

Low-rank approximation techniques have become the de facto standard for fine-tuning Large Language Models (LLMs) due to their reduced computational and memory requirements. This paper investigates the effectiveness of these methods in…

Machine Learning · Computer Science 2024-05-30 Saswat Das , Marco Romanelli , Cuong Tran , Zarreen Reza , Bhavya Kailkhura , Ferdinando Fioretto

A common problem for agents operating in real-world environments is that the response of an environment to their actions may be non-deterministic and observed through noise. This renders environmental state and progress towards completing a…

Artificial Intelligence · Computer Science 2024-05-21 William E Bishop , Alice Li , Christopher Rawles , Oriana Riva

Learning dynamics, which describes how the learning of specific training examples influences the model's predictions on other examples, gives us a powerful tool for understanding the behavior of deep learning systems. We study the learning…

Machine Learning · Computer Science 2025-07-01 Yi Ren , Danica J. Sutherland

Large Language Models (LLMs) can comply with harmful instructions, raising serious safety concerns despite their impressive capabilities. Recent work has leveraged probing-based approaches to study the separability of malicious and benign…

Computation and Language · Computer Science 2025-12-16 Cheng Wang , Zeming Wei , Qin Liu , Muhao Chen

State-of-the-art Large Language Models (LLMs) are accredited with an increasing number of different capabilities, ranging from reading comprehension, over advanced mathematical and reasoning skills to possessing scientific knowledge. In…

Computation and Language · Computer Science 2024-11-01 Neeladri Bhuiya , Viktor Schlegel , Stefan Winkler
‹ Prev 1 8 9 10 Next ›