English
Related papers

Related papers: Answer, Refuse, or Guess? Investigating Risk-Aware…

200 papers

Users often formulate their search queries with immature language without well-developed keywords and complete structures. Such queries fail to express their true information needs and raise ambiguity as fragmental language often yield…

Information Retrieval · Computer Science 2021-01-19 Zhenduo Wang , Qingyao Ai

Large language models (LLMs) are known to produce varying responses depending on prompt phrasing, indicating that subtle guidance in phrasing can steer their answers. However, the impact of this framing bias on LLM-based evaluation, where…

Computation and Language · Computer Science 2026-01-21 Yerin Hwang , Dongryeol Lee , Taegwan Kang , Minwoo Lee , Kyomin Jung

Access control is a cornerstone of secure computing, yet large language models often blur role boundaries by producing unrestricted responses. We study role-conditioned refusals, focusing on the LLM's ability to adhere to access control…

Computation and Language · Computer Science 2025-10-10 Đorđe Klisura , Joseph Khoury , Ashish Kundu , Ram Krishnan , Anthony Rios

Metacognition -- assessing the quality of one's own cognitive performance -- guides adaptive behavior across species. Substantial research demonstrates that confidence signals can be extracted from language model outputs, yet a fundamental…

Machine Learning · Computer Science 2026-05-20 Dharshan Kumaran , Nathaniel Daw , Simon Osindero , Petar Veličković , Viorica Patraucean

Recent Large Reasoning Models (LRMs) with thinking traces have shown strong performance on English reasoning tasks. However, their ability to think in other languages is less studied. This capability is as important as answer accuracy for…

Computation and Language · Computer Science 2025-12-12 Jirui Qi , Shan Chen , Zidi Xiong , Raquel Fernández , Danielle S. Bitterman , Arianna Bisazza

Large language models (LLMs) are increasingly used to simulate human decision-making, but their intrinsic biases often diverge from real human behavior--limiting their ability to reflect population-level diversity. We address this challenge…

Computer Science and Game Theory · Computer Science 2025-08-27 Ayato Kitadai , Yusuke Fukasawa , Nariaki Nishino

Large Language Models (LLMs) have emerged as formidable instruments capable of comprehending and producing human-like text. This paper explores the potential of LLMs, to shape user perspectives and subsequently influence their decisions on…

Artificial Intelligence · Computer Science 2024-09-04 Ganesh Prasath Ramani , Shirish Karande , Santhosh V , Yash Bhatia

Traditionally, Reinforcement Learning (RL) aims at deciding how to act optimally for an artificial agent. We argue that deciding when to act is equally important. As humans, we drift from default, instinctive or memorized behaviors to…

Machine Learning · Computer Science 2022-03-17 Alexis Jacq , Johan Ferret , Olivier Pietquin , Matthieu Geist

The recent explosion in the capabilities of large language models has led to a wave of interest in how best to prompt a model to perform a given task. While it may be tempting to simply choose a prompt based on average performance on a…

Machine Learning · Computer Science 2024-03-29 Thomas P. Zollo , Todd Morrill , Zhun Deng , Jake C. Snell , Toniann Pitassi , Richard Zemel

A safe and trustworthy use of Large Language Models (LLMs) requires an accurate expression of confidence in their answers. We propose a novel Reinforcement Learning approach that allows to directly fine-tune LLMs to express calibrated…

Computation and Language · Computer Science 2026-03-03 David Bani-Harouni , Chantal Pellegrini , Paul Stangel , Ege Özsoy , Kamilia Zaripova , Nassir Navab , Matthias Keicher

In order to be deployed safely, Large Language Models (LLMs) must be capable of dynamically adapting their behavior based on their level of knowledge and uncertainty associated with specific topics. This adaptive behavior, which we refer to…

Computation and Language · Computer Science 2024-07-04 Alexandre Piché , Aristides Milios , Dzmitry Bahdanau , Chris Pal

The conformity bias exhibited by large language models (LLMs) can pose a significant challenge to decision-making in LLM-based multi-agent systems (LLM-MAS). While many prior studies have treated "conformity" simply as a matter of opinion…

Artificial Intelligence · Computer Science 2026-04-22 Mikako Bito , Keita Nishimoto , Kimitaka Asatani , Ichiro Sakata

Chain-of-thought explanations are widely used to inspect the decision process of large language models (LLMs) and to evaluate the trustworthiness of model outputs, making them important for effective collaboration between LLMs and humans.…

Computation and Language · Computer Science 2025-07-16 Pedro Ferreira , Wilker Aziz , Ivan Titov

High-stakes decision domains are increasingly exploring the potential of Large Language Models (LLMs) for complex decision-making tasks. However, LLM deployment in real-world settings presents challenges in data security, evaluation of its…

Computers and Society · Computer Science 2025-12-05 Swati Sachan , Theo Miller , Mai Phuong Nguyen

Responsible AI demands systems whose behavioral tendencies can be effectively measured, audited, and adjusted to prevent inadvertently nudging users toward risky decisions or embedding hidden biases in risk aversion. As language models…

Artificial Intelligence · Computer Science 2025-10-10 Ali Mazyaki , Mohammad Naghizadeh , Samaneh Ranjkhah Zonouzaghi , Amirhossein Farshi Sotoudeh

Large Language Models (LLMs) are widely used across sectors, yet their alignment with International Humanitarian Law (IHL) is not well understood. This study evaluates eight leading LLMs on their ability to refuse prompts that explicitly…

Computers and Society · Computer Science 2025-06-10 John Mavi , Diana Teodora Găitan , Sergio Coronado

Large language models often generate confident but incorrect answers rather than abstaining when uncertain. This problem is particularly acute for small language models (SLMs), where computational constraints and autonomous operation…

Artificial Intelligence · Computer Science 2026-05-26 Ashwath Vaithinathan Aravindan , Mayank Kejriwal

In order for AI systems to communicate effectively with people, they must understand how we make decisions. However, people's decisions are not always rational, so the implicit internal models of human decision-making in Large Language…

Computation and Language · Computer Science 2025-03-11 Ryan Liu , Jiayi Geng , Joshua C. Peterson , Ilia Sucholutsky , Thomas L. Griffiths

Despite strong advisory against it, large generative models (LMs) are already being used for decision making tasks that were previously done by predictive models or humans. We put popular LMs to the test in a high-stakes decision making…

Artificial Intelligence · Computer Science 2025-02-17 Keri Mallari , Julius Adebayo , Kori Inkpen , Martin T. Wells , Albert Gordo , Sarah Tan

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

Artificial Intelligence · Computer Science 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure
‹ Prev 1 4 5 6 7 8 10 Next ›