English
Related papers

Related papers: Can LLMs Capture Human Preferences?

200 papers

Large language models (LLMs) can be said to have preferences: they reliably pick certain tasks and outputs over others, and preferences shaped by post-training and system prompts appear to shape much of their behaviour. But models can also…

Computation and Language · Computer Science 2026-05-19 Oscar Gilg , Pierre Beckmann , Daniel Paleka , Patrick Butlin

This perspective paper explores the future potential of "conversational intelligence" by examining how Large Language Models (LLMs) could be combined with GRAPHYP's network system to better understand human conversations and preferences.…

Artificial Intelligence · Computer Science 2025-07-29 Renaud Fabre , Daniel Egret , Patrice Bellot

Explainable Artificial Intelligence (XAI) poses a significant challenge in providing transparent and understandable insights into complex AI models. Traditional post-hoc algorithms, while useful, often struggle to deliver interpretable…

Artificial Intelligence · Computer Science 2024-09-24 Adrita Barua , Cara Widmer , Pascal Hitzler

The new polymath Large Language Models (LLMs) can speed-up greatly scientific reviews, possibly using more unbiased quantitative metrics, facilitating cross-disciplinary connections, and identifying emerging trends and research gaps by…

Computation and Language · Computer Science 2023-12-08 Chenxi Wu , Alan John Varghese , Vivek Oommen , George Em Karniadakis

Large Language Models (LLMs) exhibit remarkably powerful capabilities. One of the crucial factors to achieve success is aligning the LLM's output with human preferences. This alignment process often requires only a small amount of data to…

Cognitive psychology delves on understanding perception, attention, memory, language, problem-solving, decision-making, and reasoning. Large language models (LLMs) are emerging as potent tools increasingly capable of performing human-level…

Computation and Language · Computer Science 2023-04-13 Sifatkaur Dhingra , Manmeet Singh , Vaisakh SB , Neetiraj Malviya , Sukhpal Singh Gill

Training emotion recognition models has relied heavily on human annotated data, which present diversity, quality, and cost challenges. In this paper, we explore the potential of Large Language Models (LLMs), specifically GPT4, in automating…

Computation and Language · Computer Science 2024-09-02 Minxue Niu , Mimansa Jaiswal , Emily Mower Provost

The rapid advancements in large language models (LLMs) have greatly expanded the potential for automated code-related tasks. Two primary methodologies are used in this domain: prompt engineering and fine-tuning. Prompt engineering involves…

Software Engineering · Computer Science 2025-02-21 Jiho Shin , Clark Tang , Tahmineh Mohati , Maleknaz Nayebi , Song Wang , Hadi Hemmati

Can large language models (LLMs) learn a decision maker's preferences from observed choices and generate preference-consistent recommendations in new situations? We propose a portable Simulate-Recommend-Evaluate framework that tests…

General Economics · Economics 2026-04-08 Jeongbin Kim , Matthew Kovach , Kyu-Min Lee , Euncheol Shin , Hector Tzavellas

Traditional recommender systems leverage users' item preference history to recommend novel content that users may like. However, modern dialog interfaces that allow users to express language-based preferences offer a fundamentally different…

Information Retrieval · Computer Science 2023-07-27 Scott Sanner , Krisztian Balog , Filip Radlinski , Ben Wedin , Lucas Dixon

Actively inferring user preferences, for example by asking good questions, is important for any human-facing decision-making system. Active inference allows such systems to adapt and personalize themselves to nuanced individual preferences.…

Computation and Language · Computer Science 2024-06-27 Wasu Top Piriyakulkij , Volodymyr Kuleshov , Kevin Ellis

Recent research has focused on examining Large Language Models' (LLMs) characteristics from a psychological standpoint, acknowledging the necessity of understanding their behavioral characteristics. The administration of personality tests…

Computation and Language · Computer Science 2024-10-07 Jen-tse Huang , Wenxiang Jiao , Man Ho Lam , Eric John Li , Wenxuan Wang , Michael R. Lyu

Studies of reinforcement learning in humans and animals have demonstrated a preference for options that yielded relatively better outcomes in the past, even when those options are associated with lower absolute reward. The present study…

Computation and Language · Computer Science 2024-01-29 William M. Hayes , Nicolas Yax , Stefano Palminteri

Large Language Models (LLMs) are becoming widely used to support various workflows across different disciplines, yet their potential in discrete choice modelling remains relatively unexplored. This work examines the potential of LLMs as…

Econometrics · Economics 2026-03-18 Georges Sfeir , Gabriel Nova , Stephane Hess , Sander van Cranenburgh

Commonsense reasoning is a difficult task for a computer, but a critical skill for an artificial intelligence (AI). It can enhance the explainability of AI models by enabling them to provide intuitive and human-like explanations for their…

Artificial Intelligence · Computer Science 2024-07-08 Stefanie Krause , Frieder Stolzenburg

Research on emergent patterns in Large Language Models (LLMs) has gained significant traction in both psychology and artificial intelligence, motivating the need for a comprehensive review that offers a synthesis of this complex landscape.…

Computation and Language · Computer Science 2024-12-23 Zhisheng Tang , Mayank Kejriwal

We explore the potential of Large Language Models (LLMs) to replicate human behavior in economic market experiments. Compared to previous studies, we focus on dynamic feedback between LLM agents: the decisions of each LLM impact the market…

General Economics · Economics 2025-05-13 R. Maria del Rio-Chanona , Marco Pangallo , Cars Hommes

Large language models (LLMs) exhibit strikingly conflicting behaviors: they can appear steadfastly overconfident in their initial answers whilst at the same time being prone to excessive doubt when challenged. To investigate this apparent…

The advent of AI driven large language models (LLMs) have stirred discussions about their role in qualitative research. Some view these as tools to enrich human understanding, while others perceive them as threats to the core values of the…

Software Engineering · Computer Science 2023-06-26 Muneera Bano , Didar Zowghi , Jon Whittle

This study examines the use of Large Language Models (LLMs) for retrieving factual information, addressing concerns over their propensity to produce factually incorrect "hallucinated" responses or to altogether decline to even answer prompt…

Computation and Language · Computer Science 2024-03-15 Lauren Rhue , Sofie Goethals , Arun Sundararajan