English
Related papers

Related papers: Individual Turing Test: A Case Study of LLM-based …

200 papers

Large language models (LLMs) are increasingly used to simulate human opinions and survey responses, but their ability to reproduce population responses across cultures remains limited. Existing persona-based prompting methods typically rely…

Computation and Language · Computer Science 2026-05-18 Axel Abels , Elias Fernandez Domingos , Apurva Shah , Tom Lenaerts

Conversational Recommender System (CRS) interacts with users through natural language to understand their preferences and provide personalized recommendations in real-time. CRS has demonstrated significant potential, prompting researchers…

Artificial Intelligence · Computer Science 2024-03-26 Lixi Zhu , Xiaowen Huang , Jitao Sang

Large Language Models (LLMs) have shown to be a great success in a wide range of applications ranging from regular NLP-based use cases to AI agents. LLMs have been trained on a vast corpus of texts from various sources; despite the best…

Computation and Language · Computer Science 2024-11-26 Abhinav Joshi , Shaswati Saha , Divyaksh Shukla , Sriram Vema , Harsh Jhamtani , Manas Gaur , Ashutosh Modi

Human problem-solving is enriched by a diversity of styles and personality traits, yet the development of Large Language Models (LLMs) has largely prioritized uniform performance benchmarks that favour specific behavioural tendencies such…

Computation and Language · Computer Science 2026-03-09 Xi Wang , Mengdie Zhuang , Jiqun Liu

Accurately modeling user preferences is crucial for improving the performance of content-based recommender systems. Existing approaches often rely on simplistic user profiling methods, such as averaging or concatenating item embeddings,…

Information Retrieval · Computer Science 2025-08-13 Milad Sabouri , Masoud Mansoury , Kun Lin , Bamshad Mobasher

To solve complex tasks, large language models (LLMs) often require multiple rounds of interactions with the user, sometimes assisted by external tools. However, current evaluation protocols often emphasize benchmark performance with…

Computation and Language · Computer Science 2024-03-13 Xingyao Wang , Zihan Wang , Jiateng Liu , Yangyi Chen , Lifan Yuan , Hao Peng , Heng Ji

This report analyzes the potential for large language models (LLMs) to expedite accurate replication and generalization of published research about message effects in marketing. LLM-powered participants (personas) were tested by replicating…

Computation and Language · Computer Science 2025-04-28 Leo Yeykelis , Kaavya Pichai , James J. Cummings , Byron Reeves

Large language models (LLMs) possess strong persuasive capabilities that outperform humans in head-to-head comparisons. Users report consulting LLMs to inform major life decisions in relationships, medical settings, and when seeking…

Human-Computer Interaction · Computer Science 2026-04-28 Nalin Poungpeth , Nicholas Clark , Tanu Mitra

Large language models (LLMs) are powerful dialogue agents, but specializing them towards fulfilling a specific function can be challenging. Instructing tuning, i.e. tuning models on instruction and sample responses generated by humans…

Computation and Language · Computer Science 2024-01-11 Dennis Ulmer , Elman Mansimov , Kaixiang Lin , Justin Sun , Xibin Gao , Yi Zhang

Large language models (LLMs) are increasingly involved in shaping public understanding on contested issues. This has led to substantial discussion about the potential of LLMs to reinforce or correct misperceptions. While existing literature…

Social and Information Networks · Computer Science 2025-06-09 Adiba Mahbub Proma , Neeley Pate , Sean Kelty , Gourab Ghoshal , James N. Druckman , Ehsan Hoque

While Large Language Models (LLMs) are increasingly envisioned as intelligent assistants for personalized learning, systematic head-to-head evaluations in authentic learning scenarios remain scarce. This study presents an empirical…

Artificial Intelligence · Computer Science 2025-10-23 Bo Yuan , Jiazi Hu

Fine-tuning is a common and effective method for tailoring large language models (LLMs) to specialized tasks and applications. In this paper, we study the privacy implications of fine-tuning LLMs on user data. To this end, we consider a…

Cryptography and Security · Computer Science 2024-02-27 Nikhil Kandpal , Krishna Pillutla , Alina Oprea , Peter Kairouz , Christopher A. Choquette-Choo , Zheng Xu

In the present study, we investigate and compare reasoning in large language models (LLM) and humans using a selection of cognitive psychology tools traditionally dedicated to the study of (bounded) rationality. To do so, we presented to…

Computation and Language · Computer Science 2023-09-25 Nicolas Yax , Hernan Anlló , Stefano Palminteri

Large Language Models (LLMs) excel at producing broadly relevant text, but this generality becomes a limitation when user-specific preferences are required, such as recommending restaurants or planning travel. In these scenarios, users…

Machine Learning · Computer Science 2025-10-21 Ioannis Tsaknakis , Bingqing Song , Shuyu Gan , Dongyeop Kang , Alfredo Garcia , Gaowen Liu , Charles Fleming , Mingyi Hong

The current cycle of hype and anxiety concerning the benefits and risks to human society of Artificial Intelligence is fuelled, not only by the increasing use of generative AI and other AI tools by the general public, but also by claims…

Human-Computer Interaction · Computer Science 2025-01-30 Sharon Temtsin , Diane Proudfoot , David Kaber , Christoph Bartneck

In the rapidly evolving landscape of Large Language Models (LLMs), introduction of well-defined and standardized evaluation methodologies remains a crucial challenge. This paper traces the historical trajectory of LLM evaluations, from the…

Computation and Language · Computer Science 2023-11-06 Alexey Tikhonov , Ivan P. Yamshchikov

Recent studies provide large language models (LLMs) with textual task-solving experiences via prompts to improve their performance. However, previous methods rely on substantial human labor or time to gather such experiences for each task,…

Computation and Language · Computer Science 2025-05-30 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bibo Cai , Bing Qin , Ting Liu

Personalized opinion summarization is crucial as it considers individual user interests while generating product summaries. Recent studies show that although large language models demonstrate powerful text summarization and evaluation…

Computation and Language · Computer Science 2025-03-04 Yanyue Zhang , Yulan He , Deyu Zhou

Researchers have made notable progress in applying Large Language Models (LLMs) to solve math problems, as demonstrated through efforts like GSM8k, ProofNet, AlphaGeometry, and MathOdyssey. This progress has sparked interest in their…

Human-Computer Interaction · Computer Science 2025-03-24 Adit Gupta , Jennifer Reddig , Tommaso Calo , Daniel Weitekamp , Christopher J. MacLellan

Questionnaires are a common method for detecting the personality of Large Language Models (LLMs). However, their reliability is often compromised by two main issues: hallucinations (where LLMs produce inaccurate or irrelevant responses) and…

Computation and Language · Computer Science 2024-10-14 Baohua Zhan , Yongyi Huang , Wenyao Cui , Huaping Zhang , Jianyun Shang