English
Related papers

Related papers: Dynamic Epistemic Friction in Dialogue

200 papers

The field of AI alignment aims to steer AI systems toward human goals, preferences, and ethical principles. Its contributions have been instrumental for improving the output quality, safety, and trustworthiness of today's AI models. This…

Artificial Intelligence · Computer Science 2024-11-26 Robert West , Roland Aydin

As the interest in Artificial Intelligence continues to grow it is becoming more and more important to investigate formalization and tools that allow us to exploit logic to reason about the world. In particular, given the increasing number…

Artificial Intelligence · Computer Science 2019-09-19 Francesco Fabiano

Sycophancy (overly agreeable or flattering behavior) poses a fundamental challenge for human-AI collaboration, particularly in high-stakes decision-making domains such as health, law, and education. A central difficulty in studying…

Artificial Intelligence · Computer Science 2026-05-05 Katherine Atwell , Pedram Heydari , Anthony Sicilia , Malihe Alikhani

Despite strong medical benchmark accuracy, LLMs can exhibit severe multi-turn sycophancy in clinical dialogue, abandoning initial correct diagnosis under escalating pressure. We propose \textbf{\textsc{Med-Stress}}, a targeted stress test…

Artificial Intelligence · Computer Science 2026-05-26 Boyu Xiao , Xiuqi Tian , Xuwen Song , Haochun Wang , Guanchun Song , Sendong Zhao , Bing Qin

We study opinion dynamics in a population of interacting adaptive agents voting on a set of complex multidimensional issues. We consider agents which can classify issues into for or against. The agents arrive at the opinions about each…

Physics and Society · Physics 2009-03-11 Renato Vicente , Andre C. R. Martins , Nestor Caticha

Large Language Models are increasingly used to simulate human opinion dynamics, yet the effect of genuine interaction is often obscured by systematic biases. We develop a Bayesian framework to disentangle and quantify three such biases: (i)…

Physics and Society · Physics 2026-05-25 Vincent C. Brockers , David A. Ehrlich , Viola Priesemann

When answering user queries, LLMs often retrieve knowledge from external sources stored in retrieval-augmented generation (RAG) databases. These are often populated from unvetted sources, e.g. the open web, and can contain maliciously…

Cryptography and Security · Computer Science 2026-03-27 Hao Wu , Prateek Saxena

The performance of task-oriented dialogue models is strongly tied to how well they track dialogue states, which records and updates user information across multi-turn interactions. However, current multi-domain DST encounters two key…

Computation and Language · Computer Science 2026-03-12 Haoxiang Su , Ruiyu Fang , Liting Jiang , Xiaomeng Huang , Shuangyong Song

Current large language models (LLMs) have demonstrated emerging capabilities in social intelligence tasks, including implicature resolution and theory-of-mind reasoning, both of which require substantial pragmatic understanding. However,…

Computation and Language · Computer Science 2026-01-13 Kefan Yu , Qingcheng Zeng , Weihao Xuan , Wanxin Li , Jingyi Wu , Rob Voigt

This study investigates the behaviors of Large Language Models (LLMs) when faced with conflicting prompts versus their internal memory. This will not only help to understand LLMs' decision mechanism but also benefit real-world applications,…

Computation and Language · Computer Science 2024-02-21 Jiahao Ying , Yixin Cao , Kai Xiong , Yidong He , Long Cui , Yongbin Liu

This position paper argues that effective tutoring requires corrective friction: surfacing misconceptions and challenging them supportively to drive conceptual change. Yet preference-aligned LLMs can trade epistemic rigor for agreeableness.…

Artificial Intelligence · Computer Science 2026-05-15 Enkelejda Kasneci , Gjergji Kasneci

Word evolution refers to the changing meanings and associations of words throughout time, as a byproduct of human language evolution. By studying word evolution, we can infer social trends and language constructs over different periods of…

Computation and Language · Computer Science 2018-02-14 Zijun Yao , Yifan Sun , Weicong Ding , Nikhil Rao , Hui Xiong

The rise of large language models (LLMs) has revolutionized the way that we interact with artificial intelligence systems through natural language. However, LLMs often misinterpret user queries because of their uncertain intention, leading…

Computation and Language · Computer Science 2024-02-07 Jing-Cheng Pang , Heng-Bo Fan , Pengyuan Wang , Jia-Hao Xiao , Nan Tang , Si-Hang Yang , Chengxing Jia , Sheng-Jun Huang , Yang Yu

Enhancing user engagement through interactions plays an essential role in socially-driven dialogues. While prior works have optimized models to reason over relevant knowledge or plan a dialogue act flow, the relationship between user…

Computation and Language · Computer Science 2025-06-27 Jiashuo Wang , Kaitao Song , Chunpu Xu , Changhe Song , Yang Xiao , Dongsheng Li , Lili Qiu , Wenjie Li

Large language models (LLMs) are increasingly used as information sources, yet small changes in semantic framing can destabilize their truth judgments. We propose P-StaT (Perturbation Stability of Truth), an evaluation framework for testing…

Computation and Language · Computer Science 2026-01-21 Samantha Dies , Courtney Maynard , Germans Savcisens , Tina Eliassi-Rad

LLMs are increasingly used as third-party judges, yet their reliability when evaluating speakers in dialogue remains poorly understood. We show that LLMs judge identical claims differently depending on framing: the same content elicits…

Computation and Language · Computer Science 2026-01-19 Parisa Rabbani , Priyam Sahoo , Ruben Mathew , Aishee Mondal , Harshita Ketharaman , Nimet Beyza Bozdag , Dilek Hakkani-Tür

As AI systems become embedded in everyday practice, value misalignment has emerged as a pressing concern. Yet, dominant alignment approaches remain model centric, treating users as passive recipients of prespecified values rather than as…

Human-Computer Interaction · Computer Science 2026-04-22 Anne Arzberger , Enrico Liscio , Maria Luce Lupetti , Inigo Martinez de Rituerto de Troya , Jie Yang

Understanding how humans revise their beliefs in light of new information is crucial for developing AI systems which can effectively model, and thus align with, human reasoning. While theoretical belief revision frameworks rely on a set of…

Artificial Intelligence · Computer Science 2025-06-12 Stylianos Loukas Vasileiou , Antonio Rago , Maria Vanina Martinez , William Yeoh

The reasoning capabilities of embodied agents introduce a critical, under-explored inferential privacy challenge, where the risk of an agent generate sensitive conclusions from ambient data. This capability creates a fundamental tension…

Human-Computer Interaction · Computer Science 2025-09-24 Shuning Zhang , Hong Jia , Simin Li , Ting Dang , Yongquan `Owen' Hu , Xin Yi , Hewu Li

Rational speakers are supposed to know what they know and what they do not know, and to generate expressions matching the strength of evidence. In contrast, it is still a challenge for current large language models to generate corresponding…

Computation and Language · Computer Science 2025-06-03 Meng Li , Michael Vrazitulis , David Schlangen