English
Related papers

Related papers: Empirical Study of Symmetrical Reasoning in Conver…

200 papers

With the advancement of large language models (LLMs), the focus in Conversational AI has shifted from merely generating coherent and relevant responses to tackling more complex challenges, such as personalizing dialogue systems. In an…

Computation and Language · Computer Science 2025-02-13 Maria Molchanova , Anna Mikhailova , Anna Korzanova , Lidiia Ostyakova , Alexandra Dolidze

Large language models (LLMs) are increasingly applied in educational, clinical, and professional settings, but their tendency for sycophancy -- prioritizing user agreement over independent reasoning -- poses risks to reliability. This study…

Artificial Intelligence · Computer Science 2025-09-22 Aaron Fanous , Jacob Goldberg , Ank A. Agarwal , Joanna Lin , Anson Zhou , Roxana Daneshjou , Sanmi Koyejo

Conversation with chatbots based on Large Language Models (LLMs) such as ChatGPT has become one of the major forms of interaction with Artificial Intelligence (AI) in everyday life. What makes this interaction so convenient is that…

Human-Computer Interaction · Computer Science 2026-03-18 Sarah Diefenbach , Daniel Ullrich

Large language models (LLMs) are currently at the forefront of intertwining AI systems with human communication and everyday life. Therefore, it is of great importance to evaluate their emerging abilities. In this study, we show that LLMs,…

Computation and Language · Computer Science 2023-10-10 Thilo Hagendorff , Sarah Fabi

Large Language Model (LLM) sycophancy is a growing concern. The current literature has largely examined sycophancy in contexts with clear right and wrong answers, like coding. However, AI is increasingly being used for emotional support and…

Human-Computer Interaction · Computer Science 2026-03-17 Jean Rehani , Victoria Oldemburgo de Mello , Dariya Ovsyannikova , Ashton Anderson , Michael Inzlicht

Large language models generate judgments that resemble those of humans. Yet the extent to which these models align with human judgments in interpreting figurative and socially grounded language remains uncertain. To investigate this, human…

Computation and Language · Computer Science 2026-01-15 Samhita Bollepally , Aurora Sloman-Moll , Takashi Yamauchi

Sycophancy, the tendency of LLM-based chatbots to express excessive agreement with their users, even when inappropriate, is emerging as a significant risk in human-AI interactions. However, the extent to which this affects human-LLM…

Human-Computer Interaction · Computer Science 2026-02-12 Jessica Y. Bo , Majeed Kazemitabaar , Mengqing Deng , Michael Inzlicht , Ashton Anderson

We examine whether large language models (LLMs) can predict biased decision-making in conversational settings, and whether their predictions capture not only human cognitive biases but also how those effects change under cognitive load. In…

Human-Computer Interaction · Computer Science 2026-02-06 Stephen Pilli , Vivek Nallur

Large language models (LLMs) like ChatGPT have shown significant advancements across diverse natural language understanding (NLU) tasks, including intelligent dialogue and autonomous agents. Yet, lacking widely acknowledged testing…

Computation and Language · Computer Science 2024-05-10 Jinyang Wu , Feihu Che , Xinxin Zheng , Shuai Zhang , Ruihan Jin , Shuai Nie , Pengpeng Shao , Jianhua Tao

This study consists of qualitative empirical research, conducted through exploratory tests with two different Large Language Models (LLMs) chatbots: ChatGPT and Gemini. The methodological procedure involved exploratory tests based on…

Computation and Language · Computer Science 2024-07-19 Melise Peruchini , Julio Monteiro Teixeira

Large language models (LLMs) such as ChatGPT and Vicuna have shown remarkable capacities in comprehending and producing language. However, their internal workings remain a black box, and it is unclear whether LLMs and chatbots can develop…

Computation and Language · Computer Science 2024-03-27 Zhenguang G. Cai , Xufeng Duan , David A. Haslett , Shuqi Wang , Martin J. Pickering

The purpose of this study is to assess how large language models (LLMs) can be used for fact-checking and contribute to the broader debate on the use of automated means for veracity identification. To achieve this purpose, we use AI…

Computation and Language · Computer Science 2025-03-12 Elizaveta Kuznetsova , Ilaria Vitulano , Mykola Makhortykh , Martha Stolze , Tomas Nagy , Victoria Vziatysheva

Conversational agents have made significant progress since ELIZA, expanding their role across various domains, including healthcare, education, and customer service. As these agents become increasingly integrated into daily human…

Human-Computer Interaction · Computer Science 2025-07-04 Paulo Ricardo Knob , Leonardo Scholler , Juliano Rigatti , Soraia Raupp Musse

With the rapid adoption of LLM-based chatbots, there is a pressing need to evaluate what humans and LLMs can achieve together. However, standard benchmarks, such as MMLU, measure LLM capabilities in isolation (i.e., "AI-alone"). Here, we…

Computation and Language · Computer Science 2025-08-13 Serina Chang , Ashton Anderson , Jake M. Hofman

Causal reasoning is a core component of intelligence. Large language models (LLMs) have shown impressive capabilities in generating human-like text, raising questions about whether their responses reflect true understanding or statistical…

Artificial Intelligence · Computer Science 2025-06-09 Hanna M. Dettki , Brenden M. Lake , Charley M. Wu , Bob Rehder

As large language models (LLMs) have demonstrated strong reasoning abilities in structured tasks (e.g., coding and mathematics), we explore whether these abilities extend to strategic multi-agent environments. We investigate strategic…

General Economics · Economics 2025-10-23 Gavin Kader , Dongwoo Lee

Achieving consensus in group decision-making often involves overcoming significant challenges, particularly in reconciling diverse perspectives and mitigating biases that hinder agreement. Traditional methods relying on human facilitators…

Human-Computer Interaction · Computer Science 2025-03-21 Loukas Triantafyllopoulos , Dimitris Kalles

Large Language Models (LLMs) have lately been on the spotlight of researchers, businesses, and consumers alike. While the linguistic capabilities of such models have been studied extensively, there is growing interest in investigating them…

Computation and Language · Computer Science 2023-08-17 Sotiris Lamprinidis

OpenAI's ChatGPT (GPT-4 and GPT-4o) and other Large Language Models (LLMs) like Microsoft's Copilot, Google's Gemini 1.5 Pro, and Antrophic's Claude 3.5 Sonnet can be effectively used in various phases of scientific research. Their…

Artificial Intelligence · Computer Science 2024-09-24 Goran Bubaš

Large Language Models (LLMs) such as ChatGPT demonstrated the potential to replicate human language abilities through technology, ranging from text generation to engaging in conversations. However, it remains controversial to what extent…

Computation and Language · Computer Science 2025-07-09 Martin Schuele