English
Related papers

Related papers: YIELD: A Large-Scale Dataset and Evaluation Framew…

200 papers

Heuristics and cognitive biases are an integral part of human decision-making. Automatically detecting a particular cognitive bias could enable intelligent tools to provide better decision-support. Detecting the presence of a cognitive bias…

Human-Computer Interaction · Computer Science 2024-01-15 Stephen Pilli

Despite the utility of Large Language Models (LLMs) across a wide range of tasks and scenarios, developing a method for reliably evaluating LLMs across varied contexts continues to be challenging. Modern evaluation approaches often use LLMs…

Computation and Language · Computer Science 2024-01-31 Steffi Chern , Ethan Chern , Graham Neubig , Pengfei Liu

Large Language Model (LLM) agent systems have advanced rapidly, driven by their strong generalization in zero-shot settings. To further enhance reasoning and accuracy on complex tasks, Multi-Agent Debate (MAD) has emerged as a promising…

Computation and Language · Computer Science 2025-12-03 Wei Fan , JinYi Yoon , Bo Ji

While mechanistic interpretability has developed powerful tools to analyze the internal workings of Large Language Models (LLMs), their complexity has created an accessibility gap, limiting their use to specialists. We address this…

Computation and Language · Computer Science 2026-02-23 Aaron Louis Eidt , Nils Feldhus

The subtlety of emotional expressions makes implicit emotion analysis (IEA) particularly sensitive to user-specific characteristics. Current studies personalize emotion analysis by focusing on the author but neglect the impact of the…

Computation and Language · Computer Science 2025-05-23 Jian Liao , Yu Feng , Yujin Zheng , Jun Zhao , Suge Wang , Jianxing Zheng

Open Information Extraction (OIE) aims to extract objective structured knowledge from natural texts, which has attracted growing attention to build dedicated models with human experience. As the large language models (LLMs) have exhibited…

Computation and Language · Computer Science 2023-10-17 Ji Qi , Kaixuan Ji , Xiaozhi Wang , Jifan Yu , Kaisheng Zeng , Lei Hou , Juanzi Li , Bin Xu

With the widespread adoption of Large Language Models (LLMs), the prevalence of iterative interactions among these models is anticipated to increase. Notably, recent advancements in multi-round self-improving methods allow LLMs to generate…

Computation and Language · Computer Science 2024-10-31 Yi Ren , Shangmin Guo , Linlu Qiu , Bailin Wang , Danica J. Sutherland

As Large Language Models (LLMs) rise in popularity, it is necessary to assess their capability in critically relevant domains. We present a comprehensive evaluation framework, grounded in science communication research, to assess LLM…

Conversational Assistants (CA) are increasingly supporting human workers in knowledge management. Traditionally, CAs respond in specific ways to predefined user intents and conversation patterns. However, this rigidness does not handle the…

Human-Computer Interaction · Computer Science 2024-07-15 Samuel Kernan Freire , Chaofan Wang , Evangelos Niforatos

In the domain of Human-Computer Interaction, focus groups represent a widely utilised yet resource-intensive methodology, often demanding the expertise of skilled moderators and meticulous preparatory efforts. This study introduces the…

Human-Computer Interaction · Computer Science 2024-09-04 Taiyu Zhang , Xuesong Zhang , Robbe Cools , Adalberto L. Simeone

Information extraction (IE) systems aim to automatically extract structured information, such as named entities, relations between entities, and events, from unstructured texts. While most existing work addresses a particular IE task,…

Computation and Language · Computer Science 2023-05-22 Chang Gao , Wenxuan Zhang , Wai Lam , Lidong Bing

Deriving personalized insights from popular wearable trackers requires complex numerical reasoning that challenges standard LLMs, necessitating tool-based approaches like code generation. Large language model (LLM) agents present a…

Serious illness conversations (SICs) align care with patients' values, goals, and preferences, yet they rarely occur in emergency departments (EDs), where time constraints and emotional burden often leave clinicians making high-stakes…

Human-Computer Interaction · Computer Science 2026-04-30 Hasibur Rahman , Kenji Numata , Evelyn T Lai , Maria Cheriyan , Adrian Haimovich , Kei Ouchi , Smit Desai

Recent advances on large language models (LLMs) enable researchers and developers to build autonomous language agents that can automatically solve various tasks and interact with environments, humans, and other agents using natural language…

Conversational agents are increasingly deployed in knowledge-intensive settings, where correct behavior depends on retrieving and applying domain-specific knowledge from large, proprietary, and unstructured corpora during live interactions…

Artificial Intelligence · Computer Science 2026-03-05 Quan Shi , Alexandra Zytek , Pedram Razavi , Karthik Narasimhan , Victor Barres

The proliferation of AI-generated content has created an absurd communication theater where senders use LLMs to inflate simple ideas into verbose content, recipients use LLMs to compress them back into summaries, and as a consequence…

Computation and Language · Computer Science 2025-11-07 Mohammed Musthafa Rafi , Adarsh Krishnamurthy , Aditya Balu

Evaluating large language model (LLM)-based multi-agent systems remains a critical challenge, as these systems must exhibit reliable coordination, transparent decision-making, and verifiable performance across evolving tasks. Existing…

Artificial Intelligence · Computer Science 2026-01-21 YenTing Lee , Keerthi Koneru , Zahra Moslemi , Sheethal Kumar , Ramesh Radhakrishnan

Large Language Models (LLMs) are transforming artificial intelligence, evolving into task-oriented systems capable of autonomous planning and execution. One of the primary applications of LLMs is conversational AI systems, which must…

Computation and Language · Computer Science 2025-01-22 Elad Levi , Ilan Kadar

Embodied conversational agents (ECAs) are increasingly more realistic and capable of dynamic conversations. In online surveys, anthropomorphic agents could help address issues like careless responding and satisficing, which originate from…

Human-Computer Interaction · Computer Science 2025-08-05 Matus Krajcovic , Peter Demcak , Eduard Kuric

Conversational Information Seeking has evolved rapidly in the last few years with the development of Large Language Models providing the basis for interpreting and responding in a naturalistic manner to user requests. iKAT emphasizes the…

Information Retrieval · Computer Science 2024-02-23 Mohammad Aliannejadi , Zahra Abbasiantaeb , Shubham Chatterjee , Jeffery Dalton , Leif Azzopardi