English
Related papers

Related papers: Know Your Mistakes: Towards Preventing Overrelianc…

200 papers

Dialogue State Tracking (DST) is primarily evaluated using Joint Goal Accuracy (JGA) defined as the fraction of turns where the ground-truth dialogue state exactly matches the prediction. Generally in DST, the dialogue state or belief state…

Computation and Language · Computer Science 2022-04-08 Suvodip Dey , Ramamohan Kummara , Maunendra Sankar Desarkar

The rapid integration of large language models (LLMs) into everyday workflows has transformed how individuals perform cognitive tasks such as writing, programming, analysis, and multilingual communication. While prior research has focused…

Artificial Intelligence · Computer Science 2026-04-29 Hyunwoo Kim , Harin Yu , Hanau Yi

Large language models (LLMs) have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. However, conventional DST benchmarks primarily focus on structured user-agent…

Computation and Language · Computer Science 2025-06-13 Sangmin Song , Juhwan Choi , JungMin Yun , YoungBin Kim

Large Language Models (LLMs) often exhibit factual inconsistencies and logical decay in extended, multi-turn dialogues, a challenge stemming from their reliance on static, pre-trained knowledge and an inability to reason adaptively over the…

Computation and Language · Computer Science 2025-10-16 Xiang Lei , Qin Li , Min Zhang , Min Zhang

Task-oriented dialogue (TOD) systems facilitate users in executing various activities via multi-turn dialogues, but Large Language Models (LLMs) often struggle to comprehend these intricate contexts. In this study, we propose a novel…

Computation and Language · Computer Science 2023-09-25 Haoyu Gao , Ting-En Lin , Hangyu Li , Min Yang , Yuchuan Wu , Wentao Ma , Yongbin Li

Current medical AI systems often fail to replicate real-world clinical reasoning, as they are predominantly trained and evaluated on static text and question-answer tasks. These tuning methods and benchmarks overlook critical aspects like…

Computation and Language · Computer Science 2026-02-24 Zijie Liu , Xinyu Zhao , Jie Peng , Zhuangdi Zhu , Qingyu Chen , Kaidi Xu , Xia Hu , Tianlong Chen

Optimization is as much about modeling the right problem as solving it. Identifying the right objectives, constraints, and trade-offs demands extensive interaction between researchers and stakeholders. Large language models can empower…

Artificial Intelligence · Computer Science 2026-04-06 Joshua Drossman , Alexandre Jacquillat , Sébastien Martin

Task oriented dialogue systems (TOD) complete particular tasks based on user preferences across natural language interactions. Considering the impressive performance of large language models (LLMs) in natural language processing (NLP)…

Computation and Language · Computer Science 2025-10-08 Arezoo Saedi , Afsaneh Fatemi , Mohammad Ali Nematbakhsh , Sophie Rosset , Anne Vilnat

This paper introduces a novel approach to Dialogue State Tracking (DST) that leverages Large Language Models (LLMs) to generate natural language descriptions of dialogue states, moving beyond traditional slot-value representations.…

Computation and Language · Computer Science 2025-03-13 Rafael Carranza , Mateo Alejandro Rojas

Large Language Models (LLMs) and Multimodal LLMs (MLLMs) have demonstrated immense potential in autonomous driving (AD) by offering human-like reasoning and open-world generalization. However, the excessive computational overhead and high…

Robotics · Computer Science 2026-05-26 Ruoyu Yao , Ruiguo Zhong , Pei Liu , Mingxing Peng , Rui Yang , Jun Ma

Large language models, LLMs, are increasingly deployed in multiturn settings where earlier responses shape later ones, making reliability dependent on whether a conversation remains consistent over time. When this consistency degrades…

Computation and Language · Computer Science 2026-04-20 Wael Hafez , Amir Nazeri

Large language models (LLMs) achieve impressive performance when a task is fully specified in a single turn, yet the same models lose up to 39% of that performance when the identical task is revealed incrementally across multiple turns, a…

Computation and Language · Computer Science 2026-05-27 Ramakrishna Vamsi Setti , Jagadeesh Rachapudi , Sachin Chaudhary , Praful Hambarde , Amit Shukla

With the recent emergence of powerful instruction-tuned large language models (LLMs), various helpful conversational Artificial Intelligence (AI) systems have been deployed across many applications. When prompted by users, these AI systems…

Computation and Language · Computer Science 2024-10-15 Akash Gupta , Ivaxi Sheth , Vyas Raina , Mark Gales , Mario Fritz

Diagnosing student problem behaviors requires teachers to synthesize multifaceted information, identify behavioral categories, and plan intervention strategies. Although fine-tuned large language models (LLMs) can support this process…

Computation and Language · Computer Science 2026-04-27 Zhilin Fan , Deliang Wang , Penghe Chen , Yu Lu

Supervised fine-tuning (SFT) has emerged as one of the most effective ways to improve the performance of large language models (LLMs) in downstream tasks. However, SFT can have difficulty generalizing when the underlying data distribution…

Computation and Language · Computer Science 2025-12-15 Mrinal Rawat , Arkajyoti Chakraborty , Neha Gupta , Roberto Pieraccini

We introduce a dynamic benchmarking system for conversational agents that evaluates their performance through a single, simulated, and lengthy user$\leftrightarrow$agent interaction. The interaction is a conversation between the user and…

Computation and Language · Computer Science 2024-10-14 David Castillo-Bolado , Joseph Davidson , Finlay Gray , Marek Rosa

Modeling plausible student misconceptions is critical for AI in education. In this work, we examine how large language models (LLMs) reason about misconceptions when generating multiple-choice distractors, a task that requires modeling…

Computation and Language · Computer Science 2026-03-17 Yanick Zengaffinen , Andreas Opedal , Donya Rooein , Kv Aditya Srivatsa , Shashank Sonkar , Mrinmaya Sachan

We present a generative dialogue system capable of operating in a full-duplex manner, allowing for seamless interaction. It is based on a large language model (LLM) carefully aligned to be aware of a perception module, a motor function…

Computation and Language · Computer Science 2024-10-30 Peng Wang , Songshuo Lu , Yaohua Tang , Sijie Yan , Wei Xia , Yuanjun Xiong

Large Language Models (LLMs) are democratizing access to personalized tutoring; however, their effectiveness is hindered by challenges in processing multimodal content, which limits AI's potential to provide equitable, high-quality STEM…

Task-orientated conversational agents interact with users and assist them via leveraging external APIs. A typical task-oriented conversational system can be broken down into three phases: external API selection, argument filling, and…

Computation and Language · Computer Science 2024-07-18 Jisoo Mok , Mohammad Kachuee , Shuyang Dai , Shayan Ray , Tara Taghavi , Sungroh Yoon