English
Related papers

Related papers: Step by Step to Fairness: Attributing Societal Bia…

200 papers

Task-oriented dialogue (TOD) system is designed to accomplish user-defined tasks through dialogues. The TOD system has progressed towards end-to-end modeling by leveraging pre-trained large language models. Fine-tuning the pre-trained…

Computation and Language · Computer Science 2024-11-11 Dharmendra Prajapat , Durga Toshniwal

Task-oriented dialogue (ToD) systems are designed to help users achieve specific goals through natural language interaction. While recent advances in large language models (LLMs) have significantly improved linguistic fluency and contextual…

Computation and Language · Computer Science 2025-07-03 Shutong Feng , Hsien-chin Lin , Nurul Lubis , Carel van Niekerk , Michael Heck , Benjamin Ruppik , Renato Vukovic , Milica Gašić

Most task-oriented dialogue (TOD) benchmarks assume users that know exactly how to use the system by constraining the user behaviors within the system's capabilities via strict user goals, namely "user familiarity" bias. This data bias…

Computation and Language · Computer Science 2024-07-02 Takyoung Kim , Jamin Shin , Young-Ho Kim , Sanghwan Bae , Sungdong Kim

Task-oriented dialogue (TOD) systems enable users to achieve their goals through natural language interactions. Traditionally, these systems have relied on turn-level manually annotated metadata, such as dialogue states and policy…

Computation and Language · Computer Science 2024-11-05 Adib Mosharrof , A. B. Siddique

Recently, the development of large language models (LLMs) has been significantly enhanced the question answering and dialogue generation, and makes them become increasingly popular in current practical scenarios. While unlike the general…

Computation and Language · Computer Science 2023-09-19 Zhiyuan Hu , Yue Feng , Yang Deng , Zekun Li , See-Kiong Ng , Anh Tuan Luu , Bryan Hooi

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

Computation and Language · Computer Science 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

In light of recent advances in large language models (LLMs), the expectations for the next generation of virtual assistants include enhanced naturalness and adaptability across diverse usage scenarios. However, the creation of high-quality…

Computation and Language · Computer Science 2024-06-10 Yinhong Liu , Yimai Fang , David Vandyke , Nigel Collier

Task-oriented dialogue systems have been plagued by the difficulties of obtaining large-scale and high-quality annotated conversations. Furthermore, most of the publicly available datasets only include written conversations, which are…

Computation and Language · Computer Science 2021-12-24 Xin Tian , Xinxian Huang , Dongfeng He , Yingzhan Lin , Siqi Bao , Huang He , Liankai Huang , Qiang Ju , Xiyuan Zhang , Jian Xie , Shuqi Sun , Fan Wang , Hua Wu , Haifeng Wang

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

Computation and Language · Computer Science 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

Traditionally, offline datasets have been used to evaluate task-oriented dialogue (TOD) models. These datasets lack context awareness, making them suboptimal benchmarks for conversational systems. In contrast, user-agents, which are…

Computation and Language · Computer Science 2024-11-18 Taaha Kazi , Ruiliang Lyu , Sizhe Zhou , Dilek Hakkani-Tur , Gokhan Tur

This paper studies the exposure bias problem in task-oriented dialog systems, where the model's generated content over multiple turns drives the dialog context away from the ground-truth distribution at training time, introducing error…

Computation and Language · Computer Science 2022-09-16 Yunyi Yang , Hong Ding , Qingyi Liu , Xiaojun Quan

Task-oriented dialogue (ToD) benchmarks provide an important avenue to measure progress and develop better conversational agents. However, existing datasets for end-to-end ToD modeling are limited to a single language, hindering the…

Computation and Language · Computer Science 2021-06-08 Zhaojiang Lin , Andrea Madotto , Genta Indra Winata , Peng Xu , Feijun Jiang , Yuxiang Hu , Chen Shi , Pascale Fung

Large Language Models are increasingly used in conversational systems such as digital personal assistants, shaping how people interact with technology through language. While their responses often sound fluent and natural, they can also…

Computation and Language · Computer Science 2025-12-24 Heet Bodara , Md Masum Mushfiq , Isma Farah Siddiqui

Task-Oriented Dialogue (TOD) systems have become crucial components in interactive artificial intelligence applications. While recent advances have capitalized on pre-trained language models (PLMs), they exhibit limitations regarding…

Computation and Language · Computer Science 2023-12-11 Sungryull Sohn , Yiwei Lyu , Anthony Liu , Lajanugen Logeswaran , Dong-Ki Kim , Dongsub Shim , Honglak Lee

Speech technologies are deployed in high-stakes settings, yet fairness concerns remain fragmented across tasks and disciplines. Existing surveys either adopt a general machine-learning perspective that overlooks speech-specific properties…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-05 Yi-Cheng Lin , Yun-Shao Tsai , Kuan-Yu Chen , Hsiao-Ying Huang , Huang-Cheng Chou , Hung-yi Lee

Task-oriented dialogue systems (TODS) are continuing to rise in popularity as various industries find ways to effectively harness their capabilities, saving both time and money. However, even state-of-the-art TODS are not yet reaching their…

Computation and Language · Computer Science 2022-09-07 Ryan Fellows , Hisham Ihshaish , Steve Battle , Ciaran Haines , Peter Mayhew , J. Ignacio Deza

The rapid advancement of Large Language Models (LLMs) has sparked intense debate regarding the prevalence of bias in these models and its mitigation. Yet, as exemplified by both results on debiasing methods in the literature and reports of…

Computation and Language · Computer Science 2024-05-14 David F. Jenny , Yann Billeter , Mrinmaya Sachan , Bernhard Schölkopf , Zhijing Jin

While biases in large language models (LLMs), such as stereotypes and cultural tendencies in outputs, have been examined and identified, their presence and characteristics in spoken dialogue models (SDMs) with audio input and output remain…

Computation and Language · Computer Science 2025-10-06 Yihao Wu , Tianrui Wang , Yizhou Peng , Yi-Wen Chao , Xuyi Zhuang , Xinsheng Wang , Shunshun Yin , Ziyang Ma

Achieving robust language technologies that can perform well across the world's many languages is a central goal of multilingual NLP. In this work, we take stock of and empirically analyse task performance disparities that exist between…

Computation and Language · Computer Science 2023-10-20 Songbo Hu , Han Zhou , Moy Yuan , Milan Gritta , Guchun Zhang , Ignacio Iacobacci , Anna Korhonen , Ivan Vulić

Task-oriented dialogue (TOD) systems facilitate users in executing various activities via multi-turn dialogues, but Large Language Models (LLMs) often struggle to comprehend these intricate contexts. In this study, we propose a novel…

Computation and Language · Computer Science 2023-09-25 Haoyu Gao , Ting-En Lin , Hangyu Li , Min Yang , Yuchuan Wu , Wentao Ma , Yongbin Li
‹ Prev 1 2 3 10 Next ›