English
Related papers

Related papers: SGD-X: A Benchmark for Robust Generalization in Sc…

200 papers

Spoken dialogue modeling poses challenges beyond text-based language modeling, requiring real-time interaction, turn-taking, and backchanneling. While most Spoken Dialogue Models (SDMs) operate in half-duplex mode-processing one turn at a…

Computation and Language · Computer Science 2025-08-19 Guan-Ting Lin , Jiachen Lian , Tingle Li , Qirui Wang , Gopala Anumanchipalli , Alexander H. Liu , Hung-yi Lee

Instruction tuning is an emergent paradigm in NLP wherein natural language instructions are leveraged with language models to induce zero-shot performance on unseen tasks. Instructions have been shown to enable good performance on unseen…

Computation and Language · Computer Science 2022-10-27 Prakhar Gupta , Cathy Jiao , Yi-Ting Yeh , Shikib Mehri , Maxine Eskenazi , Jeffrey P. Bigham

With the development of foundation models such as large language models, zero-shot transfer learning has become increasingly significant. This is highlighted by the generative capabilities of NLP models like GPT-4, and the retrieval-based…

Machine Learning · Computer Science 2024-06-25 Yuhan Li , Peisong Wang , Zhixun Li , Jeffrey Xu Yu , Jia Li

Zero-shot Dialogue State Tracking (DST) addresses the challenge of acquiring and annotating task-oriented dialogues, which can be time-consuming and costly. However, DST extends beyond simple slot-filling and requires effective updating…

Computation and Language · Computer Science 2023-11-28 Yuxiang Wu , Guanting Dong , Weiran Xu

The increasing capability of large language models (LLMs) to generate synthetic content has heightened concerns about their misuse, driving the development of Machine-Generated Text (MGT) detection models. However, these detectors face…

Computation and Language · Computer Science 2025-07-02 Haoyi Li , Angela Yifei Yuan , Soyeon Caren Han , Christopher Leckie

For task-oriented dialog systems to be maximally useful, it must be able to process conversations in a way that is (1) generalizable with a small number of training examples for new task domains, and (2) robust to user input in various…

Computation and Language · Computer Science 2021-01-01 Baolin Peng , Chunyuan Li , Zhu Zhang , Chenguang Zhu , Jinchao Li , Jianfeng Gao

Dialogue state tracking (DST) is a key component of task-oriented dialogue systems. DST estimates the user's goal at each user turn given the interaction until then. State of the art approaches for state tracking rely on deep learning…

Computation and Language · Computer Science 2018-01-03 Abhinav Rastogi , Dilek Hakkani-Tur , Larry Heck

Dialogue State Tracking (DST) aims to keep track of users' intentions during the course of a conversation. In DST, modelling the relations among domains and slots is still an under-studied problem. Existing approaches that have considered…

Computation and Language · Computer Science 2022-04-18 Yue Feng , Aldo Lipani , Fanghua Ye , Qiang Zhang , Emine Yilmaz

Dialogue State Tracking (DST), a crucial component of task-oriented dialogue (ToD) systems, keeps track of all important information pertaining to dialogue history: filling slots with the most probable values throughout the conversation.…

Computation and Language · Computer Science 2023-02-28 Han Zhou , Ignacio Iacobacci , Pasquale Minervini

Zero-shot cross-domain dialogue state tracking (DST) enables us to handle task-oriented dialogue in unseen domains without the expense of collecting in-domain data. In this paper, we propose a slot description enhanced generative approach…

Computation and Language · Computer Science 2021-05-11 Zhaojiang Lin , Bing Liu , Seungwhan Moon , Paul Crook , Zhenpeng Zhou , Zhiguang Wang , Zhou Yu , Andrea Madotto , Eunjoon Cho , Rajen Subba

Generalization and reliability of multilingual translation often highly depend on the amount of available parallel data for each language pair of interest. In this paper, we focus on zero-shot generalization---a challenging setup that tests…

Machine Learning · Computer Science 2019-04-11 Maruan Al-Shedivat , Ankur P. Parikh

Machine learning has made tremendous progress in recent years, with models matching or even surpassing humans on a series of specialized tasks. One key element behind the progress of machine learning in recent years has been the ability to…

Machine Learning · Computer Science 2020-06-30 Giorgi Nadiradze , Ilia Markov , Bapi Chatterjee , Vyacheslav Kungurtsev , Dan Alistarh

We present an approach to build Large Language Model (LLM) based slot-filling system to perform Dialogue State Tracking in conversational assistants serving across a wide variety of industry-grade applications. Key requirements of this…

Machine learning models trained with \emph{stochastic} gradient descent (SGD) can generalize better than those trained with deterministic gradient descent (GD). In this work, we study SGD's impact on generalization through the lens of the…

Machine Learning · Computer Science 2025-12-09 Hongjian Lan , Yucong Liu , Florian Schäfer

To train a statistical spoken dialogue system (SDS) it is essential that an accurate method for measuring task success is available. To date training has relied on presenting a task to either simulated or paid users and inferring the…

Machine Learning · Computer Science 2015-08-17 Pei-Hao Su , David Vandyke , Milica Gasic , Dongho Kim , Nikola Mrksic , Tsung-Hsien Wen , Steve Young

In this paper, we present a neural spoken language diarization model that supports an unconstrained span of languages within a single framework. Our approach integrates a learnable query-based architecture grounded in multilingual…

Computation and Language · Computer Science 2025-10-02 Sangmin Lee , Woongjib Choi , Jihyun Kim , Hong-Goo Kang

Conversational question answering systems often rely on semantic parsing to enable interactive information retrieval, which involves the generation of structured database queries from a natural language input. For information-seeking…

Computation and Language · Computer Science 2024-01-04 Phillip Schneider , Manuel Klettner , Kristiina Jokinen , Elena Simperl , Florian Matthes

State-of-the-art stereo matching (SM) models trained on synthetic data often fail to generalize to real data domains due to domain differences, such as color, illumination, contrast, and texture. To address this challenge, we leverage data…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Shuangli Du , Jing Wang , Minghua Zhao , Zhenyu Xu , Jie Li

Achieving natural full-duplex interaction in spoken dialogue systems (SDS) remains a challenge due to the difficulty of accurately detecting user interruptions. Current solutions are polarized between "trigger-happy" VAD-based methods that…

Sound · Computer Science 2026-03-26 Kangxiang Xia , Bingshen Mu , Xian Shi , Jin Xu , Lei Xie

Carefully-designed schemas describing how to collect and annotate dialog corpora are a prerequisite towards building task-oriented dialog systems. In practical applications, manually designing schemas can be error-prone, laborious,…

Computation and Language · Computer Science 2022-05-11 Dian Yu , Mingqiu Wang , Yuan Cao , Izhak Shafran , Laurent El Shafey , Hagen Soltau