English
Related papers

Related papers: Know Thy Strengths: Comprehensive Dialogue State T…

200 papers

Distribution shifts between training and test data are inevitable over the lifecycle of a deployed model, leading to performance decay. Adapting a model on test samples can help mitigate this drop in performance. However, most test-time…

Machine Learning · Computer Science 2025-11-18 Mona Schirmer , Dan Zhang , Eric Nalisnick

This paper describes a system that leads us to believe in the feasibility of constructing natural spoken dialogue systems in task-oriented domains. It specifically addresses the issue of robust interpretation of speech in the presence of…

cmp-lg · Computer Science 2008-02-03 James F. Allen , Bradford W. Miller , Eric K. Ringger , Teresa Sikorski

State-of-the-art dialogue models still often stumble with regards to factual accuracy and self-contradiction. Anecdotally, they have been observed to fail to maintain character identity throughout discourse; and more specifically, may take…

Computation and Language · Computer Science 2021-12-14 Kurt Shuster , Jack Urbanek , Arthur Szlam , Jason Weston

As input data distributions evolve, the predictive performance of machine learning models tends to deteriorate. In practice, new input data tend to come without target labels. Then, state-of-the-art techniques model input data distributions…

Machine Learning · Computer Science 2023-09-08 Carlos Mougan , Klaus Broelemann , David Masip , Gjergji Kasneci , Thanassis Thiropanis , Steffen Staab

Tracking the state of the conversation is a central component in task-oriented spoken dialogue systems. One such approach for tracking the dialogue state is slot carryover, where a model makes a binary decision if a slot from the context is…

Computation and Language · Computer Science 2019-06-05 Tongfei Chen , Chetan Naik , Hua He , Pushpendre Rastogi , Lambert Mathias

There is a multitude of novel generative models for open-domain conversational systems; however, there is no systematic evaluation of different systems. Systematic comparisons require consistency in experimental design, evaluation sets,…

Computation and Language · Computer Science 2020-10-27 Seolhwa Lee , Heuiseok Lim , João Sedoc

Dialogue state trackers have made significant progress on benchmark datasets, but their generalization capability to novel and realistic scenarios beyond the held-out conversations is less understood. We propose controllable counterfactuals…

Computation and Language · Computer Science 2021-03-29 Shiyang Li , Semih Yavuz , Kazuma Hashimoto , Jia Li , Tong Niu , Nazneen Rajani , Xifeng Yan , Yingbo Zhou , Caiming Xiong

Despite their recent success, deep neural networks continue to perform poorly when they encounter distribution shifts at test time. Many recently proposed approaches try to counter this by aligning the model to the new distribution prior to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-26 Samarth Sinha , Peter Gehler , Francesco Locatello , Bernt Schiele

The problem of synthetic speech detection has enjoyed considerable attention, with recent methods achieving low error rates across several established benchmarks. However, to what extent can low error rates on academic benchmarks translate…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-23 Ashi Garg , Zexin Cai , Lin Zhang , Henry Li Xinyuan , Leibny Paola García-Perera , Kevin Duh , Sanjeev Khudanpur , Matthew Wiesner , Nicholas Andrews

From past couple of years there is a cycle of researchers proposing a defence model for adversaries in machine learning which is arguably defensible to most of the existing attacks in restricted condition (they evaluate on some bounded…

Cryptography and Security · Computer Science 2022-02-21 Kanak Tekwani , Manojkumar Parmar

A major bottleneck for building statistical spoken dialogue systems for new domains and applications is the need for large amounts of training data. To address this problem, we adopt the multi-dimensional approach to dialogue management and…

Computation and Language · Computer Science 2022-04-15 Simon Keizer , Norbert Braunschweiler , Svetlana Stoyanchev , Rama Doddipatla

Sequence-to-sequence state-of-the-art systems for dialogue state tracking (DST) use the full dialogue history as input, represent the current state as a list with all the slots, and generate the entire state from scratch at each dialogue…

Computation and Language · Computer Science 2024-10-17 Pietro Lesci , Yoshinari Fujinuma , Momchil Hardalov , Chao Shang , Yassine Benajiba , Lluis Marquez

Deep learning models excel at many tasks but rely on the assumption that training and test data follow the same distribution. This assumption often does not hold in real-world speech systems, where distribution shifts are common due to…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-06 Bronya Roni Chernyak , Yael Segal , Yosi Shrem , Joseph Keshet

Existing dialogue state tracking (DST) models require plenty of labeled data. However, collecting high-quality labels is costly, especially when the number of domains increases. In this paper, we address a practical DST problem that is…

Computation and Language · Computer Science 2020-10-28 Chien-Sheng Wu , Steven Hoi , Caiming Xiong

Deep learning (DL) models have seen increased attention for time series forecasting, yet the application on cyber-physical systems (CPS) is hindered by the lacking robustness of these methods. Thus, this study evaluates the robustness and…

Machine Learning · Computer Science 2023-06-14 Alexander Windmann , Henrik Steude , Oliver Niggemann

Though deep neural networks have achieved impressive success on various vision tasks, obvious performance degradation still exists when models are tested in out-of-distribution scenarios. In addressing this limitation, we ponder that the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Xiaotong Li , Zixuan Hu , Jun Liu , Yixiao Ge , Yongxing Dai , Ling-Yu Duan

In open-domain dialogues, predictive uncertainties are mainly evaluated in a domain shift setting to cope with out-of-distribution inputs. However, in real-world conversations, there could be more extensive distributional shifted inputs…

Computation and Language · Computer Science 2021-09-02 Nyoungwoo Lee , ChaeHun Park , Ho-Jin Choi

Speech distortions are a long-standing problem that degrades the performance of supervisely trained speech processing models. It is high time that we enhance the robustness of speech processing models to obtain good performance when…

Sound · Computer Science 2022-07-26 Kuan Po Huang , Yu-Kuan Fu , Yu Zhang , Hung-yi Lee

Stance detection plays a pivotal role in enabling an extensive range of downstream applications, from discourse parsing to tracing the spread of fake news and the denial of scientific facts. While most stance classification models rely on…

Computation and Language · Computer Science 2024-12-13 Guy Barel , Oren Tsur , Dan Vilenchik

Diffusion models have achieved remarkable success in text-to-speech (TTS), even in zero-shot scenarios. Recent efforts aim to address the trade-off between inference speed and sound quality, often considered the primary drawback of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-14 Changjin Han , Seokgi Lee , Gyuhyeon Nam , Gyeongsu Chae