中文
相关论文

相关论文: SGD-X: A Benchmark for Robust Generalization in Sc…

200 篇论文

Large language models (LLMs) have demonstrated remarkable performance in zero-shot dialogue state tracking (DST), reducing the need for task-specific training. However, conventional DST benchmarks primarily focus on structured user-agent…

计算与语言 · 计算机科学 2025-06-13 Sangmin Song , Juhwan Choi , JungMin Yun , YoungBin Kim

Despite the surging demands for multilingual task-oriented dialog systems (e.g., Alexa, Google Home), there has been less research done in multilingual or cross-lingual scenarios. Hence, we propose a zero-shot adaptation of task-oriented…

计算与语言 · 计算机科学 2019-11-12 Zihan Liu , Jamin Shin , Yan Xu , Genta Indra Winata , Peng Xu , Andrea Madotto , Pascale Fung

Zero-shot dialogue understanding aims to enable dialogue to track the user's needs without any training data, which has gained increasing attention. In this work, we investigate the understanding ability of ChatGPT for zero-shot dialogue…

计算与语言 · 计算机科学 2023-04-11 Wenbo Pan , Qiguang Chen , Xiao Xu , Wanxiang Che , Libo Qin

Automatically evaluating text-based, non-task-oriented dialogue systems (i.e., `chatbots') remains an open problem. Previous approaches have suffered challenges ranging from poor correlation with human judgment to poor generalization and…

计算与语言 · 计算机科学 2021-04-14 Ian Berlot-Attwell , Frank Rudzicz

Tracking dialogue states is an essential topic in task-oriented dialogue systems, which involve filling in the necessary information in pre-defined slots corresponding to a schema. While general pre-trained language models have been shown…

计算与语言 · 计算机科学 2023-11-14 Ruolin Su , Ting-Wei Wu , Biing-Hwang Juang

Building end-to-end task bots and maintaining their integration with new functionalities using minimal human efforts is a long-standing challenge in dialog research. Recently large language models (LLMs) have demonstrated exceptional…

计算与语言 · 计算机科学 2023-05-17 Xiaoying Zhang , Baolin Peng , Kun Li , Jingyan Zhou , Helen Meng

Most prior work in dialogue modeling has been on written conversations mostly because of existing data sets. However, written dialogues are not sufficient to fully capture the nature of spoken conversations as well as the potential speech…

A model's capacity to generalize its knowledge to interpret unseen inputs with different characteristics is crucial to build robust and reliable machine learning systems. Language model evaluation tasks lack information metrics about model…

计算与语言 · 计算机科学 2024-09-10 Saksham Bassi , Duygu Ataman , Kyunghyun Cho

Communication-efficient SGD algorithms, which allow nodes to perform local updates and periodically synchronize local models, are highly effective in improving the speed and scalability of distributed SGD. However, a rigorous convergence…

机器学习 · 计算机科学 2019-01-28 Jianyu Wang , Gauri Joshi

Task oriented dialog agents provide a natural language interface for users to complete their goal. Dialog State Tracking (DST), which is often a core component of these systems, tracks the system's understanding of the user's goal…

计算与语言 · 计算机科学 2020-02-21 Adarsh Kumar , Peter Ku , Anuj Kumar Goyal , Angeliki Metallinou , Dilek Hakkani-Tur

This paper introduces zero-shot dialog generation (ZSDG), as a step towards neural dialog systems that can instantly generalize to new situations with minimal data. ZSDG enables an end-to-end generative dialog system to generalize to a new…

计算与语言 · 计算机科学 2018-05-15 Tiancheng Zhao , Maxine Eskenazi

To facilitate zero-shot generalization in taskoriented dialog, this paper proposes Language Models as Data (LAD). LAD is a paradigm for creating diverse and accurate synthetic data which conveys the necessary structural constraints and can…

计算与语言 · 计算机科学 2022-08-01 Shikib Mehri , Yasemin Altun , Maxine Eskenazi

A major bottleneck for building statistical spoken dialogue systems for new domains and applications is the need for large amounts of training data. To address this problem, we adopt the multi-dimensional approach to dialogue management and…

计算与语言 · 计算机科学 2022-04-15 Simon Keizer , Norbert Braunschweiler , Svetlana Stoyanchev , Rama Doddipatla

Building dialogue generation systems in a zero-shot scenario remains a huge challenge, since the typical zero-shot approaches in dialogue generation rely heavily on large-scale pre-trained language generation models such as GPT-3 and T5.…

计算与语言 · 计算机科学 2022-08-19 Yongkang Liu , Shi Feng , Daling Wang , Yifei Zhang

A schema-guided approach to dialogue management has been shown in recent work to be effective in creating robust customizable virtual agents capable of acting as friendly peers or task assistants. However, successful applications of these…

人工智能 · 计算机科学 2022-07-18 Benjamin Kane , Catherine Giugno , Lenhart Schubert , Kurtis Haut , Caleb Wohn , Ehsan Hoque

The traditional Dialogue State Tracking (DST) problem aims to track user preferences and intents in user-agent conversations. While sufficient for task-oriented dialogue systems supporting narrow domain applications, the advent of Large…

The emergence of instruction-tuned large language models (LLMs) has advanced the field of dialogue systems, enabling both realistic user simulations and robust multi-turn conversational agents. However, existing research often evaluates…

计算与语言 · 计算机科学 2025-07-22 Chalamalasetti Kranti , Sherzod Hakimov , David Schlangen

We demonstrate substantial performance gains in zero-shot dialogue state tracking (DST) by enhancing training data diversity through synthetic data generation. Existing DST datasets are severely limited in the number of application domains…

计算与语言 · 计算机科学 2024-06-14 James D. Finch , Jinho D. Choi

Dialogue systems are frequently updated to accommodate new services, but naively updating them by continually training with data for new services in diminishing performance on previously learnt services. Motivated by the insight that…

Recent works that revealed the vulnerability of dialogue state tracking (DST) models to distributional shifts have made holistic comparisons on robustness and qualitative analyses increasingly important for understanding their relative…