English
Related papers

Related papers: CSS: Combining Self-training and Self-supervised L…

200 papers

In task-oriented dialogue systems, Dialogue State Tracking (DST) aims to extract users' intentions from the dialogue history. Currently, most existing approaches suffer from error propagation and are unable to dynamically select relevant…

Computation and Language · Computer Science 2023-03-08 Jing Xu , Dandan Song , Chong Liu , Siu Cheung Hui , Fei Li , Qiang Ju , Xiaonan He , Jian Xie

We present streaming self-training (SST) that aims to democratize the process of learning visual recognition models such that a non-expert user can define a new task depending on their needs via a few labeled examples and minimal domain…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Zhiqiu Lin , Deva Ramanan , Aayush Bansal

Dialogue State Tracking (DST) is of paramount importance in ensuring accurate tracking of user goals and system actions within task-oriented dialogue systems. The emergence of large language models (LLMs) such as GPT3 and ChatGPT has…

Computation and Language · Computer Science 2023-10-24 Yujie Feng , Zexin Lu , Bo Liu , Liming Zhan , Xiao-Ming Wu

Unlike traditional supervised learning, in many settings only partial feedback is available. We may only observe outcomes for the chosen actions, but not the counterfactual outcomes associated with other alternatives. Such settings…

Machine Learning · Computer Science 2021-12-09 Ruijiang Gao , Max Biggs , Wei Sun , Ligong Han

Dialog State Tracking (DST), an integral part of modern dialog systems, aims to track user preferences and constraints (slots) in task-oriented dialogs. In real-world settings with constantly changing services, DST systems must generalize…

Computation and Language · Computer Science 2021-01-22 Shuyang Li , Jin Cao , Mukund Sridhar , Henghui Zhu , Shang-Wen Li , Wael Hamza , Julian McAuley

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

Computation and Language · Computer Science 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

Zero-shot Dialogue State Tracking (DST) addresses the challenge of acquiring and annotating task-oriented dialogues, which can be time-consuming and costly. However, DST extends beyond simple slot-filling and requires effective updating…

Computation and Language · Computer Science 2023-11-28 Yuxiang Wu , Guanting Dong , Weiran Xu

Few-shot text classification aims to recognize unseen classes with limited labeled text samples. Existing approaches focus on boosting meta-learners by developing complex algorithms in the training stage. However, the labeled samples are…

Machine Learning · Computer Science 2026-03-04 Yunlong Gao , Xinyue Liu , Yingbo Wang , Linlin Zong , Bo Xu

Task-oriented dialogue systems use four connected modules, namely, Natural Language Understanding (NLU), a Dialogue State Tracking (DST), Dialogue Policy (DP) and Natural Language Generation (NLG). A research challenge is to learn each…

Computation and Language · Computer Science 2020-08-21 Andrea Madotto , Zihan Liu , Zhaojiang Lin , Pascale Fung

Dialogue State Tracking (DST), which is the process of inferring user goals by estimating belief states given the dialogue history, plays a critical role in task-oriented dialogue systems. A coreference phenomenon observed in multi-turn…

Computation and Language · Computer Science 2021-06-17 Ting Han , Chongxuan Huang , Wei Peng

Conventional text style transfer approaches focus on sentence-level style transfer without considering contextual information, and the style is described with attributes (e.g., formality). When applying style transfer in conversations such…

Computation and Language · Computer Science 2023-09-25 Shamik Roy , Raphael Shu , Nikolaos Pappas , Elman Mansimov , Yi Zhang , Saab Mansour , Dan Roth

Dialogue state tracking (DST) is an essential sub-task for task-oriented dialogue systems. Recent work has focused on deep neural models for DST. However, the neural models require a large dataset for training. Furthermore, applying them to…

Computation and Language · Computer Science 2022-10-06 Hyunmin Jeon , Gary Geunbae Lee

A recent study finds that existing few-shot learning methods, trained on the source domain, fail to generalize to the novel target domain when a domain gap is observed. This motivates the task of Cross-Domain Few-Shot Learning (CD-FSL). In…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Yuqian Fu , Yanwei Fu , Yu-Gang Jiang

The domain shift between the source and target domain is the main challenge in Cross-Domain Few-Shot Learning (CD-FSL). However, the target domain is absolutely unknown during the training on the source domain, which results in lacking…

Computer Vision and Pattern Recognition · Computer Science 2021-09-06 Xiyao Liu , Zhong Ji , Yanwei Pang , Zhongfei Zhang

Recent work on few-shot learning \cite{tian2020rethinking} showed that quality of learned representations plays an important role in few-shot classification performance. On the other hand, the goal of self-supervised learning is to recover…

Machine Learning · Computer Science 2021-01-26 Nathaniel Simard , Guillaume Lagrange

Few-shot node classification poses a significant challenge for Graph Neural Networks (GNNs) due to insufficient supervision and potential distribution shifts between labeled and unlabeled nodes. Self-training has emerged as a widely popular…

Machine Learning · Computer Science 2024-01-22 Fali Wang , Tianxiang Zhao , Suhang Wang

For training a few-shot keyword spotting (FS-KWS) model, a large labeled dataset containing massive target keywords has known to be essential to generalize to arbitrary target keywords with only a few enrollment samples. To alleviate the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-10 Dongjune Lee , Minchan Kim , Sung Hwan Mun , Min Hyun Han , Nam Soo Kim

Currently, under supervised learning, a model pretrained by a large-scale nature scene dataset and then fine-tuned on a few specific task labeling data is the paradigm that has dominated the knowledge transfer learning. It has reached the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Tong Zhang , Peng Gao , Hao Dong , Yin Zhuang , Guanqun Wang , Wei Zhang , He Chen

Learning a new task from a handful of examples remains an open challenge in machine learning. Despite the recent progress in few-shot learning, most methods rely on supervised pretraining or meta-learning on labeled meta-training data and…

Machine Learning · Computer Science 2022-10-10 Kuilin Chen , Chi-Guhn Lee

Dialogue State Tracking (DST) is core research in dialogue systems and has received much attention. In addition, it is necessary to define a new problem that can deal with dialogue between users as a step toward the conversational AI that…

Computation and Language · Computer Science 2023-01-19 Hyungtak Choi , Hyeonmok Ko , Gurpreet Kaur , Lohith Ravuru , Kiranmayi Gandikota , Manisha Jhawar , Simma Dharani , Pranamya Patil