中文
相关论文

相关论文: CSS: Combining Self-training and Self-supervised L…

200 篇论文

In this paper, we explore how to utilize pre-trained language model to perform few-shot text classification where only a few annotated examples are given for each class. Since using traditional cross-entropy loss to fine-tune language model…

计算与语言 · 计算机科学 2022-10-03 Liwen Sun , Jiawei Han

Few-shot learning is a promising way for reducing the label cost in new categories adaptation with the guidance of a small, well labeled support set. But for few-shot semantic segmentation, the pixel-level annotations of support images are…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Jing Wang , Yuang Liu , Qiang Zhou , Fan Wang

Slot filling is one of the critical tasks in modern conversational systems. The majority of existing literature employs supervised learning methods, which require labeled training data for each new domain. Zero-shot learning and weak…

计算与语言 · 计算机科学 2023-03-27 Adib Mosharrof , Moghis Fereidouni , A. B. Siddique

The goal of this paper is to bypass the need for labelled examples in few-shot video understanding at run time. While proven effective, in many practical video settings even labelling a few examples appears unrealistic. This is especially…

计算机视觉与模式识别 · 计算机科学 2022-04-20 Pengwan Yang , Yuki M. Asano , Pascal Mettes , Cees G. M. Snoek

Few-shot learning is challenging due to its very limited data and labels. Recent studies in big transfer (BiT) show that few-shot learning can greatly benefit from pretraining on large scale labeled dataset in a different domain. This paper…

计算机视觉与模式识别 · 计算机科学 2020-12-11 Suichan Li , Dongdong Chen , Yinpeng Chen , Lu Yuan , Lei Zhang , Qi Chu , Nenghai Yu

Few-shot learning (FSL) techniques seek to learn the underlying patterns in data using fewer samples, analogous to how humans learn from limited experience. In this limited-data scenario, the challenges associated with deep neural networks,…

计算机视觉与模式识别 · 计算机科学 2023-04-14 Deepan Chakravarthi Padmanabhan , Shruthi Gowda , Elahe Arani , Bahram Zonooz

Dialogue State Tracking (DST) is crucial for understanding user needs and executing appropriate system actions in task-oriented dialogues. Majority of existing DST methods are designed to work within predefined ontologies and assume the…

计算与语言 · 计算机科学 2025-03-11 Abdulfattah Safa , Gözde Gül Şahin

Training the generative models with minimal corpus is one of the critical challenges for building open-domain dialogue systems. Existing methods tend to use the meta-learning framework which pre-trains the parameters on all non-target tasks…

计算与语言 · 计算机科学 2020-05-14 Yiping Song , Zequn Liu , Wei Bi , Rui Yan , Ming Zhang

Few-shot learning (FSL) has attracted considerable attention recently. Among existing approaches, the metric-based method aims to train an embedding network that can make similar samples close while dissimilar samples as far as possible and…

计算机视觉与模式识别 · 计算机科学 2022-10-13 Bin Xiao , Chien-Liang Liu , Wen-Hoar Hsaio

The performance of automatic speech recognition (ASR) systems typically degrades significantly when the training and test data domains are mismatched. In this paper, we show that self-training (ST) combined with an uncertainty-based…

计算与语言 · 计算机科学 2021-02-17 Sameer Khurana , Niko Moritz , Takaaki Hori , Jonathan Le Roux

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

计算机视觉与模式识别 · 计算机科学 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

We address a novel cross-domain few-shot learning task (CD-FSL) with multimodal input and unlabeled target data for egocentric action recognition. This paper simultaneously tackles two critical challenges associated with egocentric action…

计算机视觉与模式识别 · 计算机科学 2024-07-17 Masashi Hatano , Ryo Hachiuma , Ryo Fujii , Hideo Saito

Few-shot multimodal dialogue intention recognition is a critical challenge in the e-commerce domainn. Previous methods have primarily enhanced model classification capabilities through post-training techniques. However, our analysis reveals…

计算与语言 · 计算机科学 2025-03-07 Bin Chen , Yu Zhang , Hongfei Ye , Ziyi Huang , Hongyang Chen

Semi-supervised learning (SSL) has garnered significant attention due to its ability to leverage limited labeled data and a large amount of unlabeled data to improve model generalization performance. Recent approaches achieve impressive…

计算机视觉与模式识别 · 计算机科学 2025-03-05 Bo Cheng , Jueqing Lu , Yuan Tian , Haifeng Zhao , Yi Chang , Lan Du

In this paper, we investigate few-shot joint learning for dialogue language understanding. Most existing few-shot models learn a single task each time with only a few examples. However, dialogue language understanding contains two closely…

计算与语言 · 计算机科学 2021-06-15 Yutai Hou , Yongkui Lai , Cheng Chen , Wanxiang Che , Ting Liu

The lack of labeled data is a common challenge in speech classification tasks, particularly those requiring extensive subjective assessment, such as cognitive state classification. In this work, we propose a Semi-Supervised Learning (SSL)…

音频与语音处理 · 电气工程与系统科学 2025-05-01 Yuanchao Li , Zixing Zhang , Jing Han , Peter Bell , Catherine Lai

Self-training has shown great potential in semi-supervised learning. Its core idea is to use the model learned on labeled data to generate pseudo-labels for unlabeled samples, and in turn teach itself. To obtain valid supervision, active…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Ye Du , Yujun Shen , Haochen Wang , Jingjing Fei , Wei Li , Liwei Wu , Rui Zhao , Zehua Fu , Qingjie Liu

Existing dialog state tracking (DST) models are trained with dialog data in a random order, neglecting rich structural information in a dataset. In this paper, we propose to use curriculum learning (CL) to better leverage both the…

计算与语言 · 计算机科学 2021-06-02 Yinpei Dai , Hangyu Li , Yongbin Li , Jian Sun , Fei Huang , Luo Si , Xiaodan Zhu

State-of-the-art deep neural networks require large-scale labeled training data that is often expensive to obtain or not available for many tasks. Weak supervision in the form of domain-specific rules has been shown to be useful in such…

计算与语言 · 计算机科学 2021-04-13 Giannis Karamanolakis , Subhabrata Mukherjee , Guoqing Zheng , Ahmed Hassan Awadallah

We present a technique to improve the transferability of deep representations learned on small labeled datasets by introducing self-supervised tasks as auxiliary loss functions. While recent approaches for self-supervised learning have…

计算机视觉与模式识别 · 计算机科学 2019-06-18 Jong-Chyi Su , Subhransu Maji , Bharath Hariharan