English
Related papers

Related papers: Incremental Embedding Learning via Zero-Shot Trans…

200 papers

Matching images and sentences demands a fine understanding of both modalities. In this paper, we propose a new system to discriminatively embed the image and text to a shared visual-textual space. In this field, most existing works apply…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Zhedong Zheng , Liang Zheng , Michael Garrett , Yi Yang , Mingliang Xu , Yi-Dong Shen

Deep learning architectures exhibit a critical drop of performance due to catastrophic forgetting when they are required to incrementally learn new tasks. Contemporary incremental learning frameworks focus on image classification and object…

Computer Vision and Pattern Recognition · Computer Science 2019-09-18 Umberto Michieli , Pietro Zanuttigh

Incremental learning aims to learn new tasks sequentially without forgetting the previously learned ones. Most of the existing incremental learning methods for audio focus on training the model from scratch on the initial task, and the same…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-29 Manjunath Mulimani , Annamaria Mesaros

Existing zero-shot cross-lingual transfer methods rely on parallel corpora or bilingual dictionaries, which are expensive and impractical for low-resource languages. To disengage from these dependencies, researchers have explored training…

Computation and Language · Computer Science 2022-10-19 Kunbo Ding , Weijie Liu , Yuejian Fang , Weiquan Mao , Zhe Zhao , Tao Zhu , Haoyan Liu , Rong Tian , Yiren Chen

In class-incremental learning, the model is expected to learn new classes continually while maintaining knowledge on previous classes. The challenge here lies in preserving the model's ability to effectively represent prior classes in the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Arjun Ashok , K J Joseph , Vineeth Balasubramanian

Human beings not only have the ability to recognize novel unseen classes, but also can incrementally incorporate the new classes to existing knowledge preserved. However, zero-shot learning models assume that all seen classes should be…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Sixiao Zheng , Yanwei Fu , Yanxi Hou

Catastrophic forgetting is a problem of neural networks that loses the information of the first task after training the second task. Here, we propose a method, i.e. incremental moment matching (IMM), to resolve this problem. IMM…

Machine Learning · Computer Science 2018-01-31 Sang-Woo Lee , Jin-Hwa Kim , Jaehyun Jun , Jung-Woo Ha , Byoung-Tak Zhang

Multi-class supervised learning systems require the knowledge of the entire range of labels they predict. Often when learnt incrementally, they suffer from catastrophic forgetting. To avoid this, generous leeways have to be made to the…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Ragav Venkatesan , Hemanth Venkateswara , Sethuraman Panchanathan , Baoxin Li

In general class-incremental learning, researchers typically use sample sets as a tool to avoid catastrophic forgetting during continuous learning. At the same time, researchers have also noted the differences between class-incremental…

Machine Learning · Computer Science 2024-08-16 Weimin Yin , Bin Chen adn Chunzhao Xie , Zhenhao Tan

Given the semantic descriptions of classes, Zero-Shot Learning (ZSL) aims to recognize unseen classes without labeled training data by exploiting semantic information, which contains knowledge between seen and unseen classes. Existing ZSL…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Vivek Chalumuri , Bac Nguyen

Zero-shot inference is a powerful paradigm that enables the use of large pretrained models for downstream classification tasks without further training. However, these models are vulnerable to inherited biases that can impact their…

Machine Learning · Computer Science 2024-02-13 Dyah Adila , Changho Shin , Linrong Cai , Frederic Sala

Class incremental learning consists in training discriminative models to classify an increasing number of classes over time. However, doing so using only the newly added class data leads to the known problem of catastrophic forgetting of…

Machine Learning · Computer Science 2024-05-15 Quentin Ferdinand , Gilles Le Chenadec , Benoit Clement , Panagiotis Papadakis , Quentin Oliveau

A catastrophic forgetting problem makes deep neural networks forget the previously learned information, when learning data collected in new environments, such as by different sensors or in different light conditions. This paper presents a…

Machine Learning · Computer Science 2016-07-04 Heechul Jung , Jeongwoo Ju , Minju Jung , Junmo Kim

Over the past years, semantic segmentation, as many other tasks in computer vision, benefited from the progress in deep neural networks, resulting in significantly improved performance. However, deep architectures trained with…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Guanglei Yang , Enrico Fini , Dan Xu , Paolo Rota , Mingli Ding , Hao Tang , Xavier Alameda-Pineda , Elisa Ricci

Incremental learning suffers from two challenging problems; forgetting of old knowledge and intransigence on learning new knowledge. Prediction by the model incrementally learned with a subset of the dataset are thus uncertain and the…

Machine Learning · Computer Science 2019-02-05 Dahyun Kim , Jihwan Bae , Yeonsik Jo , Jonghyun Choi

Network representation learning, as an approach to learn low dimensional representations of vertices, has attracted considerable research attention recently. It has been proven extremely useful in many machine learning tasks over large…

Machine Learning · Computer Science 2019-06-11 Hao Peng , Jianxin Li , Hao Yan , Qiran Gong , Senzhang Wang , Lin Liu , Lihong Wang , Xiang Ren

Zero-shot learning (ZSL) can be formulated as a cross-domain matching problem: after being projected into a joint embedding space, a visual sample will match against all candidate class-level semantic descriptions and be assigned to the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Lei Zhang , Peng Wang , Lingqiao Liu , Chunhua Shen , Wei Wei , Yannning Zhang , Anton Van Den Hengel

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunlong Yu , Zhong Ji , Xi Li , Jichang Guo , Zhongfei Zhang , Haibin Ling , Fei Wu

Deep learning has significantly improved the precision of instance segmentation with abundant labeled data. However, in many areas like medical and manufacturing, collecting sufficient data is extremely hard and labeling this data requires…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Ye Zheng , Jiahong Wu , Yongqiang Qin , Faen Zhang , Li Cui

Recent mask proposal models have significantly improved the performance of zero-shot semantic segmentation. However, the use of a `background' embedding during training in these methods is problematic as the resulting model tends to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Son Duy Dao , Hengcan Shi , Dinh Phung , Jianfei Cai