English
Related papers

Related papers: Bookworm continual learning: beyond zero-shot lear…

200 papers

We present a continuous formulation of machine learning, as a problem in the calculus of variations and differential-integral equations, in the spirit of classical numerical analysis. We demonstrate that conventional machine learning models…

Numerical Analysis · Mathematics 2020-10-02 Weinan E , Chao Ma , Lei Wu

In this paper, we address zero-shot learning (ZSL), the problem of recognizing categories for which no labeled visual data are available during training. We focus on the transductive setting, in which unlabelled visual data from unseen…

Computer Vision and Pattern Recognition · Computer Science 2021-09-15 Federico Marmoreo , Jacopo Cavazza , Vittorio Murino

Zero-shot learning, which studies the problem of object classification for categories for which we have no training examples, is gaining increasing attention from community. Most existing ZSL methods exploit deterministic transfer learning…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Yanan Li , Donghui Wang

Continual learning (CL) -- the ability to continuously learn, building on previously acquired knowledge -- is a natural requirement for long-lived autonomous reinforcement learning (RL) agents. While building such agents, one needs to…

Machine Learning · Computer Science 2021-10-29 Maciej Wołczyk , Michał Zając , Razvan Pascanu , Łukasz Kuciński , Piotr Miłoś

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be…

Machine Learning · Computer Science 2023-06-23 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Bing Liu

Zero-shot learning (ZSL) is a popular research problem that aims at predicting for those classes that have never appeared in the training stage by utilizing the inter-class relationship with some side information. In this study, we propose…

Artificial Intelligence · Computer Science 2020-07-01 Jiaoyan Chen , Freddy Lecue , Yuxia Geng , Jeff Z. Pan , Huajun Chen

Zero-shot learning (ZSL) is a framework to classify images belonging to unseen classes based on solely semantic information about these unseen classes. In this paper, we propose a new ZSL algorithm using coupled dictionary learning. The…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Mohammad Rostami , Soheil Kolouri , Zak Murez , Yuri Owekcho , Eric Eaton , Kuyngnam Kim

This paper explores useful modifications of the recent development in contrastive learning via novel probabilistic modeling. We derive a particular form of contrastive loss named Joint Contrastive Learning (JCL). JCL implicitly involves the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Qi Cai , Yu Wang , Yingwei Pan , Ting Yao , Tao Mei

General-purpose learning systems should improve themselves in open-ended fashion in ever-changing environments. Conventional learning algorithms for neural networks, however, suffer from catastrophic forgetting (CF), i.e., previously…

Machine Learning · Computer Science 2025-02-18 Kazuki Irie , Róbert Csordás , Jürgen Schmidhuber

Zero-shot learning (ZSL) aims to recognize unseen objects using disjoint seen objects via sharing attributes. The generalization performance of ZSL is governed by the attributes, which transfer semantic information from seen classes to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Xiaofeng Xu , Ivor W. Tsang , Chuancai Liu

Multi-label zero-shot learning (ZSL) is a more realistic counter-part of standard single-label ZSL since several objects can co-exist in a natural image. However, the occurrence of multiple objects complicates the reasoning and requires…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Sanath Narayan , Akshita Gupta , Salman Khan , Fahad Shahbaz Khan , Ling Shao , Mubarak Shah

Zero-shot learning (ZSL) is a promising approach to generalizing a model to categories unseen during training by leveraging class attributes, but challenges remain. Recently, methods using generative models to combat bias towards classes…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Vinay K Verma , Nikhil Mehta , Kevin J Liang , Aakansha Mishra , Lawrence Carin

Generalized zero-shot learning (GZSL) aims to train a model for classifying data samples under the condition that some output classes are unknown during supervised learning. To address this challenging task, GZSL leverages semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Farhad Pourpanah , Moloud Abdar , Yuxuan Luo , Xinlei Zhou , Ran Wang , Chee Peng Lim , Xi-Zhao Wang , Q. M. Jonathan Wu

Humans can learn a variety of concepts and skills incrementally over the course of their lives while exhibiting many desirable properties, such as continual learning without forgetting, forward transfer and backward transfer of knowledge,…

Machine Learning · Computer Science 2020-06-17 Charles X. Ling , Tanner Bohn

Online Continual Learning (OCL) studies learning over a continuous data stream without observing any single example more than once, a setting that is closer to the experience of humans and systems that must learn "on-the-wild". Yet,…

Computation and Language · Computer Science 2021-02-02 Germán Kruszewski , Ionut-Teodor Sorodoc , Tomas Mikolov

One of the objectives of continual learning is to prevent catastrophic forgetting in learning multiple tasks sequentially, and the existing solutions have been driven by the conceptualization of the plasticity-stability dilemma. However,…

Machine Learning · Computer Science 2024-04-16 Seungyub Han , Yeongmo Kim , Taehyun Cho , Jungwoo Lee

In Zero-Shot Learning (ZSL), embedding-based methods enable knowledge transfer from seen to unseen classes by learning a visual-semantic mapping from seen-class images to class-level semantic prototypes (e.g., attributes). However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Lei Wang , Shiming Chen , Guo-Sen Xie , Ziming Hong , Chaojian Yu , Qinmu Peng , Xinge You

Contrastive Language-Image Pre-training (CLIP) has shown powerful zero-shot learning performance. Few-shot learning aims to further enhance the transfer capability of CLIP by giving few images in each class, aka 'few shots'. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yaohui Li , Qifeng Zhou , Haoxing Chen , Jianbing Zhang , Xinyu Dai , Hao Zhou

Compositional zero-shot learning (CZSL) refers to recognizing unseen compositions of known visual primitives, which is an essential ability for artificial intelligence systems to learn and understand the world. While considerable progress…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Siteng Huang , Qiyao Wei , Donglin Wang

Continual learning (CL) is widely regarded as crucial challenge for lifelong AI. However, existing CL benchmarks, e.g. Permuted-MNIST and Split-CIFAR, make use of artificial temporal variation and do not align with or generalize to the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhiqiu Lin , Jia Shi , Deepak Pathak , Deva Ramanan