English
Related papers

Related papers: Low-Shot Learning with Imprinted Weights

200 papers

Incremental few-shot semantic segmentation (IFSS) targets at incrementally expanding model's capacity to segment new class of images supervised by only a few samples. However, features learned on old classes could significantly drift,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Guangchen Shi , Yirui Wu , Jun Liu , Shaohua Wan , Wenhai Wang , Tong Lu

Training large transformer models from scratch for a target task requires lots of data and is computationally demanding. The usual practice of transfer learning overcomes this challenge by initializing the model with weights of a pretrained…

Recently, a new Continual Learning (CL) paradigm was presented to control catastrophic forgetting, called Interval Continual Learning (InterContiNet), which relies on enforcing interval constraints on the neural network parameter space.…

Machine Learning · Computer Science 2025-05-07 Patryk Krukowski , Anna Bielawska , Kamil Książek , Paweł Wawrzyński , Paweł Batorski , Przemysław Spurek

This paper tackles the problem of few-shot learning, which aims to learn new visual concepts from a few examples. A common problem setting in few-shot classification assumes random sampling strategy in acquiring data labels, which is…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Shipeng Yan , Songyang Zhang , Xuming He

The currently leading artificial neural network models of the visual ventral stream - which are derived from a combination of performance optimization and robustification methods - have demonstrated a remarkable degree of behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Morgan B. Talbot , Gabriel Kreiman , James J. DiCarlo , Guy Gaziv

In the context of pose-invariant object recognition and retrieval, we demonstrate that it is possible to achieve significant improvements in performance if both the category-based and the object-identity-based embeddings are learned…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Rohan Sarkar , Avinash Kak

The remarkable capability of Transformers to do reasoning and few-shot learning, without any fine-tuning, is widely conjectured to stem from their ability to implicitly simulate a multi-step algorithms -- such as gradient descent -- with…

Machine Learning · Computer Science 2024-10-14 Khashayar Gatmiry , Nikunj Saunshi , Sashank J. Reddi , Stefanie Jegelka , Sanjiv Kumar

In this paper, we present token labeling -- a new training objective for training high-performance vision transformers (ViTs). Different from the standard training objective of ViTs that computes the classification loss on an additional…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Zihang Jiang , Qibin Hou , Li Yuan , Daquan Zhou , Yujun Shi , Xiaojie Jin , Anran Wang , Jiashi Feng

Transferring knowledge from task-agnostic pre-trained deep models for downstream tasks is an important topic in computer vision research. Along with the growth of computational capacity, we now have open-source vision-language pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Wenhao Wu , Zhun Sun , Wanli Ouyang

Deep neural networks have become ubiquitous for applications related to visual recognition and language understanding tasks. However, it is often prohibitive to use typical neural networks on devices like mobile phones or smart watches…

Machine Learning · Computer Science 2017-08-10 Sujith Ravi

We propose a weakly-supervised multi-view learning approach to learn category-specific surface mapping without dense annotations. We learn the underlying surface geometry of common categories, such as human faces, cars, and airplanes, given…

Computer Vision and Pattern Recognition · Computer Science 2021-05-05 Nishant Rai , Aidas Liaudanskas , Srinivas Rao , Rodrigo Ortiz Cayon , Matteo Munaro , Stefan Holzer

Low-rankness plays an important role in traditional machine learning, but is not so popular in deep learning. Most previous low-rank network compression methods compress networks by approximating pre-trained models and re-training. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Kailing Guo , Zhenquan Lin , Canyang Chen , Xiaofen Xing , Fang Liu , Xiangmin Xu

Semantic segmentation, which aims to acquire a detailed understanding of images, is an essential issue in computer vision. However, in practical scenarios, new categories that are different from the categories in training usually appear.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Haiyang Liu , Yichen Wang , Jiayi Zhao , Guowu Yang , Fengmao Lv

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Jinhai Yang , Hua Yang , Lin Chen

Machine learning methods are commonly used to solve inverse problems, wherein an unknown signal must be estimated from few indirect measurements generated via a known acquisition procedure. In particular, neural networks perform well…

Machine Learning · Computer Science 2025-12-05 Hannah Laus , Suzanna Parkinson , Vasileios Charisopoulos , Felix Krahmer , Rebecca Willett

Exploiting different representations, or views, of the same object for better clustering has become very popular these days, which is conventionally called multi-view clustering. Generally, it is essential to measure the importance of each…

Machine Learning · Computer Science 2019-06-24 Feiping Nie , Jing Li , Xuelong Li

This paper studies the unsupervised embedding learning problem, which requires an effective similarity measurement between samples in low-dimensional embedding space. Motivated by the positive concentrated and negative separated properties…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Mang Ye , Xu Zhang , Pong C. Yuen , Shih-Fu Chang

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

While deep learning has been successfully applied to many real-world computer vision tasks, training robust classifiers usually requires a large amount of well-labeled data. However, the annotation is often expensive and time-consuming.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-09 Zhiyu Xue , Lixin Duan , Wen Li , Lin Chen , Jiebo Luo

Target-driven visual navigation is a challenging problem that requires a robot to find the goal using only visual inputs. Many researchers have demonstrated promising results using deep reinforcement learning (deep RL) on various robotic…

Robotics · Computer Science 2021-06-08 Qian Luo , Maks Sorokin , Sehoon Ha