English
Related papers

Related papers: Ortho-Shot: Low Displacement Rank Regularization w…

200 papers

Empirical science of neural scaling laws is a rapidly growing area of significant importance to the future of machine learning, particularly in the light of recent breakthroughs achieved by large-scale pre-trained models such as GPT-3, CLIP…

Machine Learning · Computer Science 2021-10-20 Gabriele Prato , Simon Guiroy , Ethan Caballero , Irina Rish , Sarath Chandar

Low-rank modeling has many important applications in computer vision and machine learning. While the matrix rank is often approximated by the convex nuclear norm, the use of nonconvex low-rank regularizers has demonstrated better empirical…

Machine Learning · Computer Science 2018-07-25 Quanming Yao , James T. Kwok , Taifeng Wang , Tie-Yan Liu

Cross-domain few-shot learning (CDFSL) aims to acquire knowledge from limited training data in the target domain by leveraging prior knowledge transferred from source domains with abundant training samples. CDFSL faces challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yixiong Zou , Yicong Liu , Yiman Hu , Yuhua Li , Ruixuan Li

Due to the scarcity of annotated data in the medical domain, few-shot learning may be useful for medical image analysis tasks. We design a few-shot learning method using an ensemble of random subspaces for the diagnosis of chest x-rays…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Kshitiz , Garvit Garg , Angshuman Paul

Few-shot classification is a challenging problem that aims to learn a model that can adapt to unseen classes given a few labeled samples. Recent approaches pre-train a feature extractor, and then fine-tune for episodic meta-learning. Other…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Philip Chikontwe , Soopil Kim , Sang Hyun Park

Few-shot learning aims to learn representations that can tackle novel tasks given a small number of examples. Recent studies show that cross-modal learning can improve representations for few-shot classification. More specifically, language…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Jordi Armengol-Estapé , Vincent Michalski , Ramnath Kumar , Pierre-Luc St-Charles , Doina Precup , Samira Ebrahimi Kahou

We investigate a general formulation for clustering and transductive few-shot learning, which integrates prototype-based objectives, Laplacian regularization and supervision constraints from a few labeled data points. We propose a…

Machine Learning · Computer Science 2021-06-18 Imtiaz Masud Ziko , Malik Boudiaf , Jose Dolz , Eric Granger , Ismail Ben Ayed

Few-shot class incremental learning implies the model to learn new classes while retaining knowledge of previously learned classes with a small number of training instances. Existing frameworks typically freeze the parameters of the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Parinita Nema , Vinod K Kurmi

The low displacement rank (LDR) framework for structured matrices represents a matrix through two displacement operators and a low-rank residual. Existing use of LDR matrices in deep learning has applied fixed displacement operators…

Machine Learning · Computer Science 2019-01-03 Anna T. Thomas , Albert Gu , Tri Dao , Atri Rudra , Christopher Ré

Few-shot learning in image classification aims to learn a classifier to classify images when only few training examples are available for each class. Recent work has achieved promising classification performance, where an image-level…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Wenbin Li , Lei Wang , Jinglin Xu , Jing Huo , Yang Gao , Jiebo Luo

We introduce Mixture-based Feature Space Learning (MixtFSL) for obtaining a rich and robust feature representation in the context of few-shot image classification. Previous works have proposed to model each base class either with a single…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Arman Afrasiyabi , Jean-François Lalonde , Christian Gagné

Traditional fine-grained image classification generally requires abundant labeled samples to deal with the low inter-class variance but high intra-class variance problem. However, in many scenarios we may have limited samples for some novel…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Chaofei Wang , Shiji Song , Qisen Yang , Xiang Li , Gao Huang

Human beings can recognize new objects with only a few labeled examples, however, few-shot learning remains a challenging problem for machine learning systems. Most previous algorithms in few-shot learning only utilize spatial information…

Computer Vision and Pattern Recognition · Computer Science 2021-07-08 Xiangyu Chen , Guanghui Wang

Multi-task learning, which optimizes performance across multiple tasks, is inherently a multi-objective optimization problem. Various algorithms are developed to provide discrete trade-off solutions on the Pareto front. Recently, continuous…

Machine Learning · Computer Science 2024-07-31 Weiyu Chen , James T. Kwok

In the past few years, a considerable amount of research has been dedicated to the exploitation of previous learning experiences and the design of Few-shot and Meta Learning approaches, in problem domains ranging from Computer Vision to…

Machine Learning · Computer Science 2024-01-22 Achkan Salehi , Alexandre Coninx , Stephane Doncieux

This paper tackles the challenging problem of hyperspectral (HS) image denoising. Unlike existing deep learning-based methods usually adopting complicated network architectures or empirically stacking off-the-shelf modules to pursue…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Jinhui Hou , Zhiyu Zhu , Hui Liu , Junhui Hou

Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Jinhai Yang , Hua Yang , Lin Chen

Learning to generate a task-aware base learner proves a promising direction to deal with few-shot learning (FSL) problem. Existing methods mainly focus on generating an embedding model utilized with a fixed metric (eg, cosine distance) for…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Lei Zhang , Fei Zhou , Wei Wei , Yanning Zhang

Distance metric learning (DML) has been successfully applied to object classification, both in the standard regime of rich training data and in the few-shot scenario, where each category is represented by only a few examples. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Leonid Karlinsky , Joseph Shtok , Sivan Harary , Eli Schwartz , Amit Aides , Rogerio Feris , Raja Giryes , Alex M. Bronstein

Deep learning-based methods in computational microscopy have been shown to be powerful but in general face some challenges due to limited generalization to new types of samples and requirements for large and diverse training data. Here, we…

Image and Video Processing · Electrical Eng. & Systems 2022-06-13 Luzhe Huang , Xilin Yang , Tairan Liu , Aydogan Ozcan