中文
相关论文

相关论文: Accelerating Convergence in Bayesian Few-Shot Clas…

200 篇论文

In this work, we investigate the idea of variance reduction by studying its properties with general adaptive mirror descent algorithms in nonsmooth nonconvex finite-sum optimization problems. We propose a simple yet generalized framework…

机器学习 · 统计学 2022-10-18 Wenjie Li , Zhanyu Wang , Yichen Zhang , Guang Cheng

Deep autoregressive models have shown state-of-the-art performance in density estimation for natural images on large-scale datasets such as ImageNet. However, such models require many thousands of gradient-based weight updates and unique…

神经与进化计算 · 计算机科学 2018-03-01 Scott Reed , Yutian Chen , Thomas Paine , Aäron van den Oord , S. M. Ali Eslami , Danilo Rezende , Oriol Vinyals , Nando de Freitas

Training a neural network model that can quickly adapt to a new task is highly desirable yet challenging for few-shot learning problems. Recent few-shot learning methods mostly concentrate on developing various meta-learning strategies from…

计算机视觉与模式识别 · 计算机科学 2020-11-24 Zihang Jiang , Bingyi Kang , Kuangqi Zhou , Jiashi Feng

Gaussian processes are a powerful framework for quantifying uncertainty and for sequential decision-making but are limited by the requirement of solving linear systems. In general, this has a cubic cost in dataset size and is sensitive to…

Inverse problems, i.e., estimating parameters of physical models from experimental data, are ubiquitous in science and engineering. The Bayesian formulation is the gold standard because it alleviates ill-posedness issues and quantifies…

机器学习 · 统计学 2024-05-28 Sharmila Karumuri , Ilias Bilionis

Few-shot learning (FSL) aims to learn a classifier that can be easily adapted to accommodate new tasks not seen during training, given only a few examples. To handle the limited-data problem in few-shot regimes, recent methods tend to…

计算机视觉与模式识别 · 计算机科学 2022-03-21 Yang Liu , Weifeng Zhang , Chao Xiang , Tu Zheng , Deng Cai , Xiaofei He

Few shot learning is an important problem in machine learning as large labelled datasets take considerable time and effort to assemble. Most few-shot learning algorithms suffer from one of two limitations- they either require the design of…

机器学习 · 计算机科学 2022-04-12 Shakti Kumar , Hussain Zaidi

We consider centralized and distributed mirror descent algorithms over a finite-dimensional Hilbert space, and prove that the problem variables converge to an optimizer of a possibly nonsmooth function when the step sizes are square…

最优化与控制 · 数学 2018-05-07 Thinh T. Doan , Subhonmesh Bose , D. Hoa Nguyen , Carolyn L. Beck

It is often the case that data are with multiple views in real-world applications. Fully exploring the information of each view is significant for making data more representative. However, due to various limitations and failures in data…

计算机视觉与模式识别 · 计算机科学 2023-05-19 Yuan Zhou , Yanrong Guo , Shijie Hao , Richang Hong , Jiebo Luo

This study aims to optimize the few-shot image classification task and improve the model's feature extraction and classification performance by combining self-supervised learning with the deep network model ResNet-101. During the training…

计算机视觉与模式识别 · 计算机科学 2024-11-20 Yuyang Xiao

This paper introduces the $(\alpha, \Gamma)$-descent, an iterative algorithm which operates on measures and performs $\alpha$-divergence minimisation in a Bayesian framework. This gradient-based procedure extends the commonly-used…

统计理论 · 数学 2021-10-25 Kamélia Daudel , Randal Douc , François Portier

Few-shot video classification aims to learn new video categories with only a few labeled examples, alleviating the burden of costly annotation in real-world applications. However, it is particularly challenging to learn a class-invariant…

计算机视觉与模式识别 · 计算机科学 2021-05-12 Songyang Zhang , Jiale Zhou , Xuming He

Few-shot learners aim to recognize new object classes based on a small number of labeled training examples. To prevent overfitting, state-of-the-art few-shot learners use meta-learning on convolutional-network features and perform…

计算机视觉与模式识别 · 计算机科学 2019-11-19 Yan Wang , Wei-Lun Chao , Kilian Q. Weinberger , Laurens van der Maaten

Recent machine learning advances have proposed black-box estimation of unknown continuous-time system dynamics directly from data. However, earlier works are based on approximative ODE solutions or point estimates. We propose a novel…

机器学习 · 计算机科学 2022-07-19 Pashupati Hegde , Çağatay Yıldız , Harri Lähdesmäki , Samuel Kaski , Markus Heinonen

Learning high quality class representations from few examples is a key problem in metric-learning approaches to few-shot learning. To accomplish this, we introduce a novel architecture where class representations are conditioned for each…

Inference of latent feature models in the Bayesian nonparametric setting is generally difficult, especially in high dimensional settings, because it usually requires proposing features from some prior distribution. In special cases, where…

机器学习 · 统计学 2022-06-14 Michael Minyi Zhang , Sinead A. Williamson , Fernando Perez-Cruz

Few-shot classification aims to recognize unlabeled samples from unseen classes given only few labeled samples. The unseen classes and low-data problem make few-shot classification very challenging. Many existing approaches extracted…

计算机视觉与模式识别 · 计算机科学 2019-10-18 Ruibing Hou , Hong Chang , Bingpeng Ma , Shiguang Shan , Xilin Chen

(Mini-batch) Stochastic Gradient Descent is a popular optimization method which has been applied to many machine learning applications. But a rather high variance introduced by the stochastic gradient in each step may slow down the…

机器学习 · 计算机科学 2018-10-09 Jingchang Liu , Linli Xu

Machine learning methods for computational imaging require uncertainty estimation to be reliable in real settings. While Bayesian models offer a computationally tractable way of recovering uncertainty, they need large data volumes to be…

机器学习 · 计算机科学 2020-08-24 Francesco Tonolini , Jack Radford , Alex Turpin , Daniele Faccio , Roderick Murray-Smith

Few-shot image classification is a challenging problem that aims to achieve the human level of recognition based only on a small number of training images. One main solution to few-shot image classification is deep metric learning. These…

计算机视觉与模式识别 · 计算机科学 2022-06-28 Xiaoxu Li , Xiaochen Yang , Zhanyu Ma , Jing-Hao Xue