中文
相关论文

相关论文: ALPaCA vs. GP-based Prior Learning: A Comparison b…

200 篇论文

Despite significant recent advances in probabilistic meta-learning, it is common for practitioners to avoid using deep learning models due to a comparative lack of interpretability. Instead, many practitioners simply use non-meta-models…

机器学习 · 统计学 2025-04-25 Tommy Rochussen , Vincent Fortuin

Gaussian processes (GPs) stand as crucial tools in machine learning and signal processing, with their effectiveness hinging on kernel design and hyper-parameter optimization. This paper presents a novel GP linear multiple kernel (LMK) and a…

机器学习 · 计算机科学 2025-01-17 Richard Cornelius Suwandi , Zhidi Lin , Feng Yin , Zhiguo Wang , Sergios Theodoridis

We consider a PAC-Bayes type learning rule for binary classification, balancing the training error of a randomized ''posterior'' predictor with its KL divergence to a pre-specified ''prior''. This can be seen as an extension of a modified…

机器学习 · 统计学 2026-03-25 Xiaohan Zhu , Mesrob I. Ohannessian , Nathan Srebro

Over the past decade, the field of machine learning has experienced remarkable advancements. While image recognition systems have achieved impressive levels of accuracy, they continue to rely on extensive training datasets. Additionally, a…

机器学习 · 计算机科学 2023-11-03 Benji Alwis

Meta-learning is a powerful paradigm for tackling few-shot tasks. However, recent studies indicate that models trained with the whole-class training strategy can achieve comparable performance to those trained with meta-learning in few-shot…

机器学习 · 计算机科学 2025-09-17 Yunchuan Guan , Yu Liu , Ke Zhou , Zhiqi Shen , Jenq-Neng Hwang , Serge Belongie , Lei Li

PAC-Bayesian is an analysis framework where the training error can be expressed as the weighted average of the hypotheses in the posterior distribution whilst incorporating the prior knowledge. In addition to being a pure generalization…

机器学习 · 计算机科学 2022-02-07 Wei Huang , Chunrui Liu , Yilan Chen , Tianyu Liu , Richard Yi Da Xu

The Gaussian process (GP) is a popular statistical technique for stochastic function approximation and uncertainty quantification from data. GPs have been adopted into the realm of machine learning in the last two decades because of their…

机器学习 · 统计学 2024-10-02 Marcus M. Noack , Hengrui Luo , Mark D. Risser

Sparse modeling for signal processing and machine learning has been at the focus of scientific research for over two decades. Among others, supervised sparsity-aware learning comprises two major paths paved by: a) discriminative methods and…

机器学习 · 统计学 2022-11-23 Lei Cheng , Feng Yin , Sergios Theodoridis , Sotirios Chatzis , Tsung-Hui Chang

Robots with increasing autonomy progress our space exploration capabilities, particularly for in-situ exploration and sampling to stand in for human explorers. Currently, humans drive robots to meet scientific objectives, but depending on…

机器人学 · 计算机科学 2023-09-29 Sapphira Akins , Frances Zhu

While tasks could come with varying the number of instances and classes in realistic settings, the existing meta-learning approaches for few-shot classification assume that the number of instances per task and class is fixed. Due to such…

机器学习 · 计算机科学 2022-02-15 Hae Beom Lee , Hayeon Lee , Donghyun Na , Saehoon Kim , Minseop Park , Eunho Yang , Sung Ju Hwang

The linearized-Laplace approximation (LLA) has been shown to be effective and efficient in constructing Bayesian neural networks. It is theoretically compelling since it can be seen as a Gaussian process posterior with the mean function…

机器学习 · 计算机科学 2023-07-13 Agustinus Kristiadi , Alexander Immer , Runa Eschenhagen , Vincent Fortuin

We are motivated by the problem of providing strong generalization guarantees in the context of meta-learning. Existing generalization bounds are either challenging to evaluate or provide vacuous guarantees in even relatively simple…

机器学习 · 计算机科学 2021-10-27 Alec Farid , Anirudha Majumdar

The optimisation of fed-batch (bio)chemical process recipes is subject to inherent, underlying, and unmeasurable fluctuations across batches, whose trajectories are difficult to model and costly to measure. Bayesian Optimisation (BayesOpt)…

Learning linear combinations of multiple kernels is an appealing strategy when the right choice of features is unknown. Previous approaches to multiple kernel learning (MKL) promote sparse kernel combinations to support interpretability and…

机器学习 · 计算机科学 2010-10-28 Marius Kloft , Ulf Brefeld , Soeren Sonnenburg , Alexander Zien

The problem of open-set recognition is considered. While previous approaches only consider this problem in the context of large-scale classifier training, we seek a unified solution for this and the low-shot classification setting. It is…

计算机视觉与模式识别 · 计算机科学 2020-06-09 Bo Liu , Hao Kang , Haoxiang Li , Gang Hua , Nuno Vasconcelos

Humans are capable of learning new concepts from small numbers of examples. In contrast, supervised deep learning models usually lack the ability to extract reliable predictive rules from limited data scenarios when attempting to classify…

机器学习 · 计算机科学 2020-07-17 Zhongjie Yu , Sebastian Raschka

In Generalised Bayesian Inference (GBI), the learning rate and hyperparameters of the loss must be estimated. These inference-hyperparameters can't be estimated jointly with the other parameters, from the data, by giving them a prior.…

统计方法学 · 统计学 2026-05-18 Jeong Eun Lee , Sitong Liu , Geoff K. Nicholls

We study the problem of meta-learning through the lens of online convex optimization, developing a meta-algorithm bridging the gap between popular gradient-based meta-learning and classical regularization-based multi-task transfer methods.…

机器学习 · 计算机科学 2019-05-17 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

Gaussian process (GP) models have been used in a wide range of battery applications, in which different kernels were manually selected with considerable expertise. However, to capture complex relationships in the ever-growing amount of…

系统与控制 · 电气工程与系统科学 2025-05-06 Huang Zhang , Xixi Liu , Faisal Altaf , Torsten Wik

Unsupervised meta-learning aims to learn generalizable knowledge across a distribution of tasks constructed from unlabeled data. Here, the main challenge is how to construct diverse tasks for meta-learning without label information; recent…

机器学习 · 计算机科学 2023-03-03 Huiwon Jang , Hankook Lee , Jinwoo Shin