English
Related papers

Related papers: Meta-learning Control Variates: Variance Reduction…

200 papers

We propose a method that can perform one-class classification given only a small number of examples from the target class and none from the others. We formulate the learning of meaningful features for one-class classification as a…

Computer Vision and Pattern Recognition · Computer Science 2021-04-26 Gabriel Dahia , Maurício Pamplona Segundo

Robust estimators for linear regression require non-convex objective functions to shield against adverse affects of outliers. This non-convexity brings challenges, particularly when combined with penalization in high-dimensional settings.…

Computation · Statistics 2025-08-08 David Kepplinger , Siqi Wei

Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for…

Machine Learning · Computer Science 2021-06-23 Renkun Ni , Micah Goldblum , Amr Sharaf , Kezhi Kong , Tom Goldstein

One popular trend in meta-learning is to learn from many training tasks a common initialization for a gradient-based method that can be used to solve a new task with few samples. The theory of meta-learning is still in its early stages,…

Machine Learning · Computer Science 2020-02-27 Nikunj Saunshi , Yi Zhang , Mikhail Khodak , Sanjeev Arora

We propose meta-curvature (MC), a framework to learn curvature information for better generalization and fast model adaptation. MC expands on the model-agnostic meta-learner (MAML) by learning to transform the gradients in the inner…

Machine Learning · Computer Science 2020-01-10 Eunbyung Park , Junier B. Oliva

This work introduces a novel multilevel Monte Carlo (MLMC) metamodeling approach for variance function estimation. Although devising an efficient experimental design for simulation metamodeling can be elusive, the MLMC-based approach…

Methodology · Statistics 2025-04-22 Jingtao Zhang , Xi Chen

Intelligent agents should have the ability to leverage knowledge from previously learned tasks in order to learn new ones quickly and efficiently. Meta-learning approaches have emerged as a popular solution to achieve this. However,…

Machine Learning · Computer Science 2023-02-17 Zhao Mandi , Pieter Abbeel , Stephen James

The field of meta-learning seeks to improve the ability of today's machine learning systems to adapt efficiently to small amounts of data. Typically this is accomplished by training a system with a parametrized update rule to improve a…

Machine Learning · Computer Science 2021-03-26 Lucas D. Lingle

In this paper, we consider the problem of finding a meta-learning online control algorithm that can learn across the tasks when faced with a sequence of $N$ (similar) control tasks. Each task involves controlling a linear dynamical system…

Machine Learning · Computer Science 2022-08-23 Deepan Muthirayan , Dileep Kalathil , Pramod P. Khargonekar

Learning models or control policies from data has become a powerful tool to improve the performance of uncertain systems. While a strong focus has been placed on increasing the amount and quality of data to improve performance, data can…

Systems and Control · Electrical Eng. & Systems 2024-10-02 Ralf Römer , Lukas Brunke , Siqi Zhou , Angela P. Schoellig

We overview a series of recent works devoted to variance reduction techniques for numerical stochastic homogenization. Numerical homogenization requires solving a set of problems at the micro scale, the so-called corrector problems. In a…

Numerical Analysis · Mathematics 2016-04-27 Xavier Blanc , Claude Le Bris , Frederic Legoll

Meta-learning is a branch of machine learning which trains neural network models to synthesize a wide variety of data in order to rapidly solve new problems. In process control, many systems have similar and well-understood dynamics, which…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Daniel G. McClement , Nathan P. Lawrence , Johan U. Backstrom , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni

In-context learning enables transformer models to generalize to new tasks based solely on input prompts, without any need for weight updates. However, existing training paradigms typically rely on large, unstructured datasets that are…

We consider a sequence of related multivariate time series learning tasks, such as predicting failures for different instances of a machine from time series of multi-sensor data, or activity recognition tasks over different individuals from…

Machine Learning · Computer Science 2022-03-15 Vibhor Gupta , Jyoti Narwariya , Pankaj Malhotra , Lovekesh Vig , Gautam Shroff

Meta-learning, or "learning to learn," is a subfield of machine learning where the goal is to develop models and algorithms that can learn from various tasks and improve their learning process over time. Unlike traditional machine learning…

Machine Learning · Computer Science 2024-07-23 Mouad El Bouchattaoui

Contrastive self-supervised learning has gained attention for its ability to create high-quality representations from large unlabelled data sets. A key reason that these powerful features enable data-efficient learning of downstream tasks…

Machine Learning · Computer Science 2024-01-29 Calum Heggan , Tim Hospedales , Sam Budgett , Mehrdad Yaghoobi

Approximate inference in complex probabilistic models such as deep Gaussian processes requires the optimisation of doubly stochastic objective functions. These objectives incorporate randomness both from mini-batch subsampling of the data…

Machine Learning · Statistics 2020-03-26 Ayman Boustati , Sattar Vakili , James Hensman , ST John

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Studies often estimate associations between an outcome and multiple variates. For example, studies of diagnostic test accuracy estimate sensitivity and specificity, and studies of predictive and prognostic factors typically estimate…

One-shot direct model-reference control design techniques, like the Virtual Reference Feedback Tuning (VRFT) approach, offer time-saving solutions for the calibration of fixed-structure controllers for dynamic systems. Nonetheless, such…

Systems and Control · Electrical Eng. & Systems 2023-08-30 Riccardo Busetto , Valentina Breschi , Simone Formentin