English
Related papers

Related papers: Meta-learning Control Variates: Variance Reduction…

200 papers

Extant "fast" algorithms for Monte Carlo confidence sets are limited to univariate shift parameters for the one-sample and two-sample problems using the sample mean as the test statistic; moreover, some do not converge reliably and most do…

Computation · Statistics 2025-02-27 Amanda K. Glazer , Philip B. Stark

Supervised learning is ubiquitous in medical image analysis. In this paper we consider the problem of meta-learning -- predicting which methods will perform well in an unseen classification problem, given previous experience with other…

Computer Vision and Pattern Recognition · Computer Science 2017-06-13 Veronika Cheplygina , Pim Moeskops , Mitko Veta , Behdad Dasht Bozorg , Josien Pluim

Autonomous agents situated in real-world environments must be able to master large repertoires of skills. While a single short skill can be learned quickly, it would be impractical to learn every task independently. Instead, the agent…

Machine Learning · Computer Science 2020-08-04 Coline Devin , Daniel Geng , Pieter Abbeel , Trevor Darrell , Sergey Levine

Hyperparameter tuning plays a crucial role in optimizing the performance of predictive learners. Cross--validation (CV) is a widely adopted technique for estimating the error of different hyperparameter settings. Repeated cross-validation…

Machine Learning · Computer Science 2023-08-01 Giovanni Maria Merola

Cross-validation (CV) is a popular method for model-selection. Unfortunately, it is not immediately obvious how to apply CV to unsupervised or exploratory contexts. This thesis discusses some extensions of cross-validation to unsupervised…

Methodology · Statistics 2009-09-17 Patrick O. Perry

Learning-to-learn or meta-learning leverages data-driven inductive bias to increase the efficiency of learning on a novel task. This approach encounters difficulty when transfer is not advantageous, for instance, when tasks are considerably…

Machine Learning · Computer Science 2019-06-20 Ghassen Jerfel , Erin Grant , Thomas L. Griffiths , Katherine Heller

Learning models of artificial intelligence can nowadays perform very well on a large variety of tasks. However, in practice different task environments are best handled by different learning models, rather than a single, universal,…

Artificial Intelligence · Computer Science 2016-05-31 Adi Makmal , Alexey A. Melnikov , Vedran Dunjko , Hans J. Briegel

Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics…

Robotics · Computer Science 2022-04-15 Spencer M. Richards , Navid Azizan , Jean-Jacques Slotine , Marco Pavone

We propose a variance reduction framework for variational inference using the Multilevel Monte Carlo (MLMC) method. Our framework is built on reparameterized gradient estimators and "recycles" parameters obtained from past update history in…

Machine Learning · Statistics 2021-12-03 Masahiro Fujisawa , Issei Sato

Meta-learning is a tool that allows us to build sample-efficient learning systems. Here we show that, once meta-trained, LSTM Meta-Learners aren't just faster learners than their sample-inefficient deep learning (DL) and reinforcement…

Machine Learning · Computer Science 2019-05-07 Neil C. Rabinowitz

Optimization-based meta-learning offers a promising direction for few-shot learning that is essential for many real-world computer vision applications. However, learning from few samples introduces uncertainty, and quantifying model…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Deep Pandey , Qi Yu

Machine learning techniques face numerous challenges to achieve optimal performance. These include computational constraints, the limitations of single-view learning algorithms and the complexity of processing large datasets from different…

Machine Learning · Computer Science 2025-12-08 Abdelmalik Moujahid , Fadi Dornaika

Currently, data and model size dominate the narrative in the training of super-large, powerful models. However, there has been a lack of exploration on the effect of other attributes of the training dataset on model performance. We…

Machine Learning · Computer Science 2025-01-22 Kavita Selva , Satita Vittayaareekul , Brando Miranda

Data driven control of a continuum manipulator requires a lot of data for training but generating sufficient amount of real time data is not cost efficient. Random actuation of the manipulator can also be unsafe sometimes. Meta learning has…

Robotics · Computer Science 2024-03-28 Alok Ranjan Sahoo , Pavan Chakraborty

Multi-fidelity Monte Carlo methods leverage low-fidelity and surrogate models for variance reduction to make tractable uncertainty quantification even when numerically simulating the physical systems of interest with high-fidelity models is…

Numerical Analysis · Mathematics 2022-11-22 Ionut-Gabriel Farcas , Benjamin Peherstorfer , Tobias Neckel , Frank Jenko , Hans-Joachim Bungartz

We estimate the parameter of a stationary time series process by minimizing the integrated weighted mean squared error between the empirical and simulated characteristic function, when the true characteristic functions cannot be explicitly…

Statistics Theory · Mathematics 2021-02-03 Richard A. Davis , Thiago do Rêgo Sousa , Claudia Klüppelberg

We present simple and practical strategies to reduce the variance of Monte Carlo estimators. Our focus is on variational Monte Carlo calculations of atomic forces and pressure in electronic systems, although we show that the underlying…

Strongly Correlated Electrons · Physics 2026-03-17 David Linteau , Saverio Moroni , Giuseppe Carleo , Markus Holzmann

Meta-reinforcement learning (meta-RL) acquires meta-policies that show good performance for tasks in a wide task distribution. However, conventional meta-RL, which learns meta-policies by randomly sampling tasks, has been reported to show…

Machine Learning · Computer Science 2022-04-01 Morio Matsumoto , Hiroya Matsuba , Toshihiro Kujirai

Building upon recent developments of force-based estimators with a reduced variance for the computation of densities, radial distribution functions or local transport properties from molecular simulations, we show that the variance can be…

Chemical Physics · Physics 2021-05-18 Samuel W. Coles , Etienne Mangaud , Daan Frenkel , Benjamin Rotenberg

Meta-learning, or learning to learn, is a machine learning approach that utilizes prior learning experiences to expedite the learning process on unseen tasks. As a data-driven approach, meta-learning requires meta-features that represent…

Machine Learning · Computer Science 2021-01-12 Hadi S. Jomaa , Lars Schmidt-Thieme , Josif Grabocka