English
Related papers

Related papers: Meta-Learning with Adjoint Methods

200 papers

The rapid progress in machine learning in recent years has been based on a highly productive connection to gradient-based optimization. Further progress hinges in part on a shift in focus from pattern recognition to decision-making and…

Machine Learning · Computer Science 2024-02-27 Neha S. Wadia , Yatin Dandi , Michael I. Jordan

Meta-gradients provide a general approach for optimizing the meta-parameters of reinforcement learning (RL) algorithms. Estimation of meta-gradients is central to the performance of these meta-algorithms, and has been studied in the setting…

Machine Learning · Computer Science 2022-09-26 Risto Vuorio , Jacob Beck , Shimon Whiteson , Jakob Foerster , Gregory Farquhar

We propose a simple algorithm to train stochastic neural networks to draw samples from given target distributions for probabilistic inference. Our method is based on iteratively adjusting the neural network parameters so that the output…

Machine Learning · Statistics 2016-11-29 Dilin Wang , Qiang Liu

Seeking to improve model generalization, we consider a new approach based on distributionally robust learning (DRL) that applies stochastic gradient descent to the outer minimization problem. Our algorithm efficiently estimates the gradient…

Machine Learning · Statistics 2020-12-24 Soumyadip Ghosh , Mark Squillante

In contrast to offline working fashions, two research paradigms are devised for online learning: (1) Online Meta Learning (OML) learns good priors over model parameters (or learning to learn) in a sequential setting where tasks are revealed…

Machine Learning · Computer Science 2021-08-24 Chen Zhao , Feng Chen , Bhavani Thuraisingham

Deep Metric Learning (DML) is a group of techniques that aim to measure the similarity between objects through the neural network. Although the number of DML methods has rapidly increased in recent years, most previous studies cannot…

Machine Learning · Computer Science 2022-12-02 Chenkang Zhang , Lei Luo , Bin Gu

Optimizing machine learning algorithms that are used to solve the objective function has been of great interest. Several approaches to optimize common algorithms, such as gradient descent and stochastic gradient descent, were explored. One…

Machine Learning · Computer Science 2022-10-06 Hilal AlQuabeh , Farha AlBreiki , Dilshod Azizov

Meta learning is a promising solution to few-shot learning problems. However, existing meta learning methods are restricted to the scenarios where training and application tasks share the same out-put structure. To obtain a meta model…

Machine Learning · Computer Science 2019-04-22 Yingtian Zou , Jiashi Feng

Despite its popularity, several recent works question the effectiveness of MAML when test tasks are different from training tasks, thus suggesting various task-conditioned methodology to improve the initialization. Instead of searching for…

Machine Learning · Computer Science 2020-12-09 Sungyong Baik , Myungsub Choi , Janghoon Choi , Heewon Kim , Kyoung Mu Lee

To increase the predictive power of a model, one needs to estimate its unknown parameters. Almost all parameter estimation techniques in ordinary differential equation models suffer from either a small convergence region or enormous…

Optimization and Control · Mathematics 2020-06-30 Ozgur Aydogmus , Ali Hakan Tor

Distance metric learning is successful in discovering intrinsic relations in data. However, most algorithms are computationally demanding when the problem size becomes large. In this paper, we propose a discriminative metric learning…

Machine Learning · Computer Science 2019-05-15 Jun Li , Xun Lin , Xiaoguang Rui , Yong Rui , Dacheng Tao

Meta-learning for few-shot learning entails acquiring a prior over previous tasks and experiences, such that new tasks be learned from small amounts of data. However, a critical challenge in few-shot learning is task ambiguity: even when a…

Machine Learning · Computer Science 2019-10-18 Chelsea Finn , Kelvin Xu , Sergey Levine

Alternating Direction Method of Multipliers (ADMM) has been used successfully in many conventional machine learning applications and is considered to be a useful alternative to Stochastic Gradient Descent (SGD) as a deep learning optimizer.…

Optimization and Control · Mathematics 2021-07-07 Junxiang Wang , Fuxun Yu , Xiang Chen , Liang Zhao

Meta learning aims at learning a model that can quickly adapt to unseen tasks. Widely used meta learning methods include model agnostic meta learning (MAML), implicit MAML, Bayesian MAML. Thanks to its ability of modeling uncertainty,…

Machine Learning · Computer Science 2022-03-08 Lisha Chen , Tianyi Chen

Optimizing shapes and topology of physical devices is crucial for both scientific and technological advancements, given its wide-ranging implications across numerous industries and research areas. Innovations in shape and topology…

Computational Physics · Physics 2023-10-02 Alexander Luce , Rasoul Alaee , Fabian Knorr , Florian Marquardt

Two major momentum-based techniques that have achieved tremendous success in optimization are Polyak's heavy ball method and Nesterov's accelerated gradient. A crucial step in all momentum-based methods is the choice of the momentum…

Machine Learning · Statistics 2017-12-21 Vishwak Srinivasan , Adepu Ravi Sankar , Vineeth N Balasubramanian

Building in silico models to predict chemical properties and activities is a crucial step in drug discovery. However, limited labeled data often hinders the application of deep learning in this setting. Meanwhile advances in meta-learning…

Machine Learning · Computer Science 2020-07-21 Cuong Q. Nguyen , Constantine Kreatsoulas , Kim M. Branson

Adversarial imitation learning (AIL), a prominent approach in imitation learning, has achieved significant practical success powered by neural network approximation. However, existing theoretical analyses of AIL are primarily confined to…

Machine Learning · Computer Science 2026-05-05 Tian Xu , Zhilong Zhang , Zexuan Chen , Ruishuo Chen , Yihao Sun , Yang Yu

Multi-Objective Reinforcement Learning (MORL) is a generalization of traditional Reinforcement Learning (RL) that aims to optimize multiple, often conflicting objectives simultaneously rather than focusing on a single reward. This approach…

Machine Learning · Computer Science 2025-08-15 Davide Guidobene , Lorenzo Benedetti , Diego Arapovic

Recent empirical evidence has driven conventional wisdom to believe that gradient-based meta-learning (GBML) methods perform well at few-shot learning because they learn an expressive data representation that is shared across tasks.…

Machine Learning · Computer Science 2023-06-06 Liam Collins , Aryan Mokhtari , Sewoong Oh , Sanjay Shakkottai