English
Related papers

Related papers: Meta-Learning GNN Initializations for Low-Resource…

200 papers

Despite its popularity, several recent works question the effectiveness of MAML when test tasks are different from training tasks, thus suggesting various task-conditioned methodology to improve the initialization. Instead of searching for…

Machine Learning · Computer Science 2020-12-09 Sungyong Baik , Myungsub Choi , Janghoon Choi , Heewon Kim , Kyoung Mu Lee

Software refactoring is the process of changing the structure of software without any alteration in its behavior and functionality. Presuming it is carried out in appropriate opportunities, refactoring enhances software quality…

Software Engineering · Computer Science 2023-01-20 Hanieh Khosravi , Abbas Rasoolzadegan

In the early observation period of a time series, there might be only a few historic observations available to learn a model. However, in cases where an existing prior set of datasets is available, Meta learning methods can be applicable.…

Machine Learning · Computer Science 2023-07-20 Shayan Jawed , Kiran Madhusudhanan , Vijaya Krishna Yalavarthi , Lars Schmidt-Thieme

Machine Learning (ML) has the potential to accelerate discovery of new materials and shed light on useful properties of existing materials. A key difficulty when applying ML in Materials Science is that experimental datasets of material…

In this paper, we propose to extend the recently introduced model-agnostic meta-learning algorithm (MAML) for low-resource neural machine translation (NMT). We frame low-resource translation as a meta-learning problem, and we learn to adapt…

Computation and Language · Computer Science 2018-08-28 Jiatao Gu , Yong Wang , Yun Chen , Kyunghyun Cho , Victor O. K. Li

Machine learning (ML) based materials discovery has emerged as one of the most promising approaches for breakthroughs in materials science. While heuristic knowledge based descriptors have been combined with ML algorithms to achieve good…

Materials Science · Physics 2021-09-28 Sadman Sadeed Omee , Steph-Yves Louis , Nihang Fu , Lai Wei , Sourin Dey , Rongzhi Dong , Qinyang Li , Jianjun Hu

The objective of active learning (AL) is to train classification models with less number of labeled instances by selecting only the most informative instances for labeling. The AL algorithms designed for other data types such as images and…

Machine Learning · Statistics 2020-07-23 Kaushalya Madhawa , Tsuyoshi Murata

Meta-learning involves multiple learners, each dedicated to specific tasks, collaborating in a data-constrained setting. In current meta-learning methods, task learners locally learn models from sensitive data, termed support sets. These…

Machine Learning · Computer Science 2024-06-05 Mina Rafiei , Mohammadmahdi Maheri , Hamid R. Rabiee

Deep neural networks have been shown as a class of useful tools for addressing signal recognition issues in recent years, especially for identifying the nonlinear feature structures of signals. However, this power of most deep learning…

Machine Learning · Computer Science 2021-06-15 Yihong Dong , Ying Peng , Muqiao Yang , Songtao Lu , Qingjiang Shi

Deep learning models require a large amount of data to perform well. When data is scarce for a target task, we can transfer the knowledge gained by training on similar tasks to quickly learn the target. A successful approach is…

Machine Learning · Computer Science 2021-03-18 Alberto Bernacchia

Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a…

Machine Learning · Computer Science 2018-05-22 Muhammad Abdullah Jamal , Guo-Jun Qi , Mubarak Shah

Meta-learning often referred to as learning-to-learn is a promising notion raised to mimic human learning by exploiting the knowledge of prior tasks but being able to adapt quickly to novel tasks. A plethora of models has emerged in this…

Machine Learning · Computer Science 2022-10-17 Jicang Cai , Saeed Vahidian , Weijia Wang , Mohsen Joneidi , Bill Lin

Model-agnostic meta-learning (MAML) is a popular method for few-shot learning but assumes that we have access to the meta-training set. In practice, training on the meta-training set may not always be an option due to data privacy concerns,…

Machine Learning · Computer Science 2021-03-17 Namyeong Kwon , Hwidong Na , Gabriel Huang , Simon Lacoste-Julien

The arc of drug discovery entails a multiparameter optimization problem spanning vast length scales. They key parameters range from solubility (angstroms) to protein-ligand binding (nanometers) to in vivo toxicity (meters). Through feature…

Due to its empirical success in few-shot classification and reinforcement learning, meta-learning has recently received significant interest. Meta-learning methods leverage data from previous tasks to learn a new task in a sample-efficient…

Machine Learning · Computer Science 2024-07-24 Oğuz Kaan Yüksel , Etienne Boursier , Nicolas Flammarion

With access to large datasets, deep neural networks (DNN) have achieved human-level accuracy in image and speech recognition tasks. However, in chemistry, data is inherently small and fragmented. In this work, we develop an approach of…

Machine Learning · Statistics 2018-08-16 Garrett B. Goh , Charles Siegel , Abhinav Vishnu , Nathan O. Hodas

This paper considers meta-learning problems, where there is a distribution of tasks, and we would like to obtain an agent that performs well (i.e., learns quickly) when presented with a previously unseen task sampled from this distribution.…

Machine Learning · Computer Science 2018-10-23 Alex Nichol , Joshua Achiam , John Schulman

De novo molecular design attempts to search over the chemical space for molecules with the desired property. Recently, deep learning has gained considerable attention as a promising approach to solve the problem. In this paper, we propose…

Quantitative Methods · Quantitative Biology 2020-10-28 Sungsoo Ahn , Junsu Kim , Hankook Lee , Jinwoo Shin

In few-shot learning scenarios, the challenge is to generalize and perform well on new unseen examples when only very few labeled examples are available for each task. Model-agnostic meta-learning (MAML) has gained the popularity as one of…

Machine Learning · Computer Science 2021-10-19 Sungyong Baik , Janghoon Choi , Heewon Kim , Dohee Cho , Jaesik Min , Kyoung Mu Lee

Model-Agnostic Meta-Learning (MAML) has become increasingly popular for training models that can quickly adapt to new tasks via one or few stochastic gradient descent steps. However, the MAML objective is significantly more difficult to…

Machine Learning · Computer Science 2022-08-11 Liam Collins , Aryan Mokhtari , Sanjay Shakkottai