English
Related papers

Related papers: Theoretical Convergence of Multi-Step Model-Agnost…

200 papers

Meta-learning, or "learning to learn," aims to enable models to quickly adapt to new tasks with minimal data. While traditional methods like Model-Agnostic Meta-Learning (MAML) optimize parameters in Euclidean space, they often struggle to…

Machine Learning · Computer Science 2025-03-17 JuneYoung Park , YuMi Lee , Tae-Joon Kim , Jang-Hwan Choi

Humans have a remarkable ability to quickly and effectively learn new concepts in a continuous manner without forgetting old knowledge. Though deep learning has made tremendous successes on various computer vision tasks, it faces challenges…

Machine Learning · Computer Science 2022-07-26 Kun Wu , Chengxiang Yin , Jian Tang , Zhiyuan Xu , Yanzhi Wang , Dejun Yang

Deep neural state-space models (SSMs) provide a powerful tool for modeling dynamical systems solely using operational data. Typically, neural SSMs are trained using data collected from the actual system under consideration, despite the…

Machine Learning · Computer Science 2022-11-16 Ankush Chakrabarty , Gordon Wichern , Christopher R. Laughman

Magnetic Resonance (MR) images suffer from various types of artifacts due to motion, spatial resolution, and under-sampling. Conventional deep learning methods deal with removing a specific type of artifact, leading to separately trained…

Image and Video Processing · Electrical Eng. & Systems 2023-04-14 Arun Palla , Sriprabha Ramanarayanan , Keerthi Ram , Mohanasankar Sivaprakasam

In the realm of recommender systems, the ubiquitous adoption of deep neural networks has emerged as a dominant paradigm for modeling diverse business objectives. As user bases continue to expand, the necessity of personalization and…

This letter presents a model-agnostic meta-learning (MAML) based framework for simultaneous and accurate estimation of human gait phase and terrain geometry using a small set of fabric-based wearable soft sensors, with efficient adaptation…

Meta-learning (ML) has emerged as a promising learning method under resource constraints such as few-shot learning. ML approaches typically propose a methodology to learn generalizable models. In this work-in-progress paper, we put the…

Machine Learning · Computer Science 2022-03-07 Aroof Aimen , Sahil Sidheekh , Vineet Madan , Narayanan C. Krishnan

We suggest an iterative approach to computing K-step maximum likelihood estimates (MLE) of the parametric components in semiparametric models based on their profile likelihoods. The higher order convergence rate of K-step MLE mainly depends…

Statistics Theory · Mathematics 2007-08-23 Guang Cheng

Many real-world problems, including multi-speaker text-to-speech synthesis, can greatly benefit from the ability to meta-learn large models with only a few task-specific components. Updating only these task-specific modules then allows the…

Machine Learning · Computer Science 2020-10-23 Yutian Chen , Abram L. Friesen , Feryal Behbahani , Arnaud Doucet , David Budden , Matthew W. Hoffman , Nando de Freitas

Bilevel optimization has become a powerful framework in various machine learning applications including meta-learning, hyperparameter optimization, and network architecture search. There are generally two classes of bilevel optimization…

Machine Learning · Computer Science 2021-08-03 Kaiyi Ji

Meta-learning aims to train models that can generalize to new tasks with limited labeled data by extracting shared features across diverse task datasets. Additionally, it accounts for prediction uncertainty during both training and…

Machine Learning · Computer Science 2025-03-03 Hyungi Lee , Chaeyun Jang , Dongbok Lee , Juho Lee

With the advancement of video analysis technology, the multi-object tracking (MOT) problem in complex scenes involving pedestrians is gaining increasing importance. This challenge primarily involves two key tasks: pedestrian detection and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Jiayi Chen , Chunhua Deng

Meta-learning that uses implicit gradient have provided an exciting alternative to standard techniques which depend on the trajectory of the inner loop training. Implicit meta-learning (IML), however, require computing $2^{nd}$ order…

Machine Learning · Computer Science 2023-10-31 Fady Rezk

Despite its popularity, several recent works question the effectiveness of MAML when test tasks are different from training tasks, thus suggesting various task-conditioned methodology to improve the initialization. Instead of searching for…

Machine Learning · Computer Science 2020-12-09 Sungyong Baik , Myungsub Choi , Janghoon Choi , Heewon Kim , Kyoung Mu Lee

Meta-learning stands for 'learning to learn' such that generalization to new tasks is achieved. Among these methods, Gradient-based meta-learning algorithms are a specific sub-class that excel at quick adaptation to new tasks with limited…

Machine Learning · Computer Science 2020-10-20 Jathushan Rajasegaran , Salman Khan , Munawar Hayat , Fahad Shahbaz Khan , Mubarak Shah

This study investigates the performance of robust anomaly detection models in industrial inspection, focusing particularly on their ability to handle noisy data. We propose to leverage the adaptation ability of meta learning approaches to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Muhammad Aqeel , Shakiba Sharifi , Marco Cristani , Francesco Setti

Distance metric learning based on triplet loss has been applied with success in a wide range of applications such as face recognition, image retrieval, speaker change detection and recently recommendation with the CML model. However, as we…

Information Retrieval · Computer Science 2019-09-25 Viet-Anh Tran , Romain Hennequin , Jimena Royo-Letelier , Manuel Moussallam

The increasing use of machine-learning (ML) enabled systems in critical tasks fuels the quest for novel verification and validation techniques yet grounded in accepted system assurance principles. In traditional system development,…

Machine Learning · Computer Science 2020-02-11 Taejoon Byun , Sanjai Rayadurgam

The scope of the Baldwin effect was recently called into question by two papers that closely examined the seminal work of Hinton and Nowlan. To this date there has been no demonstration of its necessity in empirically challenging tasks.…

We study the problem of meta-learning through the lens of online convex optimization, developing a meta-algorithm bridging the gap between popular gradient-based meta-learning and classical regularization-based multi-task transfer methods.…

Machine Learning · Computer Science 2019-05-17 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar