English
Related papers

Related papers: On Fast Adversarial Robustness Adaptation in Model…

200 papers

A major challenge of reinforcement learning (RL) in real-world applications is the variation between environments, tasks or clients. Meta-RL (MRL) addresses this issue by learning a meta-policy that adapts to new tasks. Standard MRL methods…

Machine Learning · Computer Science 2023-10-03 Ido Greenberg , Shie Mannor , Gal Chechik , Eli Meirom

Despite the success on few-shot learning problems, most meta-learned models only focus on achieving good performance on clean examples and thus easily break down when given adversarially perturbed samples. While some recent works have shown…

Machine Learning · Computer Science 2023-10-27 Minseon Kim , Hyeonjeong Ha , Dong Bok Lee , Sung Ju Hwang

Meta-learning (ML) has emerged as a promising learning method under resource constraints such as few-shot learning. ML approaches typically propose a methodology to learn generalizable models. In this work-in-progress paper, we put the…

Machine Learning · Computer Science 2022-03-07 Aroof Aimen , Sahil Sidheekh , Vineet Madan , Narayanan C. Krishnan

Meta learning algorithms have been widely applied in many tasks for efficient learning, such as few-shot image classification and fast reinforcement learning. During meta training, the meta learner develops a common learning strategy, or…

Machine Learning · Computer Science 2020-09-04 Han Xu , Yaxin Li , Xiaorui Liu , Hui Liu , Jiliang Tang

Model Agnostic Meta-Learning (MAML) has emerged as a standard framework for meta-learning, where a meta-model is learned with the ability of fast adapting to new tasks. However, as a double-looped optimization problem, MAML needs to…

Machine Learning · Computer Science 2021-02-10 Yufan Zhou , Zhenyi Wang , Jiayi Xian , Changyou Chen , Jinhui Xu

Sharpness-aware minimization (SAM) has been instrumental in improving deep neural network training by minimizing both the training loss and the sharpness of the loss landscape, leading the model into flatter minima that are associated with…

Machine Learning · Computer Science 2024-10-03 Van-Anh Nguyen , Quyen Tran , Tuan Truong , Thanh-Toan Do , Dinh Phung , Trung Le

Model-agnostic meta-learning (MAML) is one of the most popular and widely adopted meta-learning algorithms, achieving remarkable success in various learning problems. Yet, with the unique design of nested inner-loop and outer-loop updates,…

Machine Learning · Computer Science 2022-03-15 Chia-Hsiang Kao , Wei-Chen Chiu , Pin-Yu Chen

Sensitivity to adversarial noise hinders deployment of machine learning algorithms in security-critical applications. Although many adversarial defenses have been proposed, robustness to adversarial noise remains an open problem. The most…

Machine Learning · Computer Science 2020-08-13 Alex Serban , Erik Poll , Joost Visser

This study investigates the performance of robust anomaly detection models in industrial inspection, focusing particularly on their ability to handle noisy data. We propose to leverage the adaptation ability of meta learning approaches to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Muhammad Aqeel , Shakiba Sharifi , Marco Cristani , Francesco Setti

Deep Metric Learning (DML) has shown remarkable successes in many domains by taking advantage of powerful deep neural networks. Deep neural networks are prone to adversarial attacks and could be easily fooled by adversarial examples. The…

Machine Learning · Computer Science 2025-01-14 Xiaopeng Ke

Meta-learning approaches have been proposed to tackle the few-shot learning problem.Typically, a meta-learner is trained on a variety of tasks in the hopes of being generalizable to new tasks. However, the generalizability on new tasks of a…

Machine Learning · Computer Science 2018-05-22 Muhammad Abdullah Jamal , Guo-Jun Qi , Mubarak Shah

A core capability of intelligent systems is the ability to quickly learn new tasks by drawing on prior experience. Gradient (or optimization) based meta-learning has recently emerged as an effective approach for few-shot learning. In this…

Machine Learning · Computer Science 2019-09-11 Aravind Rajeswaran , Chelsea Finn , Sham Kakade , Sergey Levine

Adversarial training (AT) is a prominent technique employed by deep learning models to defend against adversarial attacks, and to some extent, enhance model robustness. However, there are three main drawbacks of the existing AT-based…

Image and Video Processing · Electrical Eng. & Systems 2026-03-31 X. Peng , D. Zhou , G. Sun , J. Shi , L. Wu

Intentionally crafted adversarial samples have effectively exploited weaknesses in deep neural networks. A standard method in adversarial robustness assumes a framework to defend against samples crafted by minimally perturbing a sample such…

Machine Learning · Computer Science 2022-11-07 Anaelia Ovalle , Evan Czyzycki , Cho-Jui Hsieh

This paper discusses an Enhanced Model-Agnostic Meta-Learning (E-MAML) algorithm that generates fast convergence of the policy function from a small number of training examples when applied to new learning tasks. Built on top of…

Machine Learning · Computer Science 2020-12-14 Ibrahim Ahmed , Marcos Quinones-Grueiro , Gautam Biswas

Adversarial training is an effective method to boost model robustness to malicious, adversarial attacks. However, such improvement in model robustness often leads to a significant sacrifice of standard performance on clean images. In many…

Machine Learning · Computer Science 2022-04-29 Pengyue Hou , Ming Zhou , Jie Han , Petr Musilek , Xingyu Li

As Machine Learning (ML) is increasingly used in solving various tasks in real-world applications, it is crucial to ensure that ML algorithms are robust to any potential worst-case noises, adversarial attacks, and highly unusual situations…

Machine Learning · Computer Science 2023-09-25 Long Dang , Thushari Hapuarachchi , Kaiqi Xiong , Jing Lin

Current deep learning based text classification methods are limited by their ability to achieve fast learning and generalization when the data is scarce. We address this problem by integrating a meta-learning procedure that uses the…

We present a novel Balanced Incremental Model Agnostic Meta Learning system (BI-MAML) for learning multiple tasks. Our method implements a meta-update rule to incrementally adapt its model to new tasks without forgetting old tasks. Such a…

Machine Learning · Computer Science 2020-06-16 Yang Zheng , Jinlin Xiang , Kun Su , Eli Shlizerman

Despite its popularity, several recent works question the effectiveness of MAML when test tasks are different from training tasks, thus suggesting various task-conditioned methodology to improve the initialization. Instead of searching for…

Machine Learning · Computer Science 2020-12-09 Sungyong Baik , Myungsub Choi , Janghoon Choi , Heewon Kim , Kyoung Mu Lee