English
Related papers

Related papers: EMO: Episodic Memory Optimization for Few-Shot Met…

200 papers

Bilevel optimization (BLO) is a popular approach with many applications including hyperparameter optimization, neural architecture search, adversarial robustness and model-agnostic meta-learning. However, the approach suffers from time and…

Machine Learning · Computer Science 2021-06-08 Valerii Likhosherstov , Xingyou Song , Krzysztof Choromanski , Jared Davis , Adrian Weller

The human brain constantly learns and rapidly adapts to new situations by integrating acquired knowledge and experiences into memory. Developing this capability in machine learning models is considered an important goal of AI research since…

Artificial Intelligence · Computer Science 2023-06-08 Arsham Gholamzadeh Khoee , Alireza Javaheri , Saeed Reza Kheradpisheh , Mohammad Ganjtabesh

State-of-the-art deep learning algorithms yield remarkable results in many visual recognition tasks. However, they still fail to provide satisfactory results in scarce data regimes. To a certain extent this lack of data can be compensated…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Frederik Pahde , Oleksiy Ostapenko , Patrick Jähnichen , Tassilo Klein , Moin Nabi

We consider a new problem of few-shot learning of compact models. Meta-learning is a popular approach for few-shot learning. Previous work in meta-learning typically assumes that the model architecture during meta-training is the same as…

Machine Learning · Computer Science 2022-10-19 Yong Wu , Shekhor Chanda , Mehrdad Hosseinzadeh , Zhi Liu , Yang Wang

Meta-learning algorithms are widely used for few-shot learning. For example, image recognition systems that readily adapt to unseen classes after seeing only a few labeled examples. Despite their success, we show that modern meta-learning…

Machine Learning · Computer Science 2021-10-28 Mayank Agarwal , Mikhail Yurochkin , Yuekai Sun

In this work, we introduce the first framework for Motion-aware Event Suppression, which learns to filter events triggered by IMOs and ego-motion in real time. Our model jointly segments IMOs in the current event stream while predicting…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Roberto Pellerito , Nico Messikommer , Giovanni Cioffi , Marco Cannici , Davide Scaramuzza

Despite the recent achievements made in the multi-modal emotion recognition task, two problems still exist and have not been well investigated: 1) the relationship between different emotion categories are not utilized, which leads to…

Computation and Language · Computer Science 2020-10-08 Wenliang Dai , Zihan Liu , Tiezheng Yu , Pascale Fung

Few-shot learning is the process of learning novel classes using only a few examples and it remains a challenging task in machine learning. Many sophisticated few-shot learning algorithms have been proposed based on the notion that networks…

Machine Learning · Computer Science 2019-10-04 Akihiro Nakamura , Tatsuya Harada

Episodic memory-based methods can rapidly latch onto past successful strategies by a non-parametric memory and improve sample efficiency of traditional reinforcement learning. However, little effort is put into the continuous domain, where…

Machine Learning · Computer Science 2021-06-14 Hao Hu , Jianing Ye , Guangxiang Zhu , Zhizhou Ren , Chongjie Zhang

Deep neural networks are highly effective when a large number of labeled samples are available but fail with few-shot classification tasks. Recently, meta-learning methods have received much attention, which train a meta-learner on massive…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yucan Zhou , Yu Wang , Jianfei Cai , Yu Zhou , Qinghua Hu , Weiping Wang

Distributionally robust optimization (DRO) problems are increasingly seen as a viable method to train machine learning models for improved model generalization. These min-max formulations, however, are more difficult to solve. We therefore…

Machine Learning · Statistics 2020-11-03 Soumyadip Ghosh , Mark Squillante , Ebisa Wollega

We propose regression networks for the problem of few-shot classification, where a classifier must generalize to new classes not seen in the training set, given only a small number of examples of each class. In high dimensional embedding…

Machine Learning · Computer Science 2020-06-22 Arnout Devos , Matthias Grossglauser

Few-shot Continual Relation Extraction is a crucial challenge for enabling AI systems to identify and adapt to evolving relationships in dynamic real-world domains. Traditional memory-based approaches often overfit to limited samples,…

Computation and Language · Computer Science 2025-03-03 Nguyen Xuan Thanh , Anh Duc Le , Quyen Tran , Thanh-Thien Le , Linh Ngo Van , Thien Huu Nguyen

Meta-learning (ML) has emerged as a promising direction in learning models under constrained resource settings like few-shot learning. The popular approaches for ML either learn a generalizable initial model or a generic parametric…

Machine Learning · Computer Science 2022-03-07 Aroof Aimen , Sahil Sidheekh , Narayanan C. Krishnan

Deformable image registration is inherently a multi-objective optimization (MOO) problem, requiring a delicate balance between image similarity and deformation regularity. These conflicting objectives often lead to poor optimization…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yi Zhang , Yidong Zhao , Qian Tao

In practical multi-criterion decision-making, it is cumbersome if a decision maker (DM) is asked to choose among a set of trade-off alternatives covering the whole Pareto-optimal front. This is a paradox in conventional evolutionary…

Neural and Evolutionary Computing · Computer Science 2022-04-07 Ke Li , Guiyu Lai , Xin Yao

Automatic prompt engineering aims to enhance the generation quality of large language models (LLMs). Recent works utilize feedbacks generated from erroneous cases to guide the prompt optimization. During inference, they may further retrieve…

Computation and Language · Computer Science 2025-05-28 Cilin Yan , Jingyun Wang , Lin Zhang , Ruihui Zhao , Xiaopu Wu , Kai Xiong , Qingsong Liu , Guoliang Kang , Yangyang Kang

Despite recent breakthroughs in the applications of deep neural networks, one setting that presents a persistent challenge is that of "one-shot learning." Traditional gradient-based networks require a lot of data to learn, often through…

Machine Learning · Computer Science 2016-05-20 Adam Santoro , Sergey Bartunov , Matthew Botvinick , Daan Wierstra , Timothy Lillicrap

Recent advances in video diffusion models have unlocked new potential for realistic audio-driven talking video generation. However, achieving seamless audio-lip synchronization, maintaining long-term identity consistency, and producing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Longtao Zheng , Yifan Zhang , Hanzhong Guo , Jiachun Pan , Zhenxiong Tan , Jiahao Lu , Chuanxin Tang , Bo An , Shuicheng Yan

The Prototypical Network (ProtoNet) has emerged as a popular choice in Few-shot Learning (FSL) scenarios due to its remarkable performance and straightforward implementation. Building upon such success, we first propose a simple (yet novel)…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-10 Xuanyu Zhuang , Geoffroy Peeters , Gaël Richard