English
Related papers

Related papers: Cross-Modal Few-Shot Learning with Second-Order Ne…

200 papers

Foundation models, such as large language models, have demonstrated success in addressing various language and image processing tasks. In this work, we introduce a multi-modal foundation model for scientific problems, named PROSE-PDE. Our…

Machine Learning · Computer Science 2025-02-04 Jingmin Sun , Yuxuan Liu , Zecheng Zhang , Hayden Schaeffer

Optimization in machine learning, both theoretical and applied, is presently dominated by first-order gradient methods such as stochastic gradient descent. Second-order optimization methods, that involve second derivatives and/or second…

Machine Learning · Computer Science 2021-03-08 Rohan Anil , Vineet Gupta , Tomer Koren , Kevin Regan , Yoram Singer

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

Few-shot learning is a fundamental and challenging problem since it requires recognizing novel categories from only a few examples. The objects for recognition have multiple variants and can locate anywhere in images. Directly comparing…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Congqi Cao , Yanning Zhang

Few-shot Learning aims to learn and distinguish new categories with a very limited number of available images, presenting a significant challenge in the realm of deep learning. Recent researchers have sought to leverage the additional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Chunpeng Zhou , Haishuai Wang , Xilu Yuan , Zhi Yu , Jiajun Bu

Few-shot learning methods offer pre-training techniques optimized for easier later adaptation of the model to new classes (unseen during training) using one or a few examples. This adaptivity to unseen classes is especially important for…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Guy Bukchin , Eli Schwartz , Kate Saenko , Ori Shahar , Rogerio Feris , Raja Giryes , Leonid Karlinsky

Object localisation, in the context of regular images, often depicts objects like people or cars. In these images, there is typically a relatively small number of objects per class, which usually is manageable to annotate. However, outside…

Machine Learning · Computer Science 2021-08-24 Andreas Panteli , Jonas Teuwen , Hugo Horlings , Efstratios Gavves

Cross-domain few-shot classification task (CD-FSC) combines few-shot classification with the requirement to generalize across domains represented by datasets. This setup faces challenges originating from the limited labeled data in each…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jiamei Sun , Sebastian Lapuschkin , Wojciech Samek , Yunqing Zhao , Ngai-Man Cheung , Alexander Binder

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

Conventional training of deep neural networks requires a large number of the annotated image which is a laborious and time-consuming task, particularly for rare objects. Few-shot object detection (FSOD) methods offer a remedy by realizing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zeyu Shangguan , Mohammad Rostami

This paper proposes the use of spectral element methods \citep{canuto_spectral_1988} for fast and accurate training of Neural Ordinary Differential Equations (ODE-Nets; \citealp{Chen2018NeuralOD}) for system identification. This is achieved…

Neural and Evolutionary Computing · Computer Science 2020-01-20 Alessio Quaglino , Marco Gallieri , Jonathan Masci , Jan Koutník

We address the problem of few-shot semantic segmentation (FSS), which aims to segment novel class objects in a target image with a few annotated samples. Though recent advances have been made by incorporating prototype-based metric…

Computer Vision and Pattern Recognition · Computer Science 2021-11-10 Hyeongjun Kwon , Somi Jeong , Sunok Kim , Kwanghoon Sohn

In this paper, we study the performance of few-shot learning, specifically meta learning empowered few-shot relation networks, over supervised deep learning and conventional machine learning approaches in the problem of Sound Source…

Sound · Computer Science 2024-10-08 Amirreza Sobhdel , Roozbeh Razavi-Far , Vasile Palade

Deep learning models have emerged as the cornerstone of medical image segmentation, but their efficacy hinges on the availability of extensive manually labeled datasets and their adaptability to unforeseen categories remains a challenge.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Lev Ayzenberg , Raja Giryes , Hayit Greenspan

Multimodal few-shot learning is challenging due to the large domain gap between vision and language modalities. Existing methods are trying to communicate visual concepts as prompts to frozen language models, but rely on hand-engineered…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Ivona Najdenkoska , Xiantong Zhen , Marcel Worring

We study the problem of few-shot learning-based denoising where the training set contains just a handful of clean and noisy samples. A solution to mitigate the small training set issue is to pre-train a denoising model with small training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-27 Leslie Casas , Attila Klimmek , Gustavo Carneiro , Nassir Navab , Vasileios Belagiannis

Few-shot image classification aims to accurately classify unlabeled images using only a few labeled samples. The state-of-the-art solutions are built by deep learning, which focuses on designing increasingly complex deep backbones.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Na Chen , Xianming Kuang , Feiyu Liu , Kehao Wang , Qun Chen

Few-shot class-incremental learning (FSCIL) is designed to incrementally recognize novel classes with only few training samples after the (pre-)training on base classes with sufficient samples, which focuses on both base-class performance…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yixiong Zou , Shanghang Zhang , Yuhua Li , Ruixuan Li

While recent progress has significantly boosted few-shot classification (FSC) performance, few-shot object detection (FSOD) remains challenging for modern learning systems. Existing FSOD systems follow FSC approaches, ignoring critical…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Tung-I Chen , Yueh-Cheng Liu , Hung-Ting Su , Yu-Cheng Chang , Yu-Hsiang Lin , Jia-Fong Yeh , Wen-Chin Chen , Winston H. Hsu

Currently, the state-of-the-art methods treat few-shot semantic segmentation task as a conditional foreground-background segmentation problem, assuming each class is independent. In this paper, we introduce the concept of meta-class, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Zhonghua Wu , Xiangxi Shi , Guosheng lin , Jianfei Cai