English
Related papers

Related papers: Cross-Modal Few-Shot Learning with Second-Order Ne…

200 papers

Scaling deep neural network (DNN) training to more devices can reduce time-to-solution. However, it is impractical for users with limited computing resources. FOSI, as a hybrid order optimizer, converges faster than conventional optimizers…

Machine Learning · Computer Science 2025-08-05 Shunxian Gu , Chaoqun You , Bangbang Ren , Lailong Luo , Junxu Xia , Deke Guo

Recent works in deep-learning have shown that second-order information is beneficial in many computer-vision tasks. Second-order information can be enforced both in the spatial context and the abstract feature dimensions. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Tony Ng , Vassileios Balntas , Yurun Tian , Krystian Mikolajczyk

Few-shot learning aims to train models that can be generalized to novel classes with only a few samples. Recently, a line of works are proposed to enhance few-shot learning with accessible semantic information from class names. However,…

Machine Learning · Computer Science 2023-07-11 Zihao Jiang , Yunkai Dang , Dong Pang , Huishuai Zhang , Weiran Huang

Second-order methods hold significant promise for enhancing the convergence of deep neural network training; however, their large memory and computational demands have limited their practicality. Thus there is a need for scalable…

Machine Learning · Computer Science 2023-11-17 Fnu Devvrit , Sai Surya Duvvuri , Rohan Anil , Vineet Gupta , Cho-Jui Hsieh , Inderjit Dhillon

Speckle noise has long been an extensively studied problem in medical imaging. In recent years, there have been significant advances in leveraging deep learning methods for noise reduction. Nevertheless, adaptation of supervised learning…

Image and Video Processing · Electrical Eng. & Systems 2023-06-21 Deborah Pereg

Few-shot learning has attracted intensive research attention in recent years. Many methods have been proposed to generalize a model learned from provided base classes to novel classes, but no previous work studies how to select base…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Linjun Zhou , Peng Cui , Xu Jia , Shiqiang Yang , Qi Tian

Few-shot object detection (FSOD) aims to classify and detect few images of novel categories. Existing meta-learning methods insufficiently exploit features between support and query images owing to structural limitations. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Dongwoo Park , Jong-Min Lee

Over the past few years, state-of-the-art image segmentation algorithms are based on deep convolutional neural networks. To render a deep network with the ability to understand a concept, humans need to collect a large amount of pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2020-03-25 Weide Liu , Chi Zhang , Guosheng Lin , Fayao Liu

Few-shot segmentation (FSS) is a dense prediction task that aims to infer the pixel-wise labels of unseen classes using only a limited number of annotated images. The key challenge in FSS is to classify the labels of query pixels using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Wenbo Xu , Huaxi Huang , Ming Cheng , Litao Yu , Qiang Wu , Jian Zhang

Although providing exceptional results for many computer vision tasks, state-of-the-art deep learning algorithms catastrophically struggle in low data scenarios. However, if data in additional modalities exist (e.g. text) this can…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Frederik Pahde , Mihai Puscas , Tassilo Klein , Moin Nabi

Neural ordinary differential equations (NODEs) presented a new paradigm to construct (continuous-time) neural networks. While showing several good characteristics in terms of the number of parameters and the flexibility in constructing…

Machine Learning · Computer Science 2021-06-01 Sheo Yon Jhin , Minju Jo , Taeyong Kong , Jinsung Jeon , Noseong Park

Most few-shot learning works rely on the same domain assumption between the base and the target tasks, hindering their practical applications. This paper proposes an adaptive transformer network (ADAPTER), a simple but effective solution…

Machine Learning · Computer Science 2024-01-26 Naeem Paeedeh , Mahardhika Pratama , Muhammad Anwar Ma'sum , Wolfgang Mayer , Zehong Cao , Ryszard Kowlczyk

Combining the respective advantages of cross-modality images can compensate for the lack of information in the single modality, which has attracted increasing attention of researchers into multi-modal image matching tasks. Meanwhile, due to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Shasha Mei

Multivariate time series classification is an important task with widespread domains of applications. Recently, deep neural networks (DNN) have achieved state-of-the-art performance in time series classification. However, they often require…

Machine Learning · Computer Science 2024-09-17 Jesus Barreda , Ashley Gomez , Ruben Puga , Kaixiong Zhou , Li Zhang

Few-shot object detection (FSOD) aims to detect never-seen objects using few examples. This field sees recent improvement owing to the meta-learning techniques by learning how to match between the query image and few-shot class examples,…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Guangxing Han , Yicheng He , Shiyuan Huang , Jiawei Ma , Shih-Fu Chang

Current state-of-the-art methods for panoptic segmentation require an immense amount of annotated training data that is both arduous and expensive to obtain posing a significant challenge for their widespread adoption. Concurrently, recent…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Markus Käppeler , Kürsat Petek , Niclas Vödisch , Wolfram Burgard , Abhinav Valada

Fourier Neural Operators (FNO) offer a principled approach to solving challenging partial differential equations (PDE) such as turbulent flows. At the core of FNO is a spectral layer that leverages a discretization-convergent representation…

Machine Learning · Computer Science 2024-03-06 Robert Joseph George , Jiawei Zhao , Jean Kossaifi , Zongyi Li , Anima Anandkumar

In-context learning, which offers substantial advantages over fine-tuning, is predominantly observed in decoder-only models, while encoder-decoder (i.e., seq2seq) models excel in methods that rely on weight updates. Recently, a few studies…

Computation and Language · Computer Science 2024-08-28 Jihyeon Lee , Dain Kim , Doohae Jung , Boseop Kim , Kyoung-Woon On

Few-shot Learning (FSL) methods are being adopted in settings where data is not abundantly available. This is especially seen in medical domains where the annotations are expensive to obtain. Deep Neural Networks have been shown to be…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Prashant Pandey , Aleti Vardhan , Mustafa Chasmai , Tanuj Sur , Brejesh Lall

In recent years, soft prompt learning methods have been proposed to fine-tune large-scale vision-language pre-trained models for various downstream tasks. These methods typically combine learnable textual tokens with class tokens as input…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Yingjie Tian , Yiqi Wang , Xianda Guo , Zheng Zhu , Long Chen