English
Related papers

Related papers: FASA: Feature Augmentation and Sampling Adaptation…

200 papers

Conventional detection networks usually need abundant labeled training samples, while humans can learn new concepts incrementally with just a few examples. This paper focuses on a more challenging but realistic class-incremental few-shot…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Pengyang Li , Yanan Li , Han Cui , Donghui Wang

Low-Rank Adaptation (LoRA) has emerged as a dominant method in Parameter-Efficient Fine-Tuning (PEFT) for large language models, which augments the transformer layer with one down-projection $A$ and one up-projection $B$. However, LoRA's…

Computation and Language · Computer Science 2026-03-03 Qin Dong , Yuntian Tang , Heming Jia , Yunhang Shen , Bohan Jia , Wenxuan Huang , Lianyue Zhang , Jiao Xie , Shaohui Lin , Rongrong Ji

Although the current different types of SAM adaptation methods have achieved promising performance for various downstream tasks, such as prompt-based ones and adapter-based ones, most of them belong to the one-step adaptation paradigm. In…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Jinglong Yang , Yichen Wu , Jun Cen , Wenjian Huang , Hong Wang , Jianguo Zhang

The natural world is long-tailed: rare classes are observed orders of magnitudes less frequently than common ones, leading to highly-imbalanced data where rare classes can have only handfuls of examples. Learning from few examples is a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Edoardo Lanzini , Sara Beery

Point cloud representation has gained traction due to its efficient memory usage and simplicity in acquisition, manipulation, and storage. However, as point cloud sizes increase, effective down-sampling becomes essential to address the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Shubham Bhardwaj , Ashwin Vinod , Soumojit Bhattacharya , Aryan Koganti , Aditya Sai Ellendula , Balakrishna Reddy

We describe a simple method for unsupervised domain adaptation, whereby the discrepancy between the source and target distributions is reduced by swapping the low-frequency spectrum of one with the other. We illustrate the method in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Yanchao Yang , Stefano Soatto

Self-supervised adaptation (SSA) improves foundation model transfer to medical domains but is computationally prohibitive. Although parameter efficient fine-tuning methods such as LoRA have been explored for supervised adaptation, their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Moein Sorkhei , Emir Konuk , Jingyu Guo , Chanjuan Meng , Christos Matsoukas , Kevin Smith

Despite their success in various vision tasks, deep neural network architectures often underperform in out-of-distribution scenarios due to the difference between training and target domain style. To address this limitation, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Robin Gerster , Holger Caesar , Matthias Rapp , Alexander Wolpert , Michael Teutsch

Test-time adaptation (TTA) aims to adapt a model, initially trained on training data, to test data with potential distribution shifts. Most existing TTA methods focus on classification problems. The pronounced success of classification…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Chang'an Yi , Haotian Chen , Yifan Zhang , Yonghui Xu , Yan Zhou , Lizhen Cui

Federated Domain Adaptation (FDA) is a federated learning (FL) approach that improves model performance at the target client by collaborating with source clients while preserving data privacy. FDA faces two primary challenges: domain shifts…

Machine Learning · Computer Science 2025-09-16 Mrinmay Sen , Ankita Das , Sidhant Nair , C Krishna Mohan

Fine-tuning is a widely used strategy for adapting pre-trained models to new tasks, yet its methodology and theoretical properties in high-dimensional nonparametric settings with variable selection have not yet been developed. We propose a…

Machine Learning · Statistics 2026-05-19 Jinhang Chai , Jianqing Fan , Cheng Gao , Qishuo Yin

We propose Power Slow Feature Analysis, a gradient-based method to extract temporally slow features from a high-dimensional input stream that varies on a faster time-scale, as a variant of Slow Feature Analysis (SFA) that allows end-to-end…

Machine Learning · Computer Science 2019-07-19 Merlin Schüler , Hlynur Davíð Hlynsson , Laurenz Wiskott

Temporal Action Segmentation (TAS) is an essential task in video analysis, aiming to segment and classify continuous frames into distinct action segments. However, the ambiguous boundaries between actions pose a significant challenge for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Shuaibing Wang , Shunli Wang , Mingcheng Li , Dingkang Yang , Haopeng Kuang , Ziyun Qian , Lihua Zhang

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

Machine Learning · Statistics 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten

The Segment Anything Model (SAM) has advanced interactive segmentation but is limited by the high computational cost on high-resolution images. This requires downsampling to meet GPU constraints, sacrificing the fine-grained details needed…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 You Huang , Wenbin Lai , Jiayi Ji , Liujuan Cao , Shengchuan Zhang , Rongrong Ji

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

Machine Learning · Computer Science 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

Incremental Few-Shot Semantic Segmentation (iFSS) tackles a task that requires a model to continually expand its segmentation capability on novel classes using only a few annotated examples. Typical incremental approaches encounter a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Wenbo Xu , Yanan Wu , Haoran Jiang , Yang Wang , Qiang Wu , Jian Zhang

Robust semantic segmentation under adverse conditions is crucial in real-world applications. To address this challenging task in practical scenarios where labeled normal condition images are not accessible in training, we propose FREST, a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Sohyun Lee , Namyup Kim , Sungyeon Kim , Suha Kwak

Automatic Speech Recognition (ASR) for adults' speeches has made significant progress by employing deep neural network (DNN) models recently, but improvement in children's speech is still unsatisfactory due to children's speech's distinct…

Computation and Language · Computer Science 2024-06-27 Dancheng Liu , Jinjun Xiong

Long-tailed class distributions are prevalent among the practical applications of object detection and instance segmentation. Prior work in long-tail instance segmentation addresses the imbalance of losses between rare and frequent…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Ting-I Hsieh , Esther Robb , Hwann-Tzong Chen , Jia-Bin Huang