English
Related papers

Related papers: AMF: Adaptable Weighting Fusion with Multiple Fine…

200 papers

Image segmentation is a crucial task in computer vision, with wide-ranging applications in industry. The Segment Anything Model (SAM) has recently attracted intensive attention; however, its application in industrial inspection,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Zheming Zuo , Joseph Smith , Jonathan Stonehouse , Boguslaw Obara

Metric-based few-shot fine-grained classification has shown promise due to its simplicity and efficiency. However, existing methods often overlook task-level special cases and struggle with accurate category description and irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Ping Li , Hongbo Wang , Lei Lu

Existing fine-tuning methods either tune all parameters of the pre-trained model (full fine-tuning), which is not efficient, or only tune the last linear layer (linear probing), which suffers a significant accuracy drop compared to the full…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Dongze Lian , Daquan Zhou , Jiashi Feng , Xinchao Wang

Despite achieving state-of-the-art zero-shot performance, existing vision-language models still fall short of few-shot transfer ability on domain-specific problems. Classical fine-tuning often fails to prevent highly expressive models from…

Multimedia · Computer Science 2022-07-18 Zhenhailong Wang , Hang Yu , Manling Li , Han Zhao , Heng Ji

Most uses of machine learning today involve training a model from scratch for a particular task, or sometimes starting with a model pretrained on a related task and then fine-tuning on a downstream task. Both approaches offer limited…

Machine Learning · Computer Science 2022-05-26 Andrea Gesmundo , Jeff Dean

Reinforcement finetuning (RFT) has shown great potential for enhancing the mathematical reasoning capabilities of large language models (LLMs), but it is often sample- and compute-inefficient, requiring extensive training. In this work, we…

Machine Learning · Computer Science 2026-02-03 Taiwei Shi , Yiyang Wu , Linxin Song , Tianyi Zhou , Jieyu Zhao

Diffusion models have recently achieved remarkable success in generative modeling, yet their training dynamics across different noise levels remain highly imbalanced, which can lead to inefficient optimization and unstable learning…

Machine Learning · Computer Science 2026-03-12 Nanlong Sun , Lei Shi

The success of deep learning is inseparable from normalization layers. Researchers have proposed various normalization functions, and each of them has both advantages and disadvantages. In response, efforts have been made to design a…

Machine Learning · Computer Science 2024-02-20 Zikai Zhou , Shuo Zhang , Ziruo Wang , Huanran Chen

Fine-grained image recognition is a longstanding computer vision challenge that focuses on differentiating objects belonging to multiple subordinate categories within the same meta-category. Since images belonging to the same meta-category…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Yifan Pu , Yizeng Han , Yulin Wang , Junlan Feng , Chao Deng , Gao Huang

Fine-tuning is a widely used strategy for adapting pre-trained models to new tasks, yet its methodology and theoretical properties in high-dimensional nonparametric settings with variable selection have not yet been developed. We propose a…

Machine Learning · Statistics 2026-05-19 Jinhang Chai , Jianqing Fan , Cheng Gao , Qishuo Yin

As a specific semantic segmentation task, aerial imagery segmentation has been widely employed in high spatial resolution (HSR) remote sensing images understanding. Besides common issues (e.g. large scale variation) faced by general…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Lin Huang , Qiyuan Dong , Lijun Wu , Jia Zhang , Jiang Bian , Tie-Yan Liu

Fine-grained image recognition is central to many multimedia tasks such as search, retrieval and captioning. Unfortunately, these tasks are still challenging since the appearance of samples of the same class can be more different than those…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Pau Rodríguez López , Diego Velazquez Dorta , Guillem Cucurull Preixens , Josep M. Gonfaus , F. Xavier Roca Marva , Jordi Gonzàlez Sabaté

We propose Adaptive Multi-Style Fusion (AMSF), a reference-based training-free framework that enables controllable fusion of multiple reference styles in diffusion models. Most of the existing reference-based methods are limited by (a)…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Xu Liu , Yibo Lu , Xinxian Wang , Xinyu Wu

We study the problem of feature selection in general machine learning (ML) context, which is one of the most critical subjects in the field. Although, there exist many feature selection methods, however, these methods face challenges such…

Machine Learning · Computer Science 2024-06-18 Mehmet Y. Turali , Mehmet E. Lorasdagi , Ali T. Koc , Suleyman S. Kozat

Federated Learning using the Federated Averaging algorithm has shown great advantages for large-scale applications that rely on collaborative learning, especially when the training data is either unbalanced or inaccessible due to privacy…

Machine Learning · Computer Science 2021-07-21 Jonatan Reyes , Lisa Di Jorio , Cecile Low-Kam , Marta Kersten-Oertel

News text classification is a crucial task in natural language processing, essential for organizing and filtering the massive volume of digital content. Traditional methods typically rely on statistical features like term frequencies or…

Computation and Language · Computer Science 2025-11-24 Mohammad Zare

The goal of this paper is to design image classification systems that, after an initial multi-task training phase, can automatically adapt to new tasks encountered at test time. We introduce a conditional neural process based approach to…

Machine Learning · Statistics 2020-07-14 James Requeima , Jonathan Gordon , John Bronskill , Sebastian Nowozin , Richard E. Turner

Fine-tuning pre-trained foundation models has gained significant popularity in various research fields. Existing methods for fine-tuning can be roughly divided into two categories, namely Parameter-Efficient Fine-Tuning and High-Performance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Peng Ye , Yongqi Huang , Chongjun Tu , Minglei Li , Tao Chen , Tong He , Wanli Ouyang

In recent years, convolutional neural networks (CNNs) have achieved impressive performance for various visual recognition scenarios. CNNs trained on large labeled datasets can not only obtain significant performance on most challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Xiangyang Li , Luis Herranz , Shuqiang Jiang

Transfer learning is the predominant paradigm for training deep networks on small target datasets. Models are typically pretrained on large ``upstream'' datasets for classification, as such labels are easy to collect, and then finetuned on…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Anurag Arnab , Xuehan Xiong , Alexey Gritsenko , Rob Romijnders , Josip Djolonga , Mostafa Dehghani , Chen Sun , Mario Lučić , Cordelia Schmid