English
Related papers

Related papers: Text-guided Foundation Model Adaptation for Long-T…

200 papers

Structured data is widely used in domains such as healthcare, finance, and scientific data management. Recent studies on structured data foundation models (SFMs) aim to support data analysis and mining tasks over such data, but still face…

Machine Learning · Computer Science 2026-05-21 Zhenghang Song , Tang Qian , Lu Chen , Yushuai Li , Zhengke Hu , Bingbing Fang , Yumeng Song , Junbo Zhao , Sheng Zhang , Tianyi Li

The visual world naturally exhibits a long-tailed distribution of open classes, which poses great challenges to modern visual systems. Existing approaches either perform class re-balancing strategies or directly improve network modules to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Teli Ma , Shijie Geng , Mengmeng Wang , Jing Shao , Jiasen Lu , Hongsheng Li , Peng Gao , Yu Qiao

The current mainstream multi-modal medical image-to-image translation methods face a contradiction. Supervised methods with outstanding performance rely on pixel-wise aligned training data to constrain the model optimization. However,…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Langrui Zhou , Guang Li

Foundation models have emerged as a powerful tool for many AI problems. Despite the tremendous success of foundation models, effective adaptation to new tasks, particularly those with limited labels, remains an open question and lacks…

Machine Learning · Computer Science 2024-02-26 Zhuoyan Xu , Zhenmei Shi , Junyi Wei , Fangzhou Mu , Yin Li , Yingyu Liang

Data in the real world tends to exhibit a long-tailed label distribution, which poses great challenges for the training of neural networks in visual recognition. Existing methods tackle this problem mainly from the perspective of data…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Yan Zhao , Weicong Chen , Xu Tan , Kai Huang , Jihong Zhu

Long-tailed data is prevalent in real-world classification tasks and heavily relies on supervised information, which makes the annotation process exceptionally labor-intensive and time-consuming. Unfortunately, despite being a common…

Machine Learning · Computer Science 2024-12-04 Meng Wei , Zhongnian Li , Yong Zhou , Xinzheng Xu

Fine-tuning on task-specific question-answer pairs is a predominant method for enhancing the performance of instruction-tuned large language models (LLMs) on downstream tasks. However, in certain specialized domains, such as healthcare or…

Computation and Language · Computer Science 2024-10-18 Shuyang Jiang , Yusheng Liao , Ya Zhang , Yanfeng Wang , Yu Wang

Performance of neural network models relies on the availability of large datasets with minimal levels of uncertainty. Transfer Learning (TL) models have been proposed to resolve the issue of small dataset size by letting the model train on…

Federated learning is designed to enhance data security and privacy, but faces challenges when dealing with heterogeneous data in long-tailed and non-IID distributions. This paper explores an overlooked scenario where tail classes are…

Machine Learning · Computer Science 2024-03-14 Zhuoxin Chen , Zhenyu Wu , Yang Ji

Data collected from the real world typically exhibit long-tailed distributions, where frequent classes contain abundant data while rare ones have only a limited number of samples. While existing supervised learning approaches have been…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Ci-Siang Lin , Min-Hung Chen , Yu-Chiang Frank Wang

Deep learning algorithms face great challenges with long-tailed data distribution which, however, is quite a common case in real-world scenarios. Previous methods tackle the problem from either the aspect of input space (re-sampling classes…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jiequan Cui , Shu Liu , Zhuotao Tian , Zhisheng Zhong , Jiaya Jia

Deep learning relies heavily on data augmentation to mitigate limited data, especially in medical imaging. Recent multimodal learning integrates text and images for segmentation, known as referring or text-guided image segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Shurong Chai , Rahul Kumar JAIN , Rui Xu , Shaocong Mo , Ruibo Hou , Shiyu Teng , Jiaqing Liu , Lanfen Lin , Yen-Wei Chen

Foundation models (FMs) have demonstrated strong transferability across medical imaging tasks, yet their clinical utility depends critically on how pretrained representations are adapted to domain-specific data, supervision regimes, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Real-world training data usually exhibits long-tailed distribution, where several majority classes have a significantly larger number of samples than the remaining minority classes. This imbalance degrades the performance of typical…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Shuang Li , Kaixiong Gong , Chi Harold Liu , Yulin Wang , Feng Qiao , Xinjing Cheng

Large Vision-Language Models (LVLMs) have achieved significant progress in combining visual comprehension with language generation. Despite this success, the training data of LVLMs still suffers from Long-Tail (LT) problems, where the data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Mingyang Song , Xiaoye Qu , Jiawei Zhou , Yu Cheng

Despite the recent success of deep neural networks, it remains challenging to effectively model the long-tail class distribution in visual recognition tasks. To address this problem, we first investigate the performance bottleneck of the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Songyang Zhang , Zeming Li , Shipeng Yan , Xuming He , Jian Sun

Recent advances in training vision-language models have demonstrated unprecedented robustness and transfer learning effectiveness; however, standard computer vision datasets are image-only, and therefore not well adapted to such training…

Computer Vision and Pattern Recognition · Computer Science 2023-02-22 Andre Nakkab , Benjamin Feuer , Chinmay Hegde

Self-supervised learning in the federated learning paradigm has been gaining a lot of interest both in industry and research due to the collaborative learning capability on unlabeled yet isolated data. However, self-supervised based…

Machine Learning · Computer Science 2025-02-05 Sunder Ali Khowaja , Kapal Dev , Syed Muhammad Anwar , Marius George Linguraru

Medical report generation demands automatic creation of coherent and precise descriptions for medical images. However, the scarcity of labelled medical image-report pairs poses formidable challenges in developing large-scale neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Shibin Wu , Bang Yang , Zhiyu Ye , Haoqian Wang , Hairong Zheng , Tong Zhang

State-of-the-art face recognition (FR) models often experience a significant performance drop when dealing with facial images in surveillance scenarios where images are in low quality and often corrupted with noise. Leveraging facial…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Md Mahedi Hasan , Shoaib Meraj Sami , Nasser Nasrabadi