English
Related papers

Related papers: LTDA-Drive: LLMs-guided Generative Models based Lo…

200 papers

Real-world data are long-tailed, the lack of tail samples leads to a significant limitation in the generalization ability of the model. Although numerous approaches of class re-balancing perform well for moderate class imbalance problems,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yanbiao Ma , Licheng Jiao , Fang Liu , Shuyuan Yang , Xu Liu , Puhua Chen

Training a model for food recognition is challenging because the training samples, which are typically crawled from the Internet, are visually different from the pictures captured by users in the free-living environment. In addition to this…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Qing Wang , Chong-Wah Ngo , Ee-Peng Lim , Qianru Sun

Real-world point cloud datasets have made significant contributions to the development of LiDAR-based perception technologies, such as object segmentation for autonomous driving. However, due to the limited number of instances in some rare…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Shutong Lin , Zhengkang Xiang , Jianzhong Qi , Kourosh Khoshelham

Large Language Models (LLMs) are increasingly used for decision-making and planning in autonomous driving, showing promising reasoning capabilities and potential to generalize across diverse traffic situations. However, current LLM-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Fabian Schmidt , Noushiq Mohammed Kayilan Abdul Nazar , Markus Enzweiler , Abhinav Valada

Diffusion-based models have shown the merits of generating high-quality visual data while preserving better diversity in recent studies. However, such observation is only justified with curated data distribution, where the data samples are…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Yiming Qin , Huangjie Zheng , Jiangchao Yao , Mingyuan Zhou , Ya Zhang

To effectively use large language models (LLMs) for real-world queries, it is imperative that they generalize to the long-tail distribution, i.e. rare examples where models exhibit low confidence. In this work, we take the first step…

Computation and Language · Computer Science 2024-10-07 Huihan Li , Yuting Ning , Zeyi Liao , Siyuan Wang , Xiang Lorraine Li , Ximing Lu , Wenting Zhao , Faeze Brahman , Yejin Choi , Xiang Ren

Long-tail learning has received significant attention in recent years due to the challenge it poses with extremely imbalanced datasets. In these datasets, only a few classes (known as the head classes) have an adequate number of training…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Jiang-Xin Shi , Tong Wei , Yuke Xiang , Yu-Feng Li

Recently, large-scale pre-trained vision-language models have presented benefits for alleviating class imbalance in long-tailed recognition. However, the long-tailed data distribution can corrupt the representation space, where the distance…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Siming Fu , Xiaoxuan He , Xinpeng Ding , Yuchen Cao , Hualiang Wang

Continuous efforts are being made to advance anomaly detection in various manufacturing processes to increase the productivity and safety of industrial sites. Deep learning replaced rule-based methods and recently emerged as a promising…

Machine Learning · Computer Science 2024-06-28 Kukjin Choi , Jihun Yi , Jisoo Mok , Sungroh Yoon

Object detection has been widely explored for class-balanced datasets such as COCO. However, real-world scenarios introduce the challenge of long-tailed distributions, where numerous categories contain only a few instances. This inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Satyam Gaba

3D conducting motion generation aims to synthesize fine-grained conductor motions from music, with broad potential in music education, virtual performance, digital human animation, and human-AI co-creation. However, this task remains…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Tianzhi Jia , Kaixing Yang , Xiaole Yang , Xulong Tang , Ke Qiu , Shikui Wei , Yao Zhao

Effectively handling the co-occurrence of non-IID data and long-tailed distributions remains a critical challenge in federated learning. While fine-tuning vision-language models (VLMs) like CLIP has shown to be promising in addressing…

Machine Learning · Computer Science 2025-03-11 Shihao Hou , Xinyi Shang , Shreyank N Gowda , Yang Lu , Chao Wu , Yan Yan , Hanzi Wang

Large language models (LLMs) can learn vast amounts of knowledge from diverse domains during pre-training. However, long-tail knowledge from specialized domains is often scarce and underrepresented, rarely appearing in the models'…

Computation and Language · Computer Science 2025-02-11 Shuyang Yu , Runxue Bao , Parminder Bhatia , Taha Kass-Hout , Jiayu Zhou , Cao Xiao

This paper considers learning deep features from long-tailed data. We observe that in the deep feature space, the head classes and the tail classes present different distribution patterns. The head classes have a relatively large spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Jialun Liu , Yifan Sun , Chuchu Han , Zhaopeng Dou , Wenhui Li

Current out-of-distribution (OOD) detection methods typically assume balanced in-distribution (ID) data, while most real-world data follow a long-tailed distribution. Previous approaches to long-tailed OOD detection often involve balancing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Yina He , Lei Peng , Yongcun Zhang , Juanjuan Weng , Zhiming Luo , Shaozi Li

Dataset distillation creates a small distilled set that enables efficient training by capturing key information from the full dataset. While existing dataset distillation methods perform well on balanced datasets, they struggle under…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Xiao Cui , Yulei Qin , Xinyue Li , Wengang Zhou , Hongsheng Li , Houqiang Li

Data in real-world object detection often exhibits the long-tailed distribution. Existing solutions tackle this problem by mitigating the competition between the head and tail categories. However, due to the scarcity of training samples,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Bo Li , Yongqiang Yao , Jingru Tan , Xin Lu , Fengwei Yu , Ye Luo , Jianwei Lu

Real-world data is often unbalanced and long-tailed, but deep models struggle to recognize rare classes in the presence of frequent classes. To address unbalanced data, most studies try balancing the data, the loss, or the classifier to…

Machine Learning · Computer Science 2021-11-02 Dvir Samuel , Gal Chechik

Large language models (LLMs) have significantly advanced various natural language processing tasks, but deploying them remains computationally expensive. Knowledge distillation (KD) is a promising solution, enabling the transfer of…

Computation and Language · Computer Science 2024-10-22 Yuhang Zhou , Jing Zhu , Paiheng Xu , Xiaoyu Liu , Xiyao Wang , Danai Koutra , Wei Ai , Furong Huang

Controllable video generation has emerged as a versatile tool for autonomous driving, enabling realistic synthesis of traffic scenarios. However, existing methods depend on control signals at inference time to guide the generative model…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Mirlan Karimov , Teodora Spasojevic , Markus Braun , Julian Wiederer , Vasileios Belagiannis , Marc Pollefeys