English
Related papers

Related papers: Learning Transferrable Parameters for Long-tailed …

200 papers

We have been witnessing the usefulness of conversational AI systems such as Siri and Alexa, directly impacting our daily lives. These systems normally rely on machine learning models evolving over time to provide quality user experience.…

Machine Learning · Computer Science 2021-04-28 Cheng Wang , Sun Kim , Taiwoo Park , Sajal Choudhary , Sunghyun Park , Young-Bum Kim , Ruhi Sarikaya , Sungjin Lee

Digital transformation forces companies to rethink their processes to meet current customer needs. Business Process Management (BPM) can provide the means to structure and tackle this change. However, most approaches to BPM face…

Software Engineering · Computer Science 2020-12-02 Marcus Fischer , Adrian Hofmann , Florian Imgrund , Christian Janiesch , Axel Winkelmann

Many real-world prediction tasks have outcome variables that have characteristic heavy-tail distributions. Examples include copies of books sold, auction prices of art pieces, demand for commodities in warehouses, etc. By learning…

Machine Learning · Computer Science 2023-10-13 Xindi Wang , Onur Varol , Tina Eliassi-Rad

User behavior modeling is a key technique for recommender systems. However, most methods focus on head users with large-scale interactions and hence suffer from data sparsity issues. Several solutions integrate side information such as…

Information Retrieval · Computer Science 2021-01-01 Lifang Deng , Jin Niu , Angulia Yang , Qidi Xu , Xiang Fu , Jiandong Zhang , Anxiang Zeng

The fine-tuning paradigm in addressing long-tail learning tasks has sparked significant interest since the emergence of foundation models. Nonetheless, how fine-tuning impacts performance in long-tail learning was not explicitly quantified.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Jiang-Xin Shi , Tong Wei , Zhi Zhou , Jie-Jing Shao , Xin-Yan Han , Yu-Feng Li

Long-tail recognition tackles the natural non-uniformly distributed data in real-world scenarios. While modern classifiers perform well on populated classes, its performance degrades significantly on tail classes. Humans, however, are less…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Tz-Ying Wu , Pedro Morgado , Pei Wang , Chih-Hui Ho , Nuno Vasconcelos

In the real-world setting, data often follows a long-tailed distribution, where head classes contain significantly more training samples than tail classes. Consequently, models trained on such data tend to be biased toward head classes. The…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Fan Zhang , Wei Qin , Weijieying Ren , Lei Wang , Zetong Chen , Richang Hong

Federated learning offers a paradigm to the challenge of preserving privacy in distributed machine learning. However, datasets distributed across each client in the real world are inevitably heterogeneous, and if the datasets can be…

Machine Learning · Computer Science 2024-09-19 Xiuhua Lu , Peng Li , Xuefeng Jiang

Balancing training on long-tail data distributions remains a long-standing challenge in deep learning. While methods such as re-weighting and re-sampling help alleviate the imbalance issue, limited sample diversity continues to hinder…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Shizhen Zhao , Xin Wen , Jiahui Liu , Chuofan Ma , Chunfeng Yuan , Xiaojuan Qi

Large Language Model-based Recommender Systems (LRSs) have recently emerged as a new paradigm in sequential recommendation by directly adopting LLMs as backbones. While LRSs demonstrate strong knowledge utilization and instruction-following…

Information Retrieval · Computer Science 2026-03-16 Jiaming Zhang , Yuyuan Li , Xiaohua Feng , Li Zhang , Longfei Li , Jun Zhou , Chaochao Chen

Graph Convolutional Networks (GCNs) has demonstrated promising results for recommender systems, as they can effectively leverage high-order relationship. However, these methods usually encounter data sparsity issue in real-world scenarios.…

Information Retrieval · Computer Science 2023-09-21 Qian Zhao , Zhengwei Wu , Zhiqiang Zhang , Jun Zhou

The real-world data distribution is essentially long-tailed, which poses great challenge to the deep model. In this work, we propose a new method, Gradual Balanced Loss and Adaptive Feature Generator (GLAG) to alleviate imbalance. GLAG…

Computer Vision and Pattern Recognition · Computer Science 2022-03-02 Zihan Zhang , Xiang Xiang

Benchmark datasets for visual recognition assume that data is uniformly distributed, while real-world datasets obey long-tailed distribution. Current approaches handle the long-tailed problem to transform the long-tailed dataset to uniform…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Renhui Zhang , Tiancheng Lin , Rui Zhang , Yi Xu

For long-tailed classification, most works often pretrain a big model on a large-scale dataset, and then fine-tune the whole model for adapting to long-tailed data. Though promising, fine-tuning the whole pretrained model tends to suffer…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Bowen Dong , Pan Zhou , Shuicheng Yan , Wangmeng Zuo

Deep neural networks still struggle on long-tailed image datasets, and one of the reasons is that the imbalance of training data across categories leads to the imbalance of trained model parameters. Motivated by the empirical findings that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Haoxuan Wang , Junchi Yan

Remarkable progress has been made in object instance detection and segmentation in recent years. However, existing state-of-the-art methods are mostly evaluated with fairly balanced and class-limited benchmarks, such as Microsoft COCO…

Computer Vision and Pattern Recognition · Computer Science 2020-08-03 Tao Wang , Yu Li , Bingyi Kang , Junnan Li , Jun Hao Liew , Sheng Tang , Steven Hoi , Jiashi Feng

Semantic segmentation usually suffers from a long-tail data distribution. Due to the imbalanced number of samples across categories, the features of those tail classes may get squeezed into a narrow area in the feature space. Towards a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Yuchao Wang , Jingjing Fei , Haochen Wang , Wei Li , Tianpeng Bao , Liwei Wu , Rui Zhao , Yujun Shen

As a safety critical task, autonomous driving requires accurate predictions of road users' future trajectories for safe motion planning, particularly under challenging conditions. Yet, many recent deep learning methods suffer from a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Junrui Zhang , Mozhgan Pourkeshavarz , Amir Rasouli

Convolutional neural networks have achieved great improvement on face recognition in recent years because of its extraordinary ability in learning discriminative features of people with different identities. To train such a well-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xiao Zhang , Zhiyuan Fang , Yandong Wen , Zhifeng Li , Yu Qiao

Natural data are often long-tail distributed over semantic classes. Existing recognition methods tackle this imbalanced classification by placing more emphasis on the tail data, through class re-balancing/re-weighting or ensembling over…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Xudong Wang , Long Lian , Zhongqi Miao , Ziwei Liu , Stella X. Yu