English
Related papers

Related papers: Long-tailed Distribution Adaptation

200 papers

In conventional domain adaptation, a critical assumption is that there exists a fully labeled domain (source) that contains the same label space as another unlabeled or scarcely labeled domain (target). However, in the real world, there…

Machine Learning · Computer Science 2019-05-01 Shuhan Tan , Jiening Jiao , Wei-Shi Zheng

Machine learning models often struggle to generalize across domains with varying data distributions, such as differing noise levels, leading to degraded performance. Traditional strategies like personalized training, which trains separate…

Machine Learning · Computer Science 2026-04-07 Snehaa Reddy , Jayaprakash Katual , Satish Mulleti

In the presence of large sets of labeled data, Deep Learning (DL) has accomplished extraordinary triumphs in the avenue of computer vision, particularly in object classification and recognition tasks. However, DL cannot always perform well…

Computer Vision and Pattern Recognition · Computer Science 2019-01-03 Mohammad Mahfujur Rahman , Clinton Fookes , Mahsa Baktashmotlagh , Sridha Sridharan

Unsupervised domain adaptation is a promising way to generalize deep models to novel domains. However, the current literature assumes that the label distribution is domain-invariant and only aligns the feature distributions or vice versa.…

Machine Learning · Computer Science 2020-09-22 Shuhan Tan , Xingchao Peng , Kate Saenko

Long-tailed recognition with imbalanced class distribution naturally emerges in practical machine learning applications. Existing methods such as data reweighing, resampling, and supervised contrastive learning enforce the class balance…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chengkai Hou , Jieyu Zhang , Haonan Wang , Tianyi Zhou

Domain shift poses a significant challenge in cross-domain spoken language recognition (SLR) by reducing its effectiveness. Unsupervised domain adaptation (UDA) algorithms have been explored to address domain shifts in SLR without relying…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 Xugang Lu , Peng Shen , Yu Tsao , Hisashi Kawai

Unsupervised Domain Adaptation (UDA) approaches address the covariate shift problem by minimizing the distribution discrepancy between the source and target domains, assuming that the label distribution is invariant across domains. However,…

Machine Learning · Computer Science 2023-08-22 Xiaona Sun , Zhenyu Wu , Yichen Liu , Saier Hu , Zhiqiang Zhan , Yang Ji

Current out-of-distribution (OOD) detection methods typically assume balanced in-distribution (ID) data, while most real-world data follow a long-tailed distribution. Previous approaches to long-tailed OOD detection often involve balancing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Yina He , Lei Peng , Yongcun Zhang , Juanjuan Weng , Zhiming Luo , Shaozi Li

Machine learning algorithms have revolutionized different fields, including natural language processing, computer vision, signal processing, and medical data processing. Despite the excellent capabilities of machine learning algorithms in…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Gita Sarafraz , Armin Behnamnia , Mehran Hosseinzadeh , Ali Balapour , Amin Meghrazi , Hamid R. Rabiee

3D perception plays an essential role for improving the safety and performance of autonomous driving. Yet, existing models trained on real-world datasets, which naturally exhibit long-tail distributions, tend to underperform on rare and…

Robotics · Computer Science 2025-05-27 Mahmut Yurt , Xin Ye , Yunsheng Ma , Jingru Luo , Abhirup Mallik , John Pauly , Burhaneddin Yaman , Liu Ren

In this study, we focus on the unsupervised domain adaptation problem where an approximate inference model is to be learned from a labeled data domain and expected to generalize well to an unlabeled data domain. The success of unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Jing Wang , Jiahong Chen , Jianzhe Lin , Leonid Sigal , Clarence W. de Silva

Classification on long-tailed distributed data is a challenging problem, which suffers from serious class-imbalance and hence poor performance on tail classes with only a few samples. Owing to this paucity of samples, learning on the tail…

Computation and Language · Computer Science 2022-07-25 Taha ValizadehAslani , Yiwen Shi , Jing Wang , Ping Ren , Yi Zhang , Meng Hu , Liang Zhao , Hualou Liang

Unsupervised domain adaptation (UDA) in 3D segmentation tasks presents a formidable challenge, primarily stemming from the sparse and unordered nature of point cloud data. Especially for LiDAR point clouds, the domain discrepancy becomes…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Xidong Peng , Runnan Chen , Feng Qiao , Lingdong Kong , Youquan Liu , Yujing Sun , Tai Wang , Xinge Zhu , Yuexin Ma

Real-world data typically follow a long-tailed distribution, where a few majority categories occupy most of the data while most minority categories contain a limited number of samples. Classification models minimizing cross-entropy struggle…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Jianggang Zhu , Zheng Wang , Jingjing Chen , Yi-Ping Phoebe Chen , Yu-Gang Jiang

We introduce an algorithm for tackling the problem of unsupervised domain adaptation (UDA) in continual learning (CL) scenarios. The primary objective is to maintain model generalization under domain shift when new domains arrive…

Machine Learning · Computer Science 2024-02-02 Mohammad Rostami

Learning deep neural networks that are generalizable across different domains remains a challenge due to the problem of domain shift. Unsupervised domain adaptation is a promising avenue which transfers knowledge from a source domain to a…

Machine Learning · Computer Science 2020-08-20 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

Long-tailed problems in healthcare emerge from data imbalance due to variability in the prevalence and representation of different medical conditions, warranting the requirement of precise and dependable classification methods. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Pankhi Kashyap , Pavni Tandon , Sunny Gupta , Abhishek Tiwari , Ritwik Kulkarni , Kshitij Sharad Jadhav

In this paper, we address the problem of unsupervised Domain Adaptation. The need for such an adaptation arises when the distribution of the target data differs from that which is used to develop the model and the ground truth information…

Machine Learning · Computer Science 2022-10-04 Siddharth Roheda , Ashkan Panahi , Hamid Krim

We characterise the learning of a mixture of two clouds of data points with generic centroids via empirical risk minimisation in the high dimensional regime, under the assumptions of generic convex loss and convex regularisation. Each cloud…

Machine Learning · Statistics 2024-03-19 Urte Adomaityte , Gabriele Sicuro , Pierpaolo Vivo

Although deep neural networks achieve tremendous success on various classification tasks, the generalization ability drops sheer when training datasets exhibit long-tailed distributions. One of the reasons is that the learned…

Machine Learning · Computer Science 2023-02-27 Xuantong Liu , Jianfeng Zhang , Tianyang Hu , He Cao , Lujia Pan , Yuan Yao