English
Related papers

Related papers: OSDTW: Optimal Shared Depth and Task Weighting for…

200 papers

Federated Long-Tailed Learning (Fed-LT), a paradigm wherein data collected from decentralized local clients manifests a globally prevalent long-tailed distribution, has garnered considerable attention in recent times. In the context of…

Machine Learning · Computer Science 2024-03-11 Zikai Xiao , Zihan Chen , Liyinglan Liu , Yang Feng , Jian Wu , Wanlu Liu , Joey Tianyi Zhou , Howard Hao Yang , Zuozhu Liu

Long-tailed object detection faces great challenges because of its extremely imbalanced class distribution. Recent methods mainly focus on the classification bias and its loss function design, while ignoring the subtle influence of the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Ke Zhu , Minghao Fu , Jie Shao , Tianyu Liu , Jianxin Wu

The task of building footprint segmentation has been well-studied in the context of remote sensing (RS) as it provides valuable information in many aspects, however, difficulties brought by the nature of RS images such as variations in the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Burak Ekim , Elif Sertel

Multi-Task Learning (MTL) involves the concurrent training of multiple tasks, offering notable advantages for dense prediction tasks in computer vision. MTL not only reduces training and inference time as opposed to having multiple…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Maxime Fontana , Michael Spratling , Miaojing Shi

Supervised Contrastive Loss (SCL) is popular in visual representation learning. Given an anchor image, SCL pulls two types of positive samples, i.e., its augmentation and other images from the same class together, while pushes negative…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Shiyu Xuan , Shiliang Zhang

We aim to address Multi-Task Learning (MTL) with a large number of tasks by Multi-Task Grouping (MTG). Given N tasks, we propose to simultaneously identify the best task groups from 2^N candidates and train the model weights simultaneously…

Machine Learning · Computer Science 2024-07-09 Yuan Gao , Shuguo Jiang , Moran Li , Jin-Gang Yu , Gui-Song Xia

Camera traps, unmanned observation devices, and deep learning-based image recognition systems have greatly reduced human effort in collecting and analyzing wildlife images. However, data collected via above apparatus exhibits 1) long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Jeongsoo Kim , Sangmin Woo , Byeongjun Park , Changick Kim

Long-tailed distributions are common in real-world recognition tasks, where a few head classes have many samples while most tail classes have very few. Recently, fine-tuning foundation models for long-tailed learning has gained attention…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ruichi Zhang , Chikai Shang , Jiacheng Yang , Mengke Li , Yang Zhou , Junlong Gao , Yang Lu

Noisy labels, which are common in real-world datasets, can significantly impair the training of deep learning models. However, recent adversarial noise-combating methods overlook the long-tailed distribution of real data, which can…

Machine Learning · Computer Science 2024-08-09 Mengting Li , Chuang Zhu

In this paper, we study the OOD generalization of neural algorithmic reasoning tasks, where the goal is to learn an algorithm (e.g., sorting, breadth-first search, and depth-first search) from input-output pairs using deep neural networks.…

Machine Learning · Computer Science 2023-03-21 Sadegh Mahdavi , Kevin Swersky , Thomas Kipf , Milad Hashemi , Christos Thrampoulidis , Renjie Liao

Deep neural network models degrade significantly in the long-tailed data distribution, with the overall training data dominated by a small set of classes in the head, and the tail classes obtaining less training examples. Addressing the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Brainard Philemon Jagati , Jitendra Tembhurne , Harsh Goud , Rudra Pratap Singh , Chandrashekhar Meshram

Large Vision-Language Models (LVLMs) have achieved significant progress in combining visual comprehension with language generation. Despite this success, the training data of LVLMs still suffers from Long-Tail (LT) problems, where the data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Mingyang Song , Xiaoye Qu , Jiawei Zhou , Yu Cheng

Real-world datasets commonly exhibit noisy labels and class imbalance, such as long-tailed distributions. While previous research addresses this issue by differentiating noisy and clean samples, reliance on information from predictions…

Machine Learning · Computer Science 2024-03-06 Ying-Hsuan Wu , Jun-Wei Hsieh , Li Xin , Shin-You Teng , Yi-Kuan Hsieh , Ming-Ching Chang

In real-world data, long-tailed data distribution is common, making it challenging for models trained on empirical risk minimisation to learn and classify tail classes effectively. While many studies have sought to improve long tail…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Ziheng Wang , Toni Lassila , Sharib Ali

Long-tailed instance segmentation is a challenging task due to the extreme imbalance of training samples among classes. It causes severe biases of the head classes (with majority samples) against the tailed ones. This renders "how to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yin-Yin He , Peizhen Zhang , Xiu-Shen Wei , Xiangyu Zhang , Jian Sun

Solving long-tail large vocabulary object detection with deep learning based models is a challenging and demanding task, which is however under-explored.In this work, we provide the first systematic analysis on the underperformance of…

Computer Vision and Pattern Recognition · Computer Science 2020-06-20 Yu Li , Tao Wang , Bingyi Kang , Sheng Tang , Chunfeng Wang , Jintao Li , Jiashi Feng

Contemporary autonomous vehicle (AV) benchmarks have advanced techniques for training 3D detectors. While class labels naturally follow a long-tailed distribution in the real world, existing benchmarks only focus on a few common classes…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Yechi Ma , Neehar Peri , Achal Dave , Wei Hua , Deva Ramanan , Shu Kong

OOD-CV challenge is an out-of-distribution generalization task. In this challenge, our core solution can be summarized as that Noisy Label Learning Is A Strong Test-Time Domain Adaptation Optimizer. Briefly speaking, our main pipeline can…

Computer Vision and Pattern Recognition · Computer Science 2023-01-13 Yilu Guo , Xingyue Shi , Weijie Chen , Shicai Yang , Di Xie , Shiliang Pu , Yueting Zhuang

Long-tailed visual recognition has received increasing attention in recent years. Due to the extremely imbalanced data distribution in long-tailed learning, the learning process shows great uncertainties. For example, the predictions of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Zichang Tan , Jun Li , Jinhao Du , Jun Wan , Zhen Lei , Guodong Guo

Lifelong Reinforcement Learning (LRL) holds significant potential for addressing sequential tasks, but it still faces considerable challenges. A key difficulty lies in effectively preventing catastrophic forgetting and facilitating…

Machine Learning · Computer Science 2025-03-18 Zhiyi Huang , Xiaohan Shan , Jianmin Li