English
Related papers

Related papers: Tail-Learning: Adaptive Learning Method for Mitiga…

200 papers

Non-independent and identically distributed (Non-IID) data across edge clients have long posed significant challenges to federated learning (FL) training in edge computing environments. Prior works have proposed various methods to mitigate…

Machine Learning · Computer Science 2025-04-25 Weijie Liu , Ziwei Zhan , Carlee Joe-Wong , Edith Ngai , Jingpu Duan , Deke Guo , Xu Chen , Xiaoxi Zhang

Many real-world applications are widely adopting the edge computing paradigm due to its low latency and better privacy protection. With notable success in AI and deep learning (DL), edge devices and AI accelerators play a crucial role in…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-28 Piyush Subedi , Jianwei Hao , In Kee Kim , Lakshmish Ramaswamy

In class incremental learning (CIL) a model must learn new classes in a sequential manner without forgetting old ones. However, conventional CIL methods consider a balanced distribution for each new task, which ignores the prevalence of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Xialei Liu , Yu-Song Hu , Xu-Sheng Cao , Andrew D. Bagdanov , Ke Li , Ming-Ming Cheng

Distributed deep learning (DDL) training systems are designed for cloud and data-center environments that assumes homogeneous compute resources, high network bandwidth, sufficient memory and storage, as well as independent and identically…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Sahil Tyagi , Martin Swany

Predicting the future trajectories of the traffic agents is a gordian technique in autonomous driving. However, trajectory prediction suffers from data imbalance in the prevalent datasets, and the tailed data is often more complicated and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Yuning Wang , Pu Zhang , Lei Bai , Jianru Xue

This paper introduces a two-stage framework designed to enhance long-tail class incremental learning, enabling the model to progressively learn new classes, while mitigating catastrophic forgetting in the context of long-tailed data…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Jayateja Kalla , Soma Biswas

Industry 4.0 becomes possible through the convergence between Operational and Information Technologies. All the requirements to realize the convergence is integrated on the Fog Platform. Fog Platform is introduced between the cloud server…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-27 Jia Qian , Sayantan Sengupta , Lars Kai Hansen

In some applications, edge learning is experiencing a shift in focusing from conventional learning from scratch to new two-stage learning unifying pre-training and task-specific fine-tuning. This paper considers the problem of joint…

Information Theory · Computer Science 2024-04-02 Zhonghao Lyu , Yuchen Li , Guangxu Zhu , Jie Xu , H. Vincent Poor , Shuguang Cui

Balancing performance trade-off on long-tail (LT) data distributions remains a long-standing challenge. In this paper, we posit that this dilemma stems from a phenomenon called "tail performance degradation" (the model tends to severely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Shenghan Chen , Yiming Liu , Yanzhen Wang , Yujia Wang , Xiankai Lu

Long-tail class incremental learning (LT CIL) remains highly challenging because the scarcity of samples in tail classes not only hampers their learning but also exacerbates catastrophic forgetting under continuously evolving and imbalanced…

Artificial Intelligence · Computer Science 2026-03-24 Xi Wang , Xu Yang , Donghao Sun , Cheng Deng

Long-tailed data is a special type of multi-class imbalanced data with a very large amount of minority/tail classes that have a very significant combined influence. Long-tailed learning aims to build high-performance models on datasets with…

Machine Learning · Computer Science 2024-08-02 Chongsheng Zhang , George Almpanidis , Gaojuan Fan , Binquan Deng , Yanbo Zhang , Ji Liu , Aouaidjia Kamel , Paolo Soda , João Gama

To satisfy the expected plethora of computation-heavy applications, federated edge learning (FEEL) is a new paradigm featuring distributed learning to carry the capacities of low-latency and privacy-preserving. To further improve the…

Systems and Control · Electrical Eng. & Systems 2022-12-02 Jun Du , Bingqing Jiang , Chunxiao Jiang , Yuanming Shi , Zhu Han

Collaborative edge computing addresses the resource constraints of individual edge nodes by enabling resource sharing and task co-processing across multiple nodes. To fully leverage the advantages of collaborative edge computing, joint…

Performance · Computer Science 2025-08-25 Yang Li , Xing Zhang , Yunji Zhao , Wenbo Wang

Real-world visual data often exhibits a long-tailed distribution, where some ''head'' classes have a large number of samples, yet only a few samples are available for ''tail'' classes. Such imbalanced distribution causes a great challenge…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Junjie Zhang , Lingqiao Liu , Peng Wang , Chunhua Shen

Edge computing is the practice of placing computing resources at the edges of the Internet in close proximity to devices and information sources. This, much like a cache on a CPU, increases bandwidth and reduces latency for applications but…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-01 Paul Wood , Heng Zhang , Muhammad-Bilal Siddiqui , Saurabh Bagchi

The surging development of Artificial Intelligence-Generated Content (AIGC) marks a transformative era of the content creation and production. Edge servers promise attractive benefits, e.g., reduced service delay and backhaul traffic load,…

Machine Learning · Computer Science 2024-09-10 Yuxin Liang , Peng Yang , Yuanyuan He , Feng Lyu

Growing demands in today's industry results in increasingly stringent performance and throughput specifications. For accurate positioning of high-precision motion systems, feedforward control plays a crucial role. Nonetheless, conventional…

Systems and Control · Electrical Eng. & Systems 2023-03-28 Anantha Sai Hariharan Vinjarapu , Yorick Broens , Hans Butler , Roland Tóth

Deploying deep models in real-world scenarios entails a number of challenges, including computational efficiency and real-world (e.g., long-tailed) data distributions. We address the combined challenge of learning long-tailed distributions…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jihun Kim , Dahyun Kim , Hyungrok Jung , Taeil Oh , Jonghyun Choi

We present OptiReduce, a new collective-communication system for the cloud with bounded, predictable completion times for deep-learning jobs in the presence of varying computation (stragglers) and communication (congestion and gradient…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-06 Ertza Warraich , Omer Shabtai , Khalid Manaa , Shay Vargaftik , Yonatan Piasetzky , Matty Kadosh , Lalith Suresh , Muhammad Shahbaz

Meta learning is a promising paradigm in the era of large models and task distributional robustness has become an indispensable consideration in real-world scenarios. Recent advances have examined the effectiveness of tail task risk…

Machine Learning · Computer Science 2024-10-31 Yiqin Lv , Qi Wang , Dong Liang , Zheng Xie