English
Related papers

Related papers: Beyond Sharpness: A Flatness Decomposition Framewo…

200 papers

As edge devices become more capable and pervasive in wireless networks, there is growing interest in leveraging their collective compute power for distributed learning. However, optimizing learning at the network edge entails unique…

Machine Learning · Computer Science 2025-04-14 Thomas Tsouparopoulos , Iordanis Koutsopoulos

Continual learning (CL), which aims to learn a sequence of tasks, has attracted significant recent attention. However, most work has focused on the experimental performance of CL, and theoretical studies of CL are still limited. In…

Machine Learning · Computer Science 2023-02-14 Sen Lin , Peizhong Ju , Yingbin Liang , Ness Shroff

Partially-supervised learning can be challenging for segmentation due to the lack of supervision for unlabeled structures, and the methods directly applying fully-supervised learning could lead to incompatibility, meaning ground truth is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Ke Zhang , Xiahai Zhuang

Continual learning the ability of a neural network to learn multiple sequential tasks without catastrophic forgetting remains a central challenge in developing adaptive artificial intelligence systems. While deep learning models achieve…

Machine Learning · Computer Science 2025-10-14 Md Hasibul Amin , Tamzid Tanvi Alam

Continual learning is a process that involves training learning agents to sequentially master a stream of tasks or classes without revisiting past data. The challenge lies in leveraging previously acquired knowledge to learn new tasks…

Machine Learning · Computer Science 2024-02-21 Marcus de Carvalho , Mahardhika Pratama , Jie Zhang , Chua Haoyan , Edward Yapp

Deep neural networks achieve state-of-the-art and sometimes super-human performance across various domains. However, when learning tasks sequentially, the networks easily forget the knowledge of previous tasks, known as "catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Shixiang Tang , Dapeng Chen , Jinguo Zhu , Shijie Yu , Wanli Ouyang

Continual learning (CL) involves acquiring and accumulating knowledge from evolving tasks while alleviating catastrophic forgetting. Recently, leveraging contrastive loss to construct more transferable and less forgetful representations has…

Machine Learning · Computer Science 2025-09-22 Jia Tang , Xinrui Wang , Songcan Chen

Catastrophic forgetting remains a critical challenge in the field of continual learning, where neural networks struggle to retain prior knowledge while assimilating new information. Most existing studies emphasize mitigating this issue only…

Machine Learning · Computer Science 2023-09-21 Wenhang Shi , Yiren Chen , Zhe Zhao , Wei Lu , Kimmo Yan , Xiaoyong Du

Federated learning (FL), which has gained increasing attention recently, enables distributed devices to train a common machine learning (ML) model for intelligent inference cooperatively without data sharing. However, problems in practical…

Machine Learning · Computer Science 2022-11-01 Yujie Zhou , Zhidu Li , Tong Tang , Ruyan Wang

Node classification is a key task in temporal graph learning (TGL). Real-life temporal graphs often introduce new node classes over time, but existing TGL methods assume a fixed set of classes. This assumption brings limitations, as…

Machine Learning · Computer Science 2025-03-04 Hanmo Liu , Shimin Di , Haoyang Li , Xun Jian , Yue Wang , Lei Chen

Federated Learning (FL) provides decentralised model training, which effectively tackles problems such as distributed data and privacy preservation. However, the generalisation of global models frequently faces challenges from data…

Machine Learning · Computer Science 2025-09-05 Ozgu Goksu , Nicolas Pugeault

The field of Continual Learning (CL) has inspired numerous researchers over the years, leading to increasingly advanced countermeasures to the issue of catastrophic forgetting. Most studies have focused on the single-class scenario, where…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Martin Menabue , Emanuele Frascaroli , Matteo Boschini , Lorenzo Bonicelli , Angelo Porrello , Simone Calderara

Hybrid modeling, the combination of machine learning models and scientific mathematical models, enables flexible and robust data-driven prediction with partial interpretability. However, effectively the scientific models may be ignored in…

Machine Learning · Computer Science 2026-02-09 Naoya Takeishi

Deep learning methods have been considered promising for accelerating molecular screening in drug discovery and material design. Due to the limited availability of labelled data, various self-supervised molecular pre-training methods have…

Machine Learning · Computer Science 2024-07-17 Yuyan Ni , Shikun Feng , Xin Hong , Yuancheng Sun , Wei-Ying Ma , Zhi-Ming Ma , Qiwei Ye , Yanyan Lan

Heterogeneous federated learning (HFL) aims to ensure effective and privacy-preserving collaboration among different entities. As newly joined clients require significant adjustments and additional training to align with the existing…

Machine Learning · Computer Science 2026-01-29 Kaile Wang , Jiannong Cao , Yu Yang , Xiaoyin Li , Mingjin Zhang

Complementary-label Learning (CLL) is a form of weakly supervised learning that trains an ordinary classifier using only complementary labels, which are the classes that certain instances do not belong to. While existing CLL studies…

Machine Learning · Computer Science 2023-05-16 Wei-I Lin , Gang Niu , Hsuan-Tien Lin , Masashi Sugiyama

Blind deconvolution (BD) has been demonstrated as an efficacious approach for extracting bearing fault-specific features from vibration signals under strong background noise. Despite BD's desirable feature in adaptability and mathematical…

Signal Processing · Electrical Eng. & Systems 2024-04-25 Jing-Xiao Liao , Chao He , Jipu Li , Jinwei Sun , Shiping Zhang , Xiaoge Zhang

Multi-label classification (MLC) studies the problem where each instance is associated with multiple relevant labels, which leads to the exponential growth of output space. MLC encourages a popular framework named label compression (LC) for…

Machine Learning · Computer Science 2020-09-21 Jiaqi Lv , Tianran Wu , Chenglun Peng , Yunpeng Liu , Ning Xu , Xin Geng

Simultaneous localization and mapping (SLAM) with implicit neural representations has received extensive attention due to the expressive representation power and the innovative paradigm of continual learning. However, deploying such a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Baicheng Li , Zike Yan , Dong Wu , Hanqing Jiang , Hongbin Zha

Federated Learning (FL) enables collaborative model training across large-scale distributed service nodes while preserving data privacy, making it a cornerstone of intelligent service systems in edge-cloud environments. However, in…

Machine Learning · Computer Science 2026-02-03 Zhiwei Ling , Hailiang Zhao , Chao Zhang , Xiang Ao , Ziqi Wang , Cheng Zhang , Zhen Qin , Xinkui Zhao , Kingsum Chow , Yuanqing Wu , MengChu Zhou