English
Related papers

Related papers: AWF: Adaptive Weight Fusion for Enhanced Class Inc…

200 papers

Skin cancer classification remains a challenging problem due to high inter-class similarity, intra-class variability, and image noise in dermoscopic images. To address these issues, we propose an improved ResNet-50 model enhanced with…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Runhao Liu , Ziming Chen , Peng Zhang

Federated Learning (FL) has emerged as a promising framework for distributed machine learning, enabling collaborative model training without sharing local data, thereby preserving privacy and enhancing security. However, data heterogeneity…

Machine Learning · Computer Science 2025-03-21 Changlong Shi , He Zhao , Bingjie Zhang , Mingyuan Zhou , Dandan Guo , Yi Chang

Online Class-Incremental (OCI) learning has sparked new approaches to expand the previously trained model knowledge from sequentially arriving data streams with new classes. Unfortunately, OCI learning can suffer from catastrophic…

Machine Learning · Computer Science 2023-03-15 Yunfeng Fan , Wenchao Xu , Haozhao Wang , Jiaqi Zhu , Junxiao Wang , Song Guo

Cross-client data heterogeneity in federated learning induces biases that impede unbiased consensus condensation and the complementary fusion of generalization- and personalization-oriented knowledge. While existing approaches mitigate…

Machine Learning · Computer Science 2025-08-26 Ming Yang , Dongrun Li , Xin Wang , Xiaoyang Yu , Xiaoming Wu , Shibo He

Learning in deep weight spaces (DWS), where neural networks process the weights of other neural networks, is an emerging research direction, with applications to 2D and 3D neural fields (INRs, NeRFs), as well as making inferences about…

Machine Learning · Computer Science 2024-11-12 Aviv Shamsian , Aviv Navon , David W. Zhang , Yan Zhang , Ethan Fetaya , Gal Chechik , Haggai Maron

We propose a result-level category-specific fusion architecture called ClassWise-CRF. This architecture employs a two-stage process: first, it selects expert networks that perform well in specific categories from a pool of candidate…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Qinfeng Zhu , Yunxi Jiang , Lei Fan

Class Incremental Learning (CIL) constitutes a pivotal subfield within continual learning, aimed at enabling models to progressively learn new classification tasks while retaining knowledge obtained from prior tasks. Although previous…

Machine Learning · Computer Science 2025-01-14 Jaeill Kim , Wonseok Lee , Moonjung Eo , Wonjong Rhee

Catastrophic forgetting is the primary challenge that hinders continual learning, which refers to a neural network ability to sequentially learn multiple tasks while retaining previously acquired knowledge. Elastic Weight Consolidation, a…

Machine Learning · Computer Science 2025-07-15 Brandon Shuen Yi Loke , Filippo Quadri , Gabriel Vivanco , Maximilian Casagrande , Saúl Fenollosa

Image fusion aims to combine information from multiple source images into a single one with more comprehensive informational content. Deep learning-based image fusion algorithms face significant challenges, including the lack of a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Haowen Bai , Zixiang Zhao , Jiangshe Zhang , Yichen Wu , Lilun Deng , Yukun Cui , Shuang Xu , Baisong Jiang

Knowledge graphs (KGs) require continual updates as new information emerges, but neural embedding models suffer from catastrophic forgetting when learning new tasks sequentially. We evaluate Elastic Weight Consolidation (EWC), a…

Machine Learning · Computer Science 2025-12-02 Gaganpreet Jhajj , Fuhua Lin

The demand for edge AI in vision-language tasks requires models that achieve real-time performance on resource-constrained devices with limited power and memory. This paper proposes two adaptive compression techniques -- Sparse Temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Md Tasnin Tanvir , Soumitra Das , Sk Md Abidar Rahaman , Ali Shiri Sichani

Semantic segmentation models have two fundamental weaknesses: i) they require large training sets with costly pixel-level annotations, and ii) they have a static output space, constrained to the classes of the training set. Toward…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Fabio Cermelli , Massimiliano Mancini , Yongqin Xian , Zeynep Akata , Barbara Caputo

In this paper, we present an Adaptive Ensemble Learning framework that aims to boost the performance of deep neural networks by intelligently fusing features through ensemble learning techniques. The proposed framework integrates ensemble…

Artificial Intelligence · Computer Science 2023-04-07 Neelesh Mungoli

Federated learning (FL) has emerged as a widely adopted training paradigm for privacy-preserving machine learning. While the SGD-based FL algorithms have demonstrated considerable success in the past, there is a growing trend towards…

Machine Learning · Computer Science 2024-07-29 Yujia Wang , Shiqiang Wang , Songtao Lu , Jinghui Chen

Modern neural network based speech recognition models are required to continually absorb new data without re-training the whole system, especially in downstream applications using foundation models, having no access to the original training…

Computation and Language · Computer Science 2025-06-23 Enes Yavuz Ugan , Ngoc-Quan Pham , Alexander Waibel

Multi-view learning integrates diverse representations of the same instances to improve performance. Most existing kernel-based multi-view learning methods use fusion techniques without enforcing an explicit collaboration type across views…

Machine Learning · Computer Science 2025-12-03 Farnaz Faramarzi Lighvan , Mehrdad Asadi , Lynn Houthuys

The performance of deep neural networks is enhanced by ensemble methods, which average the output of several models. However, this comes at an increased cost at inference. Weight averaging methods aim at balancing the generalization of…

Machine Learning · Computer Science 2024-05-29 Louis Fournier , Adel Nabli , Masih Aminbeidokhti , Marco Pedersoli , Eugene Belilovsky , Edouard Oyallon

Evolution Strategies (ES) emerged as a scalable alternative to popular Reinforcement Learning (RL) techniques, providing an almost perfect speedup when distributed across hundreds of CPU cores thanks to a reduced communication overhead.…

Machine Learning · Statistics 2018-11-13 Víctor Campos , Xavier Giro-i-Nieto , Jordi Torres

This paper presents a novel approach to one-class classifier fusion through locally adaptive learning with dynamic $\ell$p-norm constraints. We introduce a framework that dynamically adjusts fusion weights based on local data…

Machine Learning · Computer Science 2024-11-21 Sepehr Nourmohammadi , Arda Sarp Yenicesu , Shervin Rahimzadeh Arashloo , Ozgur S. Oguz

Foundation ASR models often support many languages, e.g. 100 languages in Whisper. However, there has been limited work on integrating an additional, typically low-resource, language, while maintaining performance on the original language…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-25 Mengjie Qian , Siyuan Tang , Rao Ma , Kate M. Knill , Mark J. F. Gales