English
Related papers

Related papers: Fisher-Guided Selective Forgetting: Mitigating The…

200 papers

Deep neural networks are typically represented by a much larger number of parameters than shallow models, making them prohibitive for small footprint devices. Recent research shows that there is considerable redundancy in the parameter…

Machine Learning · Computer Science 2016-05-17 Ming Tu , Visar Berisha , Yu Cao , Jae-sun Seo

The Forward-Forward (FF) Algorithm has been recently proposed to alleviate the issues of backpropagation (BP) commonly used to train deep neural networks. However, its current formulation exhibits limitations such as the generation of…

Machine Learning · Computer Science 2024-03-29 Andreas Papachristodoulou , Christos Kyrkou , Stelios Timotheou , Theocharis Theocharides

Vision Foundation Models (VFMs) excel in generalization due to large-scale pretraining, but fine-tuning them for Domain Generalized Semantic Segmentation (DGSS) while maintaining this ability remains challenging. Existing approaches either…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Dong Zhao , Jinlong Li , Shuang Wang , Mengyao Wu , Qi Zang , Nicu Sebe , Zhun Zhong

In recent years, the increasing size of deep learning models and their growing demand for computational resources have drawn significant attention to the practice of pruning neural networks, while aiming to preserve their accuracy. In…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Lingkai Zhu , Can Deniz Bezek , Orcun Goksel

To preserve the data privacy, the federated learning (FL) paradigm emerges in which clients only expose model gradients rather than original data for conducting model training. To enhance the protection of model gradients in FL,…

Machine Learning · Computer Science 2024-08-19 Jiating Ma , Yipeng Zhou , Qi Li , Quan Z. Sheng , Laizhong Cui , Jiangchuan Liu

In this paper we propose an approach to avoiding catastrophic forgetting in sequential task learning scenarios. Our technique is based on a network reparameterization that approximately diagonalizes the Fisher Information Matrix of the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Xialei Liu , Marc Masana , Luis Herranz , Joost Van de Weijer , Antonio M. Lopez , Andrew D. Bagdanov

Recent advances in Bayesian reinforcement learning (BRL) have shown that Bayes-optimality is theoretically achievable by modeling the environment's latent dynamics using Flat-Dirichlet-Multinomial (FDM) prior. In self-interested multi-agent…

Machine Learning · Computer Science 2014-03-18 Trong Nghia Hoang , Kian Hsiang Low

Learning from Preferences in Reinforcement Learning (PbRL) has gained attention recently, as it serves as a natural fit for complicated tasks where the reward function is not easily available. However, preferences often come with…

Machine Learning · Computer Science 2026-03-19 Yuxuan Li , Harshith Reddy Kethireddy , Srijita Das

Large Language Models (LLMs) can acquire unintended biases from seemingly benign training data even without explicit cues or malicious content. Existing methods struggle to detect such risks before fine-tuning, making post hoc evaluation…

Machine Learning · Computer Science 2026-02-05 Mengru Wang , Zhenqian Xu , Junfeng Fang , Yunzhi Yao , Shumin Deng , Huajun Chen , Ningyu Zhang

Privacy regulations require the erasure of data from deep learning models. This is a significant challenge that is amplified in Federated Learning, where data remains on clients, making full retraining or coordinated updates often…

Machine Learning · Computer Science 2026-01-27 Antonio Balordi , Lorenzo Manini , Fabio Stella , Alessio Merlo

The lifelong learning paradigm in machine learning is an attractive alternative to the more prominent isolated learning scheme not only due to its resemblance to biological learning but also its potential to reduce energy waste by obviating…

Machine Learning · Computer Science 2023-08-30 Sanket Vaibhav Mehta , Darshan Patil , Sarath Chandar , Emma Strubell

Model-based reinforcement learning (MBRL) provides a way to learn a transition model of the environment, which can then be used to plan personalized policies for different patient cohorts and to understand the dynamics involved in the…

Machine Learning · Computer Science 2024-11-22 Abhishek Sharma , Sonali Parbhoo , Omer Gottesman , Finale Doshi-Velez

Zero-shot reinforcement learning is necessary for extracting optimal policies in absence of concrete rewards for fast adaptation to future problem settings. Forward-backward representations (FB) have emerged as a promising method for…

Machine Learning · Computer Science 2025-07-09 Núria Armengol Urpí , Marin Vlastelica , Georg Martius , Stelian Coros

Recently, a large number of data sources opened up by informatization intensify the data heterogeneity, the faster speed of data generation and the gradual implementation of data regulations limit the storage time of data. In personalized…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-02-03 Sixing Tan , Xianmin Liu

Preference-based Reinforcement Learning (PbRL) is a paradigm in which an RL agent learns to optimize a task using pair-wise preference-based feedback over trajectories, rather than explicit reward signals. While PbRL has demonstrated…

Machine Learning · Computer Science 2024-04-18 Wenhao Zhan , Masatoshi Uehara , Wen Sun , Jason D. Lee

In this study, we introduce a Fourier series-based trainable filter for computed tomography (CT) reconstruction within the filtered backprojection (FBP) framework. This method overcomes the limitation in noise reduction by optimizing…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Yipeng Sun , Linda-Sophie Schneider , Fuxin Fan , Mareike Thies , Mingxuan Gu , Siyuan Mei , Yuzhong Zhou , Siming Bayer , Andreas Maier

Decision-focused learning (DFL) offers an end-to-end approach to the predict-then-optimize (PO) framework by training predictive models directly on decision loss (DL), enhancing decision-making performance within PO contexts. However, the…

Machine Learning · Computer Science 2025-04-15 Jiaqi Yang , Enming Liang , Zicheng Su , Zhichao Zou , Peng Zhen , Jiecheng Guo , Wanjing Ma , Kun An

Deep Reinforcement Learning (DRL) has been highly effective in learning from and adapting to RF environments and thus detecting and mitigating jamming effects to facilitate reliable wireless communications. However, traditional DRL methods…

Machine Learning · Computer Science 2024-10-15 Kemal Davaslioglu , Sastry Kompella , Tugba Erpek , Yalin E. Sagduyu

In this paper, we address the issue of fairness in preference-based reinforcement learning (PbRL) in the presence of multiple objectives. The main objective is to design control policies that can optimize multiple objectives while treating…

Machine Learning · Computer Science 2023-09-04 Umer Siddique , Abhinav Sinha , Yongcan Cao

We introduce the forward-backward (FB) representation of the dynamics of a reward-free Markov decision process. It provides explicit near-optimal policies for any reward specified a posteriori. During an unsupervised phase, we use…

Machine Learning · Computer Science 2021-10-12 Ahmed Touati , Yann Ollivier