English
Related papers

Related papers: Fisher-Guided Selective Forgetting: Mitigating The…

200 papers

We study the problem of Reinforcement Learning (RL) using as few real-world samples as possible. A naive application of RL can be inefficient in large and continuous state spaces. We present two versions of Multi-Fidelity Reinforcement…

Robotics · Computer Science 2020-03-10 Varun Suryan , Nahush Gondhalekar , Pratap Tokekar

This paper explores a Deep Reinforcement Learning (DRL) approach for designing image-based control for edge robots to be implemented on Field Programmable Gate Arrays (FPGAs). Although FPGAs are more power-efficient than CPUs and GPUs, a…

Robotics · Computer Science 2021-09-16 Yuki Kadokawa , Yoshihisa Tsurumine , Takamitsu Matsubara

Differentially Private Federated Learning (DPFL) strengthens privacy protection by perturbing model gradients with noise, though at the cost of reduced accuracy. Although prior empirical studies indicate that initializing from pre-trained…

Machine Learning · Computer Science 2025-10-10 Huitong Jin , Yipeng Zhou , Quan Z. Sheng , Shiting Wen , Laizhong Cui

Preference-based Reinforcement Learning (PbRL) methods utilize binary feedback from the human in the loop (HiL) over queried trajectory pairs to learn a reward model in an attempt to approximate the human's underlying reward function…

Machine Learning · Computer Science 2023-02-20 Mudit Verma , Subbarao Kambhampati

Remembering and forgetting mechanisms are two sides of the same coin in a human learning-memory system. Inspired by human brain memory mechanisms, modern machine learning systems have been working to endow machine with lifelong learning…

Machine Learning · Computer Science 2021-11-23 Jian Peng , Xian Sun , Min Deng , Chao Tao , Bo Tang , Wenbo Li , Guohua Wu , QingZhu , Yu Liu , Tao Lin , Haifeng Li

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

Pre-training GNNs to extract transferable knowledge and apply it to downstream tasks has become the de facto standard of graph representation learning. Recent works focused on designing self-supervised pre-training tasks to extract useful…

Machine Learning · Computer Science 2024-04-24 Zhe Zhao , Pengkun Wang , Xu Wang , Haibin Wen , Xiaolong Xie , Zhengyang Zhou , Qingfu Zhang , Yang Wang

Continual learning is the problem of learning new tasks or knowledge while protecting old knowledge and ideally generalizing from old experience to learn new tasks faster. Neural networks trained by stochastic gradient descent often degrade…

Machine Learning · Computer Science 2019-11-27 David Rolnick , Arun Ahuja , Jonathan Schwarz , Timothy P. Lillicrap , Greg Wayne

Traditional Federated Learning (FL) methods encounter significant challenges when dealing with heterogeneous data and providing personalized solutions for non-IID scenarios. Personalized Federated Learning (PFL) approaches aim to address…

Machine Learning · Computer Science 2025-11-11 Yasaman Saadati , Mohammad Rostami , M. Hadi Amini

Forgetting is often seen as an unwanted characteristic in both human and machine learning. However, we propose that forgetting can in fact be favorable to learning. We introduce "forget-and-relearn" as a powerful paradigm for shaping the…

Machine Learning · Computer Science 2022-02-02 Hattie Zhou , Ankit Vani , Hugo Larochelle , Aaron Courville

Reinforcement Learning from Human Feedback (RLHF) has recently surged in popularity, particularly for aligning large language models and other AI systems with human intentions. At its core, RLHF can be viewed as a specialized instance of…

Machine Learning · Computer Science 2025-01-10 Yujie Zhao , Jose Efraim Aguilar Escamill , Weyl Lu , Huazheng Wang

One of the key behavioral characteristics used in neuroscience to determine whether the subject of study -- be it a rodent or a human -- exhibits model-based learning is effective adaptation to local changes in the environment, a particular…

Machine Learning · Computer Science 2023-09-28 Ali Rahimi-Kalahroudi , Janarthanan Rajendran , Ida Momennejad , Harm van Seijen , Sarath Chandar

Conventional physics-informed extreme learning machine (PIELM) often faces challenges in solving partial differential equations (PDEs) involving high-frequency and variable-frequency behaviors. To address these challenges, we propose a…

Machine Learning · Computer Science 2025-10-15 Fei Ren , Sifan Wang , Pei-Zhi Zhuang , Hai-Sui Yu , He Yang

Despite the numerous applications and success of deep reinforcement learning in many control tasks, it still suffers from many crucial problems and limitations, including temporal credit assignment with sparse reward, absence of effective…

Neural and Evolutionary Computing · Computer Science 2022-09-20 Marzieh Sadat Esmaeeli , Hamed Malek

Deep Reinforcement Learning (RL) methods rely on experience replay to approximate the minibatched supervised learning setting; however, unlike supervised learning where access to lots of training data is crucial to generalization,…

Machine Learning · Computer Science 2021-02-24 Brett Daley , Cameron Hickert , Christopher Amato

In many robotic applications, it is crucial to maintain a belief about the state of a system, which serves as input for planning and decision making and provides feedback during task execution. Bayesian Filtering algorithms address this…

Machine Learning · Computer Science 2021-06-11 Alina Kloss , Georg Martius , Jeannette Bohg

Detecting pre-training data in Large Language Models (LLMs) is crucial for auditing data privacy and copyright compliance, yet it remains challenging in black-box, zero-shot settings where computational resources and training data are…

Computation and Language · Computer Science 2026-01-13 Jinhan Liu , Yibo Yang , Ruiying Lu , Piotr Piekos , Yimeng Chen , Peng Wang , Dandan Guo

Federated learning (FL) suffers from performance degradation due to the inevitable presence of noisy annotations in distributed scenarios. Existing approaches have advanced in distinguishing noisy samples from the dataset for label…

Machine Learning · Computer Science 2026-04-01 Tian Wen , Zhiqin Yang , Yonggang Zhang , Xuefeng Jiang , Hao Peng , Yuwei Wang , Bo Han

Mean field games (MFGs) have emerged as a powerful framework for modeling interactions in large-scale multi-agent systems. Despite recent advancements in reinforcement learning (RL) for MFGs, existing methods are typically limited to finite…

Machine Learning · Computer Science 2025-10-28 Lorenzo Magnino , Kai Shao , Zida Wu , Jiacheng Shen , Mathieu Laurière

MR fingerprinting (MRF) is a rapid growing approach for fast quantitave MRI. A typical drawback of dictionary-based MRF is its explosion in size as a function of the number of reconstructed parameters, according to the curse of…