English
Related papers

Related papers: Efficient Inverse-Free Incremental and Decremental…

200 papers

Reinforcement learning (RL) is a classical tool to solve network control or policy optimization problems in unknown environments. The original Q-learning suffers from performance and complexity challenges across very large networks. Herein,…

Machine Learning · Computer Science 2024-09-02 Talha Bozkus , Urbashi Mitra

Recently machine unlearning (MU) is proposed to remove the imprints of revoked samples from the already trained model parameters, to solve users' privacy concern. Different from the runtime expensive retraining from scratch, there exist two…

Machine Learning · Computer Science 2024-12-20 Mingxin Li , Yizhen Yu , Ning Wang , Zhigang Wang , Xiaodong Wang , Haipeng Qu , Jia Xu , Shen Su , Zhichao Yin

We consider stochastic gradient methods under the interpolation regime where a perfect fit can be obtained (minimum loss at each observation). While previous work highlighted the implicit regularization of such algorithms, we consider an…

Optimization and Control · Mathematics 2020-04-01 Anant Raj , Francis Bach

We propose a distributional framework for offline Inverse Reinforcement Learning (IRL) that jointly models uncertainty over reward functions and full distributions of returns. Unlike conventional IRL approaches that recover a deterministic…

Machine Learning · Computer Science 2026-05-29 Feiyang Wu , Ye Zhao , Anqi Wu

The Euler Elastica (EE) model with surface curvature can generate artifact-free results compared with the traditional total variation regularization model in image processing. However, strong nonlinearity and singularity due to the…

Optimization and Control · Mathematics 2023-08-28 Zhifang Liu , Baochen Sun , Xue-Cheng Tai , Qi Wang , Huibin Chang

Deep learning models tend to forget their earlier knowledge while incrementally learning new tasks. This behavior emerges because the parameter updates optimized for the new tasks may not align well with the updates suitable for older…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 K J Joseph , Salman Khan , Fahad Shahbaz Khan , Rao Muhammad Anwer , Vineeth N Balasubramanian

Tensor-based discrete density estimation requires flexible modeling and proper divergence criteria to enable effective learning; however, traditional approaches using $\alpha$-divergence face analytical challenges due to the $\alpha$-power…

Machine Learning · Statistics 2025-05-26 Kazu Ghalamkari , Jesper Løve Hinrich , Morten Mørup

Mixed linear regression involves the recovery of two (or more) unknown vectors from unlabeled linear measurements; that is, where each sample comes from exactly one of the vectors, but we do not know which one. It is a classic problem, and…

Machine Learning · Statistics 2014-02-10 Xinyang Yi , Constantine Caramanis , Sujay Sanghavi

Extreme learning machines (ELMs), which preset hidden layer parameters and solve for last layer coefficients via a least squares method, can typically solve partial differential equations faster and more accurately than Physics Informed…

Numerical Analysis · Mathematics 2025-09-10 Chang-Ock Lee , Byungeun Ryoo

In this work, we investigate various approaches that use learning from training data to solve inverse problems, following a bi-level learning approach. We consider a general framework for optimal inversion design, where training data can be…

Numerical Analysis · Mathematics 2021-10-07 Julianne Chung , Matthias Chung , Silvia Gazzola , Mirjeta Pasha

We introduce a neural network architecture to solve inverse problems linked to a one-dimensional integral operator. This architecture is built by unfolding a forward-backward algorithm derived from the minimization of an objective function…

Optimization and Control · Mathematics 2021-06-01 Emilie Chouzenoux , Cecile Della Valle , Jean-Christophe Pesquet

Data representation techniques have made a substantial contribution to advancing data processing and machine learning (ML). Improving predictive power was the focus of previous representation techniques, which unfortunately perform rather…

Machine Learning · Computer Science 2022-05-24 Qiyou Duan , Hadi Ghauch , Taejoon Kim

Incremental learning of semantic segmentation has emerged as a promising strategy for visual scene interpretation in the open- world setting. However, it remains challenging to acquire novel classes in an online fashion for the segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Shipeng Yan , Jiale Zhou , Jiangwei Xie , Songyang Zhang , Xuming He

We present a converged algorithm for Tikhonov regularized nonnegative matrix factorization (NMF). We specially choose this regularization because it is known that Tikhonov regularized least square (LS) is the more preferable form in solving…

Machine Learning · Computer Science 2015-03-20 Andri Mirzal

We develop an online learning algorithm that dramatically improves the data efficiency of reinforcement learning from human feedback (RLHF). Our algorithm incrementally updates reward and language models as choice data is received. The…

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

Machine Learning · Computer Science 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

Offline inverse reinforcement learning (IRL) aims to recover a reward function that explains expert behavior using only fixed demonstration data, without any additional online interaction. We propose BiCQL-ML, a policy-free offline IRL…

Machine Learning · Computer Science 2025-12-01 Junsung Park

Inverse reinforcement learning (IRL) is the problem of finding a reward function that generates a given optimal policy for a given Markov Decision Process. This paper looks at an algorithmic-independent geometric analysis of the IRL problem…

Machine Learning · Computer Science 2021-02-19 Abi Komanduru , Jean Honorio

Building highly non-linear and non-parametric models is central to several state-of-the-art machine learning systems. Kernel methods form an important class of techniques that induce a reproducing kernel Hilbert space (RKHS) for inferring…

Machine Learning · Statistics 2017-11-16 Huan Song , Jayaraman J. Thiagarajan , Prasanna Sattigeri , Andreas Spanias

In this paper, we propose the use of Recurrent Inference Machines (RIMs) to perform T1 and T2 mapping. The RIM is a neural network framework that learns an iterative inference process based on the signal model, similar to conventional…

Image and Video Processing · Electrical Eng. & Systems 2021-06-15 E. R. Sabidussi , S. Klein , M. W. A. Caan , S. Bazrafkan , A. J. den Dekker , J. Sijbers , W. J. Niessen , D. H. J. Poot