English
Related papers

Related papers: Efficient Inverse-Free Incremental and Decremental…

200 papers

A supervised learning approach is proposed for regularization of large inverse problems where the main operator is built from noisy data. This is germane to superresolution imaging via the sampling indicators of the inverse scattering…

Numerical Analysis · Mathematics 2025-08-22 Fatemeh Pourahmadian , Yang Xu

Random feature approximation is arguably one of the most popular techniques to speed up kernel methods in large scale algorithms and provides a theoretical approach to the analysis of deep neural networks. We analyze generalization…

Machine Learning · Computer Science 2023-08-30 Mike Nguyen , Nicole Mücke

Inverse reinforcement learning (IRL) recovers reward functions from observed behavior, yet traditional methods assume a single stationary reward that cannot capture goal switching within an episode. Recent multi-intention IRL methods…

Machine Learning · Computer Science 2026-05-27 Wenyuan Sheng , Hao Zhu , Joschka Boedecker

We present an alternative to the pseudo-inverse method for determining the hidden to output weight values for Extreme Learning Machines performing classification tasks. The method is based on linear discriminant analysis and provides Bayes…

Neural and Evolutionary Computing · Computer Science 2014-06-13 Philip de Chazal , Jonathan Tapson , André van Schaik

The infinite restricted Boltzmann machine (iRBM) is an extension of the classic RBM. It enjoys a good property of automatically deciding the size of the hidden layer according to specific training data. With sufficient training, the iRBM…

Machine Learning · Computer Science 2018-07-30 Xuan Peng , Xunzhang Gao , Xiang Li

Ensemble Kalman inversion (EKI) is a sequential Monte Carlo method used to solve inverse problems within a Bayesian framework. Unlike backpropagation, EKI is a gradient-free optimization method that only necessitates the evaluation of…

Machine Learning · Computer Science 2023-07-18 Lucas Böttcher

Differential privacy has become a cornerstone in the development of privacy-preserving learning algorithms. This work addresses optimizing differentially private kernel learning within the empirical risk minimization (ERM) framework. We…

Machine Learning · Statistics 2026-04-30 Bonwoo Lee , Cheolwoo Park , Jeongyoun Ahn

In this paper, we focus on the problem of inferring the underlying reward function of an expert given demonstrations, which is often referred to as inverse reinforcement learning (IRL). In particular, we propose a model-free density-based…

Robotics · Computer Science 2016-10-03 Sungjoon Choi , Kyungjae Lee , Andy Park , Songhwai Oh

Online (also called "recursive" or "adaptive") estimation of fixed model parameters in hidden Markov models is a topic of much interest in times series modelling. In this work, we propose an online parameter estimation algorithm that…

Computation · Statistics 2011-02-16 Olivier Cappé

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

It has previously been shown that by using reinforcement learning (RL), agents can derive simple approximate and exact-restricted numeral systems that are similar to human ones (Carlsson, 2021). However, it is a major challenge to show how…

Computation and Language · Computer Science 2025-05-20 Andrea Silvi , Jonathan Thomas , Emil Carlsson , Devdatt Dubhashi , Moa Johansson

Standard regularization methods that are used to compute solutions to ill-posed inverse problems require knowledge of the forward model. In many real-life applications, the forward model is not known, but training data is readily available.…

Numerical Analysis · Mathematics 2015-06-19 Julianne Chung , Matthias Chung

Model-based learned iterative reconstruction methods have recently been shown to outperform classical reconstruction algorithms. Applicability of these methods to large scale inverse problems is however limited by the available memory for…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Andreas Hauptmann , Jonas Adler , Simon Arridge , Ozan Öktem

In the past decades, we have witnessed significant progress in the domain of autonomous driving. Advanced techniques based on optimization and reinforcement learning (RL) become increasingly powerful at solving the forward problem: given…

Robotics · Computer Science 2020-06-25 Zheng Wu , Liting Sun , Wei Zhan , Chenyu Yang , Masayoshi Tomizuka

Extreme learning machine (ELM), which can be viewed as a variant of Random Vector Functional Link (RVFL) network without the input-output direct connections, has been extensively used to create multi-layer (deep) neural networks. Such…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Rakesh Katuwal , P. N. Suganthan

Expectation-Maximization (EM) algorithm is a widely used iterative algorithm for computing (local) maximum likelihood estimate (MLE). It can be used in an extensive range of problems, including the clustering of data based on the Gaussian…

Machine Learning · Statistics 2023-03-28 Pierre Houdouin , Esa Ollila , Frederic Pascal

The Expectation--Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of…

Machine Learning · Statistics 2022-11-15 Hideitsu Hino , Shotaro Akaho , Noboru Murata

We propose Improved Memories Learning (IMeL), a novel algorithm that turns reinforcement learning (RL) into a supervised learning (SL) problem and delimits the role of neural networks (NN) to interpolation. IMeL consists of two components.…

Machine Learning · Computer Science 2020-08-25 Francesco Varoli , Guido Novati , Pantelis R. Vlachas , Petros Koumoutsakos

We propose a new method that uses deep learning techniques to accelerate the popular alternating direction method of multipliers (ADMM) solution for inverse problems. The ADMM updates consist of a proximity operator, a least squares…

Computer Vision and Pattern Recognition · Computer Science 2017-11-16 Qi Wei , Kai Fan , Lawrence Carin , Katherine A. Heller

Although extreme learning machine (ELM) has been successfully applied to a number of pattern recognition problems, it fails to pro-vide sufficient good results in hyperspectral image (HSI) classification due to two main drawbacks. The first…

Computer Vision and Pattern Recognition · Computer Science 2018-05-15 Faxian Cao , Zhijing Yang , Jinchang Ren , Wing-Kuen Ling