English
Related papers

Related papers: Filter-based regularisation for impulse response m…

200 papers

We consider the Bayesian optimal filtering problem: i.e. estimating some conditional statistics of a latent time-series signal from an observation sequence. Classical approaches often rely on the use of assumed or estimated transition and…

Machine Learning · Statistics 2023-03-16 Adrian N. Bishop , Edwin V. Bonilla

This paper presents a kernelized offset-free data-driven predictive control scheme for nonlinear systems. Traditional model-based and data-driven predictive controllers often struggle with inaccurate predictors or persistent disturbances,…

Systems and Control · Electrical Eng. & Systems 2024-12-02 Thomas Oliver de Jong , Mircea Lazar

Image reconstruction in X-ray tomography is an ill-posed inverse problem, particularly with limited available data. Regularization is thus essential, but its effectiveness hinges on the choice of a regularization parameter that balances…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Chuyang Wu , Samuli Siltanen

Pattern formation in biological tissues plays an important role in the development of living organisms. Since the classical work of Alan Turing, a pre-eminent way of modelling has been through reaction-diffusion mechanisms. More recently,…

Analysis of PDEs · Mathematics 2023-01-27 Alexey Kazarnikov , Robert Scheichl , Heikki Haario , Anna Marciniak-Czochra

We consider the problem of supervised learning with convex loss functions and propose a new form of iterative regularization based on the subgradient method. Unlike other regularization approaches, in iterative regularization no constraint…

Machine Learning · Statistics 2015-04-02 Junhong Lin , Lorenzo Rosasco , Ding-Xuan Zhou

The linearization of a power flow (PF) model is an important approach for simplifying and accelerating the calculation of a power system's control, operation, and optimization. Traditional model-based methods derive linearized PF models by…

Systems and Control · Computer Science 2017-10-31 Yuxiao Liu , Ning Zhang , Yi Wang , Jingwei Yang , Chongqing Kang

This paper presents an iterative method suitable for inverting semilinear problems which are important kernels in many numerical applications. The primary idea is to employ a parametrization that is able to reduce semilinear problems into…

Numerical Analysis · Mathematics 2019-08-02 Prosper Torsu

In recent years, a variety of learned regularization frameworks for solving inverse problems in imaging have emerged. These offer flexible modeling together with mathematical insights. The proposed methods differ in their architectural…

In supervised learning, the output variable to be predicted is often represented as a function, such as a spectrum or probability distribution. Despite its importance, functional output regression remains relatively unexplored. In this…

Machine Learning · Statistics 2025-03-19 Minoru Kusaba , Megumi Iwayama , Ryo Yoshida

We show that regularizing Bayesian predictive regressions provides a framework for prior sensitivity analysis. We develop a procedure that jointly regularizes expectations and variance-covariance matrices using a pair of shrinkage priors.…

Methodology · Statistics 2017-09-15 Guanhao Feng , Nicholas G. Polson

With the advent of multi-coil imaging and compressed sensing, a number of model based reconstruction algorithms have been created. They incorporate a multitude of different regularization functions based on physics, observed phenomenology,…

Image and Video Processing · Electrical Eng. & Systems 2023-02-03 Nicholas Dwork , Ethan M. I. Johnson , Daniel O'Connor , Jeremy W. Gordon , Adam B. Kerr , Corey A. Baron , John M. Pauly , Peder E. Z. Larson

Identification of model parameters in computer simulations is an important topic in computer experiments. We propose a new method, called the projected kernel calibration method, to estimate these model parameters. The proposed method is…

Methodology · Statistics 2017-05-10 Rui Tuo

Regularization methods allow one to handle a variety of inferential problems where there are more covariates than cases. This allows one to consider a potentially enormous number of covariates for a problem. We exploit the power of these…

Methodology · Statistics 2012-10-03 Yoonkyung Lee , Steven N. MacEachern , Yoonsuh Jung

In this work, we broadly connect kernel-based filtering (e.g. approaches such as the bilateral filters and nonlocal means, but also many more) with general variational formulations of Bayesian regularized least squares, and the related…

Computer Vision and Pattern Recognition · Computer Science 2019-05-01 Frank Ong , Peyman Milanfar , Pascal Getreuer

Many challenging image processing tasks can be described by an ill-posed linear inverse problem: deblurring, deconvolution, inpainting, compressed sensing, and superresolution all lie in this framework. Traditional inverse problem solvers…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Davis Gilton , Greg Ongie , Rebecca Willett

The notion of reproducing kernel Hilbert space (RKHS) has emerged in system identification during the past decade. In the resulting framework, the impulse response estimation problem is formulated as a regularized optimization defined on an…

Systems and Control · Electrical Eng. & Systems 2022-04-19 Mohammad Khosravi , Roy S. Smith

Recently, linear regression models, such as EASE and SLIM, have shown to often produce rather competitive results against more sophisticated deep learning models. On the other side, the (weighted) matrix factorization approaches have been…

Information Retrieval · Computer Science 2021-06-17 Ruoming Jin , Dong Li , Jing Gao , Zhi Liu , Li Chen , Yang Zhou

We analyze a new approach to Machine Learning coming from a modification of classical regularization networks by casting the process in the time dimension, leading to a sort of collapse of dimensionality in the problem of learning the model…

Machine Learning · Computer Science 2017-01-05 Marco Gori , Marco Maggini , Alessandro Rossi

Recently, sparsity-based algorithms are proposed for super-resolution spectrum estimation. However, to achieve adequately high resolution in real-world signal analysis, the dictionary atoms have to be close to each other in frequency,…

Machine Learning · Statistics 2015-06-05 Yiyuan She , Huanghuang Li , Jiangping Wang , Dapeng Wu

We present a method of parameter estimation for large class of nonlinear systems, namely those in which the state consists of output derivatives and the flow is linear in the parameter. The method, which solves for the unknown parameter by…

Systems and Control · Electrical Eng. & Systems 2024-07-16 Simon Kuang , Xinfan Lin