English
Related papers

Related papers: On a Dynamic Variant of the Iteratively Regularize…

200 papers

This paper describes a methodology for detecting anomalies from sequentially observed and potentially noisy data. The proposed approach consists of two main elements: (1) {\em filtering}, or assigning a belief or likelihood to each…

Machine Learning · Computer Science 2016-11-17 Maxim Raginsky , Rebecca Willett , Corinne Horn , Jorge Silva , Roummel Marcia

We develop a computationally efficient algorithm for the automatic regularization of nonlinear inverse problems based on the discrepancy principle. We formulate the problem as an equality constrained optimization problem, where the…

Numerical Analysis · Mathematics 2021-09-03 Jeffrey Cornelis , Wim Vanroose

We develop and analyze stochastic inexact Gauss-Newton methods for nonlinear least-squares problems and for nonlinear systems ofequations. Random models are formed using suitable sampling strategies for the matrices involved in the…

Optimization and Control · Mathematics 2024-12-10 Stefania Bellavia , Greta Malaspina , Benedetta Morini

Probabilistic state estimation is essential for robots navigating uncertain environments. Accurately and efficiently managing uncertainty in estimated states is key to robust robotic operation. However, nonlinearities in robotic platforms…

Robotics · Computer Science 2024-11-19 Min-Won Seo , Solmaz S. Kia

Algorithms for solving nonconvex, nonsmooth, finite-sum optimization problems are proposed and tested. In particular, the algorithms are proposed and tested in the context of an optimization problem formulation arising in semi-supervised…

Optimization and Control · Mathematics 2022-07-21 Gulcin Dinc Yalcin , Frank E. Curtis

Incorporating prior information into inverse problems, e.g. via maximum-a-posteriori estimation, is an important technique for facilitating robust inverse problem solutions. In this paper, we devise two novel approaches for linear inverse…

Signal Processing · Electrical Eng. & Systems 2024-03-19 Carter Lyons , Raghu G. Raj , Margaret Cheney

Clinical time series are often irregularly sampled, with varying sensor frequencies, missing observations, and misaligned timestamps. Prior approaches typically address these irregularities by interpolating data into regular sequences,…

Machine Learning · Computer Science 2025-12-18 Arash Hajisafi , Maria Despoina Siampou , Bita Azarijoo , Zhen Xiong , Cyrus Shahabi

Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one. Based on iterative Gaussianization, we propose a new type of normalizing flow model that enables both…

Machine Learning · Computer Science 2020-03-05 Chenlin Meng , Yang Song , Jiaming Song , Stefano Ermon

Graph-based and sequential methods are two popular recommendation paradigms, each excelling in its domain but lacking the ability to leverage signals from the other. To address this, we propose a novel method that integrates both approaches…

Information Retrieval · Computer Science 2025-01-30 Yuwei Cao , Liangwei Yang , Zhiwei Liu , Yuqing Liu , Chen Wang , Yueqing Liang , Hao Peng , Philip S. Yu

Isotonic regression is a nonparametric approach for fitting monotonic models to data that has been widely studied from both theoretical and practical perspectives. However, this approach encounters computational and statistical overfitting…

Methodology · Statistics 2012-03-21 Ronny Luss , Saharon Rosset , Moni Shahar

Motivated by the need to study the molecular mechanism underlying Type 1 Diabetes (T1D) with the gene expression data collected from both the patients and healthy controls at multiple time points, we propose an innovative method for jointly…

Methodology · Statistics 2018-12-10 Bochao Jia , Faming Liang , the TEDDY Study Group

Inverse Problems in medical imaging and computer vision are traditionally solved using purely model-based methods. Among those variational regularization models are one of the most popular approaches. We propose a new framework for applying…

Computer Vision and Pattern Recognition · Computer Science 2019-01-14 Sebastian Lunz , Ozan Öktem , Carola-Bibiane Schönlieb

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

In inverse problems, it is widely recognized that the incorporation of a sparsity prior yields a regularization effect on the solution. This approach is grounded on the a priori assumption that the unknown can be appropriately represented…

Machine Learning · Statistics 2025-06-13 Giovanni S. Alberti , Luca Ratti , Matteo Santacesaria , Silvia Sciutto

We propose a numerical method based on physics-informed Random Projection Neural Networks for the solution of Initial Value Problems (IVPs) of Ordinary Differential Equations (ODEs) with a focus on stiff problems. We address an Extreme…

Gaussian graphical models are of great interest in statistical learning. Because the conditional independencies between different nodes correspond to zero entries in the inverse covariance matrix of the Gaussian distribution, one can learn…

Machine Learning · Computer Science 2010-11-02 Katya Scheinberg , Shiqian Ma , Donald Goldfarb

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

We propose a globally convergent Gauss-Newton algorithm for finding a local optimal solution of a non-convex and possibly non-smooth optimization problem. The algorithm that we present is based on a Gauss-Newton-type iteration for the…

Optimization and Control · Mathematics 2020-12-08 Ilyes Mezghani , Quoc Tran-Dinh , Ion Necoara , Anthony Papavasiliou

Full waveform inversion (FWI) is a large-scale nonlinear ill-posed problem for which computationally expensive Newton-type methods can become trapped in undesirable local minima, particularly when the initial model lacks a low-wavenumber…

Geophysics · Physics 2024-02-23 Ali Gholami

In recent years, deep learning-based methods have been proposed for solving inverse scattering problems (ISPs), but most of them heavily rely on data and suffer from limited generalization capabilities. In this paper, a new solving scheme…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Yutong Du , Zicheng Liu , Bazargul Matkerim , Changyou Li , Yali Zong , Bo Qi , Jingwei Kou