English
Related papers

Related papers: A randomized progressive iterative regularization …

200 papers

We analyze two classical algorithms for solving additively composite convex optimization problems where the objective is the sum of a smooth term and a nonsmooth regularizer: proximal stochastic gradient method for a single regularizer; and…

Optimization and Control · Mathematics 2026-02-06 Kevin Kurian Thomas Vaidyan , Michael P. Friedlander , Ahmet Alacaoglu

Measurements are a vital part of any quantum computation, whether as a final step to retrieve results, as an intermediate step to inform subsequent operations, or as part of the computation itself (as in measurement-based quantum…

Quantum Physics · Physics 2023-04-14 Stefanie J. Beale , Joel J. Wallman

Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs,…

Numerical Analysis · Mathematics 2024-12-19 Matthias J. Ehrhardt , Zeljko Kereta , Jingwei Liang , Junqi Tang

In this paper, we propose new sequential randomized algorithms for convex optimization problems in the presence of uncertainty. A rigorous analysis of the theoretical properties of the solutions obtained by these algorithms, for full…

Systems and Control · Computer Science 2016-11-17 Mohammadreza Chamanbaz , Fabrizio Dabbene , Roberto Tempo , Venkatakrishnan Venkataramanan , Qing-Guo Wang

The alignment of a set of objects by means of transformations plays an important role in computer vision. Whilst the case for only two objects can be solved globally, when multiple objects are considered usually iterative methods are used.…

Computer Vision and Pattern Recognition · Computer Science 2016-05-12 Florian Bernard , Johan Thunberg , Peter Gemmar , Frank Hertel , Andreas Husch , Jorge Goncalves

The Column Subset Selection Problem provides a natural framework for unsupervised feature selection. Despite being a hard combinatorial optimization problem, there exist efficient algorithms that provide good approximations. The drawback of…

Machine Learning · Computer Science 2018-04-13 Bruno Ordozgoiti , Alberto Mozo , Jesús García López de Lacalle

The data consistency for the physical forward model is crucial in inverse problems, especially in MR imaging reconstruction. The standard way is to unroll an iterative algorithm into a neural network with a forward model embedded. The…

Image and Video Processing · Electrical Eng. & Systems 2023-06-28 Guanxiong Luo , Mengmeng Kuang , Peng Cao

High-dimensional predictive models, those with more measurements than observations, require regularization to be well defined, perform well empirically, and possess theoretical guarantees. The amount of regularization, often determined by…

Methodology · Statistics 2019-07-16 Darren Homrighausen , Daniel J. McDonald

We introduce a general framework for analyzing learning algorithms based on the notion of self-regularization, which captures implicit complexity control without requiring explicit regularization. This is motivated by previous observations…

Machine Learning · Statistics 2026-03-19 Max Schölpple , Liu Fanghui , Ingo Steinwart

We study the problem of recovering an incomplete $m\times n$ matrix of rank $r$ with columns arriving online over time. This is known as the problem of life-long matrix completion, and is widely applied to recommendation system, computer…

Machine Learning · Computer Science 2016-12-04 Maria-Florina Balcan , Hongyang Zhang

We study the stability of regularization by projection for solving linear inverse problems if the forward operator is given indirectly but specified via some input-output training pairs. We extend the approach in "Data driven regularization…

Numerical Analysis · Mathematics 2025-08-12 Martin Hanke , Otmar Scherzer

Source identification problems have multiple applications in engineering such as the identification of fissures in materials, determination of sources in electromagnetic fields or geophysical applications, detection of contaminant sources,…

Numerical Analysis · Mathematics 2021-11-12 Guillermo F. Umbricht , Diana Rubio , Claudio El Hasi

Regularization is a powerful technique for extracting useful information from noisy data. Typically, it is implemented by adding some sort of norm constraint to an objective function and then exactly optimizing the modified objective…

Data Structures and Algorithms · Computer Science 2011-04-28 Michael W. Mahoney , Lorenzo Orecchia

Computing accurate low rank approximations of large matrices is a fundamental data mining task. In many applications however the matrix contains sensitive information about individuals. In such case we would like to release a low rank…

Data Structures and Algorithms · Computer Science 2012-11-06 Moritz Hardt , Aaron Roth

The reconstruction of images from their corresponding noisy Radon transform is a typical example of an ill-posed linear inverse problem as arising in the application of computerized tomography (CT). As the (naive) solution does not depend…

A number of image-processing problems can be formulated as optimization problems. The objective function typically contains several terms specifically designed for different purposes. Parameters in front of these terms are used to control…

Medical Physics · Physics 2017-11-02 Chenyang Shen , Yesenia Gonzalez , Liyuan Chen , Steve B. Jiang , Xun Jia

Disturbance noises are always bounded in a practical system, while fusion estimation is to best utilize multiple sensor data containing noises for the purpose of estimating a quantity--a parameter or process. However, few results are…

Systems and Control · Computer Science 2018-07-20 Bo Chen , Guoqiang Hu , Daniel W. C. Ho , Li Yu

Solving inverse problems requires appropriate regularization techniques to ensure well-posedness and stability. In recent years, denoiser-driven methods have emerged as effective regularization strategies, achieving state-of-the-art…

Numerical Analysis · Mathematics 2026-04-23 Harshit Bajpai , Ankik Kumar Giri , Tim Jahn , Abhinav Jha

This work presents a novel and effective method for fitting multidimensional ellipsoids to scattered data in the contamination of noise and outliers. We approach the problem as a Bayesian parameter estimate process and maximize the…

Methodology · Statistics 2024-07-30 Zhao Mingyang , Jia Xiaohong , Ma Lei , Shi Yuke , Jiang Jingen , Li Qizhai , Yan Dong-Ming , Huang Tiejun

In the current quantum computing paradigm, significant focus is placed on the reduction or mitigation of quantum decoherence. When designing new quantum processing units, the general objective is to reduce the amount of noise qubits are…

Quantum Physics · Physics 2026-02-17 Viacheslav Kuzmin , Wilfrid Somogyi , Ekaterina Pankovets , Alexey Melnikov