English
Related papers

Related papers: Trading Accuracy for Numerical Stability: Orthogon…

200 papers

Algorithms for signal recovery in compressed sensing (CS) are often improved by stabilization techniques, such as damping, or the less widely known so-called fractional approach, which is based on the expectation propagation (EP) framework.…

Information Theory · Computer Science 2021-10-01 Carmen Sippel , Robert F. H. Fischer

Algorithmic stability is a central concept in statistics and learning theory that measures how sensitive an algorithm's output is to small changes in the training data. Stability plays a crucial role in understanding generalization,…

Statistics Theory · Mathematics 2026-01-21 Abhinav Chakraborty , Yuetian Luo , Rina Foygel Barber

In our recent work on iterative computation in hardware, we showed that arbitrary-precision solvers can perform more favorably than their traditional arithmetic equivalents when the latter's precisions are either under- or over-budgeted for…

Numerical Analysis · Mathematics 2020-10-20 He Li , Ian McInerney , James J. Davis , George A. Constantinides

Probabilistic Circuits (PCs) are a promising avenue for probabilistic modeling. They combine advantages of probabilistic graphical models (PGMs) with those of neural networks (NNs). Crucially, however, they are tractable probabilistic…

Machine Learning · Computer Science 2021-06-07 Anji Liu , Guy Van den Broeck

Theoretical guarantees for the robust solution of inverse problems have important implications for applications. To achieve both guarantees and high reconstruction quality, we propose learning a pixel-based ridge regularizer with a…

Optimization and Control · Mathematics 2025-01-07 Sebastian Neumayer , Fabian Altekrüger

A challenging problem in estimating high-dimensional graphical models is to choose the regularization parameter in a data-dependent way. The standard techniques include $K$-fold cross-validation ($K$-CV), Akaike information criterion (AIC),…

Machine Learning · Statistics 2010-06-18 Han Liu , Kathryn Roeder , Larry Wasserman

Standard regularization methods typically favor solutions which are in, or close to, the orthogonal complement of the null space of the forward operator/matrix $\mathsf{A}$. This particular biasedness might not be desirable in applications…

Numerical Analysis · Mathematics 2025-09-05 Ole Løseth Elvetun , Bjørn Fredrik Nielsen , Niranjana Sudheer

We present a regularization method to approach a solution of the pessimistic formulation of ill -posed bilevel problems . This allows to overcome the difficulty arising from the non uniqueness of the lower level problems solutions and…

Optimization and Control · Mathematics 2016-08-16 Maïtine Bergounioux , Mounir Haddou

Data-driven control strategies for dynamical systems with unknown parameters are popular in theory and applications. An essential problem is to prevent stochastic linear systems becoming destabilized, due to the uncertainty of the…

Systems and Control · Computer Science 2019-05-20 Mohamad Kazem Shirani Faradonbeh , Ambuj Tewari , George Michailidis

In this study, the orthogonalization process for different inner products is applied to pairwise comparisons. Properties of consistent approximations of a given inconsistent pairwise comparisons matrix are examined. A method of a derivation…

Other Computer Science · Computer Science 2020-02-18 W. W. Koczkodaj , R. Smarzewski , J. Szybowski

This work addresses the problem of error concealment in video transmission systems over noisy channels employing Bregman divergences along with regularization. Error concealment intends to improve the effects of disturbances at the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-11 Alessandra M. Coelho , Vania V. Estrela , Felipe P. do Carmo , Sandro R. Fernandes

Convolutional neural networks are capable of learning powerful representational spaces, which are necessary for tackling complex learning tasks. However, due to the model capacity required to capture such representations, they are often…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Terrance DeVries , Graham W. Taylor

The aim of this paper is to numerically study the performance of a method of regularization. This technique was developed to solve the illposed problem of estimating a source-dimensional Poisson equation for two dimensions from measurements…

Analysis of PDEs · Mathematics 2024-04-22 Guillermo Federico Umbricht , Diana Rubio

The most common method for calculating accurate numerical solutions for complicated linear differential equations - for example, finding eigenvalues and eigenfunctions of the Schrodinger equation for many-electron atoms - is the variational…

Computational Physics · Physics 2014-11-13 Charles Schwartz

We find an algorithm of numerical renormalization group for spin chain models. The essence of this algorithm is orthogonal transformation of basis states, which is useful for reducing the number of relevant basis states to create effective…

High Energy Physics - Theory · Physics 2009-11-07 Takanori Sugihara

The authors discuss how general regularization schemes, in particular linear regularization schemes and projection schemes, can be used to design tests for signal detection in statistical inverse problems. It is shown that such tests can…

Statistics Theory · Mathematics 2013-04-04 Clément Marteau , Peter Mathé

The state space dynamics representation is the most general approach for nonlinear systems and often chosen for system identification. During training, the state trajectory can deform significantly leading to poor data coverage of the state…

Machine Learning · Computer Science 2025-07-11 Hermann Klein , Max Heinz Herkersdorf , Oliver Nelles

Regularization is used in many different areas of optimization when solutions are sought which not only minimize a given function, but also possess a certain degree of regularity. Popular applications are image denoising, sparse regression…

Optimization and Control · Mathematics 2021-11-15 Bennet Gebken , Katharina Bieker , Sebastian Peitz

Bicoherence analysis is a well established method for identifying the quadratic nonlinearity of stationary processes. However, it is often applied without checking the basic assumptions of stationarity and convergence. The classic…

Signal Processing · Electrical Eng. & Systems 2018-11-08 Peter Zsolt Poloskei , Gergely Papp , Gabor Por , Laszlo Horvath , Gergo I. Pokol

Recent works in medical image registration have proposed the use of Implicit Neural Representations, demonstrating performance that rivals state-of-the-art learning-based methods. However, these implicit representations need to be optimized…

Image and Video Processing · Electrical Eng. & Systems 2023-10-04 Louis D. van Harten , Jaap Stoker , Ivana Išgum