English
Related papers

Related papers: Regularization and decimation pseudolikelihood app…

200 papers

We introduce new variants of classical regression-based algorithms for optimal stopping problems based on computation of regression coefficients by Monte Carlo approximation of the corresponding $L^2$ inner products instead of the…

Computational Finance · Quantitative Finance 2019-04-29 Christian Bayer , Martin Redmann , John Schoenmakers

We present arguments for the formulation of unified approach to different standard continuous inference methods from partial information. It is claimed that an explicit partition of information into a priori (prior knowledge) and a…

Machine Learning · Statistics 2012-12-07 Mark A. Kon , Leszek Plaskota

Regularization is often used in high-dimensional regression settings to generate a sparse model, which can save tremendous computing resources and identify predictors that are most strongly associated with the response. When the predictors…

Machine Learning · Statistics 2026-05-07 Jia Wei He , R. Ayesha Ali , Gerarda Darlington

Inverse problems arise in a wide spectrum of applications in fields ranging from engineering to scientific computation. Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, such…

Numerical Analysis · Mathematics 2025-05-12 Abinash Nayak

This paper presents a detailed theoretical analysis of the three stochastic approximation proximal gradient algorithms proposed in our companion paper [49] to set regularization parameters by marginal maximum likelihood estimation. We prove…

Statistics Theory · Mathematics 2020-08-14 Valentin De Bortoli , Alain Durmus , Ana F. Vidal , Marcelo Pereyra

Unpaired image denoising has achieved promising development over the last few years. Regardless of the performance, methods tend to heavily rely on underlying noise properties or any assumption which is not always practical. Alternatively,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-05 Manisha Das Chaity , Masud An Nur Islam Fahim

This article presents a Bayesian inferential method where the likelihood for a model is unknown but where data can easily be simulated from the model. We discretize simulated (continuous) data to estimate the implicit likelihood in a…

We introduce a version of the cavity method for diluted mean-field spin models that allows the computation of thermodynamic quantities similar to the Franz-Parisi quenched potential in sparse random graph models. This method is developed in…

Disordered Systems and Neural Networks · Physics 2015-05-13 Federico Ricci-Tersenghi , Guilhem Semerjian

We consider the problem of making nonparametric inference in a class of multi-dimensional diffusions in divergence form, from low-frequency data. Statistical analysis in this setting is notoriously challenging due to the intractability of…

Methodology · Statistics 2025-01-23 Matteo Giordano , Sven Wang

An approximation method is presented for probabilistic inference with continuous random variables. These problems can arise in many practical problems, in particular where there are "second order" probabilities. The approximation, based on…

Artificial Intelligence · Computer Science 2013-04-10 Ross D. Shachter

We study the benefit of modern simulation-based inference to constrain particle interactions at the LHC. We explore ways to incorporate known physics structures into likelihood estimation, specifically morphing-aware estimation and…

High Energy Physics - Phenomenology · Physics 2025-10-01 Henning Bahl , Victor Bresó , Giovanni De Crescenzo , Tilman Plehn

Deep neural networks have had an enormous impact on image analysis. State-of-the-art training methods, based on weight decay and DropOut, result in impressive performance when a very large training set is available. However, they tend to…

Machine Learning · Computer Science 2019-09-02 Amal Rannen Triki , Matthew B. Blaschko

The inverse statistical problem of finding direct interactions in complex networks is difficult. In the natural sciences, well-controlled perturbation experiments are widely used to probe the structure of complex networks. However, our…

Disordered Systems and Neural Networks · Physics 2019-10-24 Jialong Jiang , David A. Sivak , Matt Thomson

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

Machine Learning · Computer Science 2012-07-03 Qiang Liu , Alexander Ihler

Generalized linear model with $L_1$ and $L_2$ regularization is a widely used technique for solving classification, class probability estimation and regression problems. With the numbers of both features and examples growing rapidly in the…

Machine Learning · Statistics 2017-06-28 Ilya Trofimov , Alexander Genkin

The computational complexity of simultaneous inference methods in high-dimensional linear regression models quickly increases with the number variables. This paper proposes a computationally efficient method based on the Moore-Penrose…

Statistics Theory · Mathematics 2021-02-02 Tom Boot , Didier Nibbering

Image deblurring is a notoriously challenging ill-posed inverse problem. In recent years, a wide variety of approaches have been proposed based upon regularization at the level of the image or on techniques from machine learning. We propose…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Gabriel Rioux , Rustum Choksi , Tim Hoheisel , Pierre Marechal , Christopher Scarvelis

Linear problems appear in a variety of disciplines and their application for the transmission matrix recovery is one of the most stimulating challenges in biomedical imaging. Its knowledge turns any random media into an optical tool that…

Machine Learning · Statistics 2019-02-05 Daniele Ancora , Luca Leuzzi

Although much research has been devoted to the problem of restoring Poissonian images, namely in the fields of medical and astronomical imaging, applying the state of the art regularizers (such as those based on wavelets or total variation)…

Optimization and Control · Mathematics 2009-05-01 Mario A. T. Figueiredo , Jose M. Bioucas-Dias

Variational regularization of ill-posed inverse problems is based on minimizing the sum of a data fidelity term and a regularization term. The balance between them is tuned using a positive regularization parameter, whose automatic choice…

Numerical Analysis · Mathematics 2025-11-12 Markus Juvonen , Bjørn Jensen , Ilmari Pohjola , Yiqiu Dong , Samuli Siltanen