English
Related papers

Related papers: Generalized Pseudolikelihood Methods for Inverse C…

200 papers

We propose a Coefficient-to-Basis Network (C2BNet), a novel framework for solving inverse problems within the operator learning paradigm. C2BNet efficiently adapts to different discretizations through fine-tuning, using a pre-trained model…

Machine Learning · Computer Science 2025-03-12 Zecheng Zhang , Hao Liu , Wenjing Liao , Guang Lin

In variational inference, the benefits of Bayesian models rely on accurately capturing the true posterior distribution. We propose using neural samplers that specify implicit distributions, which are well-suited for approximating complex…

Machine Learning · Computer Science 2023-11-10 Anshuk Uppal , Kristoffer Stensbo-Smidt , Wouter Boomsma , Jes Frellsen

Deep learning has become a crucial technology for making breakthroughs in many fields. Nevertheless, it still faces two important challenges in theoretical and applied aspects. The first lies in the shortcomings of gradient descent based…

Machine Learning · Computer Science 2024-07-09 Binghong Liu , Ziqi Zhao , Shupan Li , Ke Wang

In this paper, the authors first provide an overview of two major developments on complex survey data analysis: the empirical likelihood methods and statistical inference with non-probability survey samples, and highlight the important…

Methodology · Statistics 2025-08-14 Yilin Chen , Pengfei Li , J. N. K. Rao , Changbao Wu

We develop a new sampling method to estimate eigenvector centrality on incomplete networks. Our goal is to estimate this global centrality measure having at disposal a limited amount of data. This is the case in many real-world scenarios…

Social and Information Networks · Computer Science 2020-10-29 Nicolò Ruggeri , Caterina De Bacco

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and materials properties. A common short-coming shared by current approaches, however, is that neural networks only give point…

Computational Physics · Physics 2023-05-10 Albert Zhu , Simon Batzner , Albert Musaelian , Boris Kozinsky

Sample-based Bayesian inference provides a route to uncertainty quantification in the geosciences, and inverse problems in general, though is very computationally demanding in the naive form that requires simulating an accurate computer…

Computation · Statistics 2019-04-12 Tiangang Cui , Colin Fox , Michael J O'Sullivan

This paper tackles the problem of robust covariance matrix estimation when the data is incomplete. Classical statistical estimation methodologies are usually built upon the Gaussian assumption, whereas existing robust estimation ones assume…

While self-supervised learning techniques are often used to mining implicit knowledge from unlabeled data via modeling multiple views, it is unclear how to perform effective representation learning in a complex and inconsistent context. To…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Jiangmeng Li , Wenwen Qiang , Changwen Zheng , Bing Su , Farid Razzak , Ji-Rong Wen , Hui Xiong

We present a sparse representation of model uncertainty for Deep Neural Networks (DNNs) where the parameter posterior is approximated with an inverse formulation of the Multivariate Normal Distribution (MND), also known as the information…

Machine Learning · Computer Science 2020-06-23 Jongseok Lee , Matthias Humt , Jianxiang Feng , Rudolph Triebel

Neural networks are powerful tools in various applications, and quantifying their uncertainty is crucial for reliable decision-making. In the deep learning field, the uncertainties are usually categorized into aleatoric (data) and epistemic…

Machine Learning · Computer Science 2023-12-21 Wang Zhang , Ziwen Ma , Subhro Das , Tsui-Wei Weng , Alexandre Megretski , Luca Daniel , Lam M. Nguyen

Covariance estimation for high-dimensional datasets is a fundamental problem in modern day statistics with numerous applications. In these high dimensional datasets, the number of variables p is typically larger than the sample size n. A…

Methodology · Statistics 2016-10-11 Kshitij Khare , Sang Oh , Syed Rahman , Bala Rajaratnam

Noisy matrix completion aims at estimating a low-rank matrix given only partial and corrupted entries. Despite substantial progress in designing efficient estimation algorithms, it remains largely unclear how to assess the uncertainty of…

Machine Learning · Statistics 2019-11-15 Yuxin Chen , Jianqing Fan , Cong Ma , Yuling Yan

Low-rank pseudoinverses are widely used to approximate matrix inverses in scalable machine learning, optimization, and scientific computing. However, real-world matrices are often observed with noise, arising from sampling, sketching, and…

Machine Learning · Computer Science 2025-10-30 Phuc Tran , Nisheeth K. Vishnoi

Newton-step approximations to pseudo maximum likelihood estimates of spatial autoregressive models with a large number of parameters are examined, in the sense that the parameter space grows slowly as a function of sample size. These have…

Econometrics · Economics 2021-05-25 Abhimanyu Gupta

Nonparametric maximum likelihood estimation is intended to infer the unknown density distribution while making as few assumptions as possible. To alleviate the over parameterization in nonparametric data fitting, smoothing assumptions are…

Machine Learning · Statistics 2021-04-21 YunPeng Li , ZhaoHui Ye

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes…

Methodology · Statistics 2021-09-13 Jason Xu , Kenneth Lange

Neural networks are becoming increasingly popular in applications, but our mathematical understanding of their potential and limitations is still limited. In this paper, we further this understanding by developing statistical guarantees for…

Machine Learning · Computer Science 2022-12-13 Johannes Lederer

This paper investigates the comparative performance of two fundamental approaches to solving linear regression problems: the closed-form Moore-Penrose pseudoinverse and the iterative gradient descent method. Linear regression is a…

Machine Learning · Computer Science 2025-05-30 Alex Adams

An effective two-stage method for an estimation of parameters of the linear regression is considered. For this purpose we introduce a certain quasi-estimator that, in contrast to usual estimator, produces two alternative estimates. It is…

Statistics Theory · Mathematics 2010-10-06 Anatoly Gordinsky