English
Related papers

Related papers: Unbiased Parameter Estimation via DREM with Annihi…

200 papers

Hyperspectral imagery collected from airborne or satellite sources inevitably suffers from spectral variability, making it difficult for spectral unmixing to accurately estimate abundance maps. The classical unmixing model, the linear…

Computer Vision and Pattern Recognition · Computer Science 2019-06-25 Danfeng Hong , Naoto Yokoya , Jocelyn Chanussot , Xiao Xiang Zhu

The parameter estimation of unnormalized models is a challenging problem. The maximum likelihood estimation (MLE) is computationally infeasible for these models since normalizing constants are not explicitly calculated. Although some…

Machine Learning · Statistics 2020-06-09 Masatoshi Uehara , Takafumi Kanamori , Takashi Takenouchi , Takeru Matsuda

The Laplace approximation (LA) has been proposed as a method for approximating the marginal likelihood of statistical models with latent variables. However, the approximate maximum likelihood estimators (MLEs) based on the LA are often…

Methodology · Statistics 2022-07-21 Jeongseop Han , Youngjo Lee

Adaptive control is subject to stability and performance issues when a learned model is used to enhance its performance. This paper thus presents a deep learning-based adaptive control framework for nonlinear systems with…

Machine Learning · Computer Science 2021-10-05 Hiroyasu Tsukamoto , Soon-Jo Chung , Jean-Jacques Slotine

Many applications require that we learn the parameters of a model from data. EM is a method used to learn the parameters of probabilistic models for which the data for some of the variables in the models is either missing or hidden. There…

Machine Learning · Computer Science 2013-01-30 Luis E. Ortiz , Leslie Pack Kaelbling

In all applications in digital communications, it is crucial for an estimator to be unbiased. Although so-called soft feedback is widely employed in many different fields of engineering, typically the biased estimate is used. In this paper,…

Information Theory · Computer Science 2018-02-21 Susanne Sparrer , Robert F. H. Fischer

Soft-thresholding is a sparse modeling method that is typically applied to wavelet denoising in statistical signal processing and analysis. It has a single parameter that controls a threshold level on wavelet coefficients and,…

Methodology · Statistics 2016-02-01 Katsuyuki Hagiwara

We present a new method of training energy-based models (EBMs) for anomaly detection that leverages low-dimensional structures within data. The proposed algorithm, Manifold Projection-Diffusion Recovery (MPDR), first perturbs a data point…

Machine Learning · Computer Science 2023-10-31 Sangwoong Yoon , Young-Uk Jin , Yung-Kyun Noh , Frank C. Park

Restricted Boltzmann machines (RBMs) are energy-based models analogous to the Ising model and are widely applied in statistical machine learning. The standard inverse Ising problem with a complete dataset requires computing both data and…

Machine Learning · Statistics 2025-09-01 Kaiji Sekimoto , Muneki Yasuda

The problem of distributed estimation of a parametric physical field is stated as a maximum likelihood estimation problem. Sensor observations are distorted by additive white Gaussian noise. Prior to data transmission, each sensor quantizes…

Information Theory · Computer Science 2012-09-21 Natalia A. Schmid , Marwan Alkhweldi , Matthew C. Valenti

In recent years, there is a growing need to train machine learning models on a huge volume of data. Designing efficient distributed optimization algorithms for empirical risk minimization (ERM) has therefore become an active and challenging…

Optimization and Control · Mathematics 2019-11-19 Ching-pei Lee , Kai-Wei Chang

In this paper, we develop an asymptotic expansion-regularization (AER) method for inverse source problems in two-dimensional nonlinear and nonstationary singularly perturbed partial differential equations (PDEs). The key idea of this…

Numerical Analysis · Mathematics 2022-10-14 Dmitrii Chaikovskii , Aleksei Liubavin , Ye Zhang

Industry 4.0 aims to optimize the manufacturing environment by leveraging new technological advances, such as new sensing capabilities and artificial intelligence. The DRAEM technique has shown state-of-the-art performance for unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Jože M. Rožanec , Patrik Zajec , Spyros Theodoropoulos , Erik Koehorst , Blaž Fortuna , Dunja Mladenić

We proposed a novel dense line spectrum super-resolution algorithm, the DMRA, that leverages dynamical multi-resolution of atoms technique to address the limitation of traditional compressed sensing methods when handling dense point-source…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Mingguang Han , Yi Zeng , Xiaoguang Li , Tiejun Li

In this article, we construct empirical likelihood (EL)-weighted estimators of linear functionals of a probability measure in the presence of side information. Motivated by nuisance parameters in semiparametric models with possibly infinite…

Statistics Theory · Mathematics 2023-01-25 Shan Wang , Hanxiang Peng

We address the problem of estimating the inputs of a dynamical system from measurements of the system's outputs. To this end, we introduce a novel estimation algorithm that explicitly trades off bias and variance to optimally reduce the…

Machine Learning · Computer Science 2019-09-20 Sebastian Curi , Kfir Y. Levy , Andreas Krause

A generalization of the dynamic regressor extension and mixing procedure is proposed, which, unlike the original procedure, first, guarantees a reduction of the unknown parameter identification error if the requirement of regressor…

Systems and Control · Electrical Eng. & Systems 2022-10-04 Anton Glushchenko , Konstantin Lastochkin

This study introduces a debiasing method for regression estimators, including high-dimensional and nonparametric regression estimators. For example, nonparametric regression methods allow for the estimation of regression functions in a…

Machine Learning · Statistics 2024-11-27 Masahiro Kato

Traditional nonparametric estimation methods often lead to a slow convergence rate in large dimensions and require unrealistically enormous sizes of datasets for reliable conclusions. We develop an approach based on partial derivatives,…

Methodology · Statistics 2024-08-20 Xiaowu Dai

1. Parameter inference from distorted measurements is discussed. 2. Smeared measurements are unfolded without explicit regularization. The corresponding results are unbiased and permit to fit parameters and to apply quantitative…

Data Analysis, Statistics and Probability · Physics 2016-07-26 Guenter Zech