English
Related papers

Related papers: Hierarchical Maximum Likelihood Estimation for Tim…

200 papers

Dimensionality reduction (DR) offers a useful representation of complex high-dimensional data. Recent DR methods focus on hyperbolic geometry to derive a faithful low-dimensional representation of hierarchical data. However, existing…

Machine Learning · Computer Science 2026-04-24 Koshi Watanabe , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

We study empirical Bayes estimation in high-dimensional linear regression. To facilitate computationally efficient estimation of the underlying prior, we adopt a variational empirical Bayes approach, introduced originally in Carbonetto and…

Statistics Theory · Mathematics 2023-10-27 Sumit Mukherjee , Bodhisattva Sen , Subhabrata Sen

We propose a novel hierarchical Bayesian model for learning with a large (possibly infinite) number of tasks/episodes, which suits well the few-shot meta learning problem. We consider episode-wise random variables to model episode-specific…

Machine Learning · Computer Science 2023-06-19 Minyoung Kim , Timothy Hospedales

Multivariate linear regression models often face the problem of heteroscedasticity caused by multiple explanatory variables. The weighted least squares estimation with univariate-dependent weights has limitations in constructing weight…

Methodology · Statistics 2026-01-16 Lei Huang , Chengyue Liu , Li Wang

This paper proposes a multi-step probabilistic forecasting framework using a single neural-network based model to generate simultaneous point and interval forecasts. Our approach ensures non-crossing prediction intervals (PIs) through a…

Machine Learning · Computer Science 2026-04-21 Worachit Amnuaypongsa , Yotsapat Suparanonrat , Pana Wanitchollakit , Jitkomut Songsiri

Heteroscedastic regression models a Gaussian variable's mean and variance as a function of covariates. Parametric methods that employ neural networks for these parameter maps can capture complex relationships in the data. Yet, optimizing…

Machine Learning · Computer Science 2022-12-20 Andrew Stirn , Hans-Hermann Wessels , Megan Schertzer , Laura Pereira , Neville E. Sanjana , David A. Knowles

Machine learning applications frequently come with multiple diverse objectives and constraints that can change over time. Accordingly, trained models can be tuned with sets of hyper-parameters that affect their predictive behavior (e.g.,…

Machine Learning · Computer Science 2022-10-17 Bracha Laufer-Goldshtein , Adam Fisch , Regina Barzilay , Tommi Jaakkola

Quantification and minimization of uncertainty is an important task in the design of electromagnetic devices, which comes with high computational effort. We propose a hybrid approach combining the reliability and accuracy of a Monte Carlo…

Machine Learning · Computer Science 2022-04-12 Mona Fuhrländer , Sebastian Schöps

Implementing state estimation in low and medium voltage power distribution is still challenging given the scale of many networks and the reliance of traditional methods on a large number of measurements. This paper proposes a method to…

Systems and Control · Computer Science 2019-12-02 Roel Dobbe , Werner van Westering , Stephan Liu , Daniel Arnold , Duncan Callaway , Claire Tomlin

A method is developed for fitting theoretically predicted astronomical spectra to an observed spectrum. Using a hierarchical Bayesian principle, the method takes both systematic and statistical measurement errors into account, which has not…

Astrophysics · Physics 2008-11-26 Z. Shkedy , L. Decin , G. Molenberghs , C. Aerts

Computer models, aiming at simulating a complex real system, are often calibrated in the light of data to improve performance. Standard calibration methods assume that the optimal values of calibration parameters are invariant to the model…

Methodology · Statistics 2017-09-01 Georgios Karagiannis , Bledar A. Konomi , Guang Lin

Multilevel network meta-regression (ML-NMR) enables population-adjusted indirect treatment comparisons by combining individual patient data (IPD) with aggregate data. When individual-level covariates are unavailable, ML-NMR marginalizes…

Methodology · Statistics 2026-03-12 Harlan Campbell , Charles C. Margossian , Jeroen P. Jansen , Paul Gustafson

When analyzing real-world data it is common to work with event ensembles, which comprise sets of observations that collectively constrain the parameters of an underlying model of interest. Such models often have a hierarchical structure,…

Machine Learning · Statistics 2024-02-22 Lukas Heinrich , Siddharth Mishra-Sharma , Chris Pollard , Philipp Windischhofer

Nonparametric empirical Bayes methods provide a flexible and attractive approach to high-dimensional data analysis. One particularly elegant empirical Bayes methodology, involving the Kiefer-Wolfowitz nonparametric maximum likelihood…

Methodology · Statistics 2014-07-11 Lee H. Dicker , Sihai D. Zhao

Machine learning methods usually depend on internal parameters -- so called hyperparameters -- that need to be optimized for best performance. Such optimization poses a burden on machine learning practitioners, requiring expert knowledge,…

Chemical Physics · Physics 2020-04-03 Annika Stuke , Patrick Rinke , Milica Todorović

Accounting for exposure measurement errors has been recognized as a crucial problem in environmental epidemiology for over two decades. Bayesian hierarchical models offer a coherent probabilistic framework for evaluating associations…

Methodology · Statistics 2024-01-17 Changwoo J. Lee , Elaine Symanski , Amal Rammah , Dong Hun Kang , Philip K. Hopke , Eun Sug Park

We classify two types of Hierarchical Bayesian Model found in the literature as Hierarchical Prior Model (HPM) and Hierarchical Stochastic Model (HSM). Then, we focus on studying the theoretical implications of the HSM. Using examples of…

Applications · Statistics 2016-11-10 Stephen Wu , Panagiotis Angelikopoulos , James L. Beck , Petros Koumoutsakos

We develop a maximum likelihood estimating approach for time-to-event Weibull regression models with outcome-dependent sampling, where sampling of subjects is dependent on the residual fraction of the time left to developing the event of…

Applications · Statistics 2014-08-01 Brian D. M. Tom , Vernon T. Farewell , Sheila M. Bird

We develop a generally applicable full-information inference method for heterogeneous agent models, combining aggregate time series data and repeated cross sections of micro data. To handle unobserved aggregate state variables that affect…

Econometrics · Economics 2024-11-19 Laura Liu , Mikkel Plagborg-Møller

We propose a two stage procedure for the estimation of the parameters of a fairly general, continuous-time stochastic volatility. An important ingredient of the proposed method is the Cuchiero-Teichmann volatility estimator, which is based…

Statistics Theory · Mathematics 2018-12-31 Milan Merkle , Yuri F. Saporito , Rodrigo S. Targino