English
Related papers

Related papers: Fast Moment-Based Estimation for Hierarchical Mode…

200 papers

Hierarchical time series are common in several applied fields. The forecasts for these time series are required to be coherent, that is, to satisfy the constraints given by the hierarchy. The most popular technique to enforce coherence is…

Machine Learning · Statistics 2023-10-13 Lorenzo Zambon , Dario Azzimonti , Giorgio Corani

The maximum likelihood estimation is computationally demanding for large datasets, particularly when the likelihood function includes integrals. Subsampling can reduce the computational burden, but it often results in efficiency loss.This…

Methodology · Statistics 2026-04-27 Miaomiao Su , Qihua Wang , Ruoyu Wang

Numerous methods for probabilistic reasoning in large, complex belief or decision networks are currently being developed. There has been little research on automating the dynamic, incremental construction of decision models. A uniform…

Artificial Intelligence · Computer Science 2013-03-08 Soe-Tsyr Yuan

We show how to achieve the notion of "multicalibration" from H\'ebert-Johnson et al. [2018] not just for means, but also for variances and other higher moments. Informally, it means that we can find regression functions which, given a data…

Machine Learning · Computer Science 2020-08-19 Christopher Jung , Changhwa Lee , Mallesh M. Pai , Aaron Roth , Rakesh Vohra

We introduce a framework to dynamically combine heterogeneous models called \texttt{DYCHEM}, which forecasts a set of time series that are related through an aggregation hierarchy. Different types of forecasting models can be employed as…

Machine Learning · Computer Science 2023-01-18 Xing Han , Jing Hu , Joydeep Ghosh

Stochastic processes find applications in modelling systems in a variety of disciplines. A large number of stochastic models considered are Markovian in nature. It is often observed that higher order Markov processes can model the data…

Probability · Mathematics 2021-04-13 Suryadeepto Nag

With recent advances in sequencing technologies, large amounts of epigenomic data have become available and computational methods are contributing significantly to the progress of epigenetic research. As an orthogonal approach to methods…

Genomics · Quantitative Biology 2019-11-05 Alexander Lück , Verena Wolf

Multi-stage decision-making under uncertainty, where decisions are taken under sequentially revealing uncertain problem parameters, is often essential to faithfully model managerial problems. Given the significant computational challenges…

Optimization and Control · Mathematics 2026-04-30 Simon Thomä , Maximilian Schiffer , Wolfram Wiesemann

Linear mixed models with large imbalanced crossed random effects structures pose severe computational problems for maximum likelihood estimation and for Bayesian analysis. The costs can grow as fast as $N^{3/2}$ when there are N…

Methodology · Statistics 2017-05-30 K. Gao , A. B. Owen

Hierarchical forecasting is a key problem in many practical multivariate forecasting applications - the goal is to simultaneously predict a large number of correlated time series that are arranged in a pre-specified aggregation hierarchy.…

Machine Learning · Computer Science 2021-10-13 Biswajit Paria , Rajat Sen , Amr Ahmed , Abhimanyu Das

Items in modern recommender systems are often organized in hierarchical structures. These hierarchical structures and the data within them provide valuable information for building personalized recommendation systems. In this paper, we…

Machine Learning · Computer Science 2019-08-21 Zitao Liu , Zhexuan Xu , Yan Yan

In this paper we study the problem of model reduction by moment matching for stochastic systems. We characterize the mathematical object which generalizes the notion of moment to stochastic differential equations and we find a class of…

Systems and Control · Electrical Eng. & Systems 2021-05-06 Giordano Scarciotti , Andrew R. Teel

It is difficult to use subsampling with variational inference in hierarchical models since the number of local latent variables scales with the dataset. Thus, inference in hierarchical models remains a challenge at large scale. It is…

Machine Learning · Computer Science 2021-11-08 Abhinav Agrawal , Justin Domke

Estimation of the number of species or unobserved classes from a random sample of the underlying population is a ubiquitous problem in statistics. In classical settings, the size of the sample is usually small. New technologies such as…

Methodology · Statistics 2019-03-06 Timothy Daley , Andrew D Smith

Hierarchical time series forecasting plays a crucial role in decision-making in various domains while presenting significant challenges for modelling as they involve multiple levels of aggregation, constraints, and availability of…

Machine Learning · Computer Science 2024-11-12 Zhao Yingjie , Mahdi Abolghasemi

Multiscale is a hallmark feature of complex nonlinear systems. While the simulation using the classical numerical methods is restricted by the local \textit{Taylor} series constraints, the multiscale techniques are often limited by finding…

Dynamical Systems · Mathematics 2024-05-07 Asif Hamid , Danish Rafiq , Shahkar Ahmad Nahvi , Mohammad Abid Bazaz

Finite mixtures of regression models provide a flexible modeling framework for many phenomena. Using moment-based estimation of the regression parameters, we develop unbiased estimators with a minimum of assumptions on the mixture…

Statistics Theory · Mathematics 2019-05-17 Claus Thorn Ekstrøm , Christian Bressen Pipper

Well-calibrated probabilistic regression models are a crucial learning component in robotics applications as datasets grow rapidly and tasks become more complex. Unfortunately, classical regression models are usually either probabilistic…

Machine Learning · Computer Science 2023-09-12 Hany Abdulsamad , Peter Nickl , Pascal Klink , Jan Peters

Inferring parameters of models of biochemical kinetics from single-cell data remains challenging because of the uncertainty arising from the intractability of the likelihood function of stochastic reaction networks. Such uncertainty falls…

Quantitative Methods · Quantitative Biology 2025-01-14 Zekai Li , Mauricio Barahona , Philipp Thomas

We survey a number of moment hierarchies and test their performances in computing one-dimensional shock structures. It is found that for high Mach numbers, the moment hierarchies are either computationally expensive or hard to converge,…

Fluid Dynamics · Physics 2021-08-25 Zhenning Cai