中文
相关论文

相关论文: Probabilistic Forecast Reconciliation with Kullbac…

200 篇论文

We propose a new method for optimistic planning in infinite-horizon discounted Markov decision processes based on the idea of adding regularization to the updates of an otherwise standard approximate value iteration procedure. This…

机器学习 · 计算机科学 2023-06-16 Antoine Moulin , Gergely Neu

Generative models frequently suffer miscalibration, wherein statistics of the sampling distribution, such as the fraction of generations in a given class, deviate from desired values. We frame calibration as a constrained optimization…

机器学习 · 统计学 2026-05-29 Henry D. Smith , Nathaniel L. Diamant , Brian L. Trippe

Aggregation constraints, arising from geographical or sectoral division, frequently emerge in a large set of time series. Coherent forecasts of these constrained series are anticipated to conform to their hierarchical structure organized by…

应用统计 · 统计学 2026-02-27 Zhichao Wang , Shanshan Wang , Wei Cao , Fei Yang

In this article we study the problem of recovering the unknown solution of a linear ill-posed problem, via iterative regularization methods. We review the problem of projection-regularization from a statistical point of view. A basic…

统计理论 · 数学 2007-06-13 Ana K. Fermin , Carenne Ludena

Recent Reinforcement Learning (RL) algorithms making use of Kullback-Leibler (KL) regularization as a core component have shown outstanding performance. Yet, only little is understood theoretically about why KL regularization helps, so far.…

机器学习 · 计算机科学 2021-01-07 Nino Vieillard , Tadashi Kozuno , Bruno Scherrer , Olivier Pietquin , Rémi Munos , Matthieu Geist

We present a novel approach for reconciling hierarchical forecasts, based on Bayes rule. We define a prior distribution for the bottom time series of the hierarchy, based on the bottom base forecasts. Then we update their distribution via…

应用统计 · 统计学 2021-06-07 Giorgio Corani , Dario Azzimonti , João P. S. C. Augusto , Marco Zaffalon

Computer models are used to model complex processes in various disciplines. Often, a key source of uncertainty in the behavior of complex computer models is uncertainty due to unknown model input parameters. Statistical computer model…

统计方法学 · 统计学 2013-08-02 Won Chang , Murali Haran , Roman Olson , Klaus Keller

In recent years, functional linear models have attracted growing attention in statistics and machine learning, with the aim of recovering the slope function or its functional predictor. This paper considers online regularized learning…

机器学习 · 统计学 2022-11-28 Yuan Mao , Zheng-Chu Guo

We examine the problem of making reconciled forecasts of large collections of related time series through a behavioural/Bayesian lens. Our approach explicitly acknowledges and exploits the 'connectedness' of the series in terms of…

统计方法学 · 统计学 2022-10-03 Ross Hollyman , Fotios Petropoulos , Michael E. Tipping

Checklists have been widely recognized as effective tools for completing complex tasks in a systematic manner. Although originally intended for use in procedural tasks, their interpretability and ease of use have led to their adoption for…

机器学习 · 计算机科学 2024-11-27 Yukti Makhija , Edward De Brouwer , Rahul G. Krishnan

A theoretical framework for non-negative matrix factorization based on generalized dual Kullback-Leibler divergence, which includes members of the exponential family of models, is proposed. A family of algorithms is developed using this…

机器学习 · 统计学 2019-05-20 Karthik Devarajan

Predicting not only the target but also an accurate measure of uncertainty is important for many machine learning applications and in particular safety-critical ones. In this work we study the calibration of uncertainty prediction for…

机器学习 · 计算机科学 2020-02-04 Dan Levi , Liran Gispan , Niv Giladi , Ethan Fetaya

In this paper, we study the statistical and geometrical properties of the Kullback-Leibler divergence with kernel covariance operators (KKL) introduced by Bach [2022]. Unlike the classical Kullback-Leibler (KL) divergence that involves…

机器学习 · 统计学 2025-03-12 Clémentine Chazal , Anna Korba , Francis Bach

When sampling multi-modal probability distributions, correctly estimating the relative probability of each mode, even when the modes have been discovered and locally sampled, remains challenging. We test a simple reweighting scheme designed…

统计理论 · 数学 2026-02-17 Pierre Monmarché

The adoption of deep learning across various fields has been extensive, yet there is a lack of focus on evaluating the performance of deep learning pipelines. Typically, with the increased use of large datasets and complex models, the…

机器学习 · 计算机科学 2024-05-21 Yewen Fan , Nian Si , Xiangchen Song , Kun Zhang

New methods are proposed for adjusting probabilistic forecasts to ensure coherence with the aggregation constraints inherent in temporal hierarchies. The different approaches nested within this framework include methods that exploit…

统计方法学 · 统计学 2020-08-18 Jooyoung Jeon , Anastasios Panagiotelis , Fotios Petropoulos

This paper considers the distributionally robust chance constrained Markov decision process with random reward and ambiguous reward distribution. We consider individual and joint chance constraint cases with Kullback-Leibler divergence…

最优化与控制 · 数学 2023-08-01 Tian Xia , Jia Liu , Abdel Lisser

This paper studies theoretically and empirically a method of turning machine-learning algorithms into probabilistic predictors that automatically enjoys a property of validity (perfect calibration) and is computationally efficient. The…

机器学习 · 计算机科学 2015-11-16 Vladimir Vovk , Ivan Petej , Valentina Fedorova

In this paper, we propose a probabilistic optimization method, named probabilistic incremental proximal gradient (PIPG) method, by developing a probabilistic interpretation of the incremental proximal gradient algorithm. We explicitly model…

最优化与控制 · 数学 2019-06-20 Ömer Deniz Akyildiz , Émilie Chouzenoux , Víctor Elvira , Joaquín Míguez

Robust regression has attracted a great amount of attention in the literature recently, particularly for taking asymmetricity into account simultaneously and for high-dimensional analysis. However, the majority of research on the topics…

统计方法学 · 统计学 2023-07-25 Sanna Soomro , Keming Yu , Yan Yu