English
Related papers

Related papers: No-Regret Forecasting with Egalitarian Committees

200 papers

High-dimensional data subject to heavy-tailed phenomena and heterogeneity are commonly encountered in various scientific fields and bring new challenges to the classical statistical methods. In this paper, we combine the asymmetric square…

Statistics Theory · Mathematics 2019-10-02 Jun Zhao , Guan'ao Yan , Yi Zhang

Bayesian experts who are exposed to different evidence often make contradictory probabilistic forecasts. An aggregator, ignorant of the underlying model, uses this to calculate her own forecast. We use the notions of scoring rules and…

Economics · Quantitative Finance 2018-02-13 Itai Areili , Yakov Babichenko , Rann Smorodinsky

Aggregating estimators using exponential weights depending on their risk appears optimal in expectation but not in probability. We use here a slight overpenalization to obtain oracle inequality in probability for such an explicit…

Statistics Theory · Mathematics 2018-02-01 Lucie Montuelle , Erwan Le Pennec

This paper proposes the asymmetric linear double autoregression, which jointly models the conditional mean and conditional heteroscedasticity characterized by asymmetric effects. A sufficient condition is established for the existence of a…

Methodology · Statistics 2021-04-22 Songhua Tan , Qianqian Zhu

Making use of predictions is a crucial, but under-explored, area of online algorithms. This paper studies a class of online optimization problems where we have external noisy predictions available. We propose a stochastic prediction error…

Machine Learning · Computer Science 2015-04-28 Niangjun Chen , Anish Agarwal , Adam Wierman , Siddharth Barman , Lachlan L. H. Andrew

The solution of linear systems of equations is a very frequent operation and thus important in many fields. The complexity using classical methods increases linearly with the size of equations. The HHL algorithm proposed by Harrow et al.…

Quantum Physics · Physics 2022-06-14 Fang Gao , Guojian Wu , Mingyu Yang , Wei Cui , Feng Shuang

Recent advances in machine learning make it possible to design efficient prediction algorithms for data sets with huge numbers of parameters. This paper describes a new technique for "hedging" the predictions output by many such algorithms,…

Machine Learning · Computer Science 2011-11-22 Alexander Gammerman , Vladimir Vovk

Machine learning is about forecasting. When the forecasts come with an evaluation metric the forecasts become useful. What are reasonable evaluation metrics? How do existing evaluation metrics relate? In this work, we provide a general…

Machine Learning · Computer Science 2025-07-08 Rabanus Derr , Robert C. Williamson

Methods for forecasting time series adhering to linear constraints have seen notable development in recent years, especially with the advent of forecast reconciliation. This paper extends forecast reconciliation to the open question of…

Methodology · Statistics 2025-10-27 Daniele Girolimetto , Anastasios Panagiotelis , Tommaso Di Fonzo , Han Li

Classifying subsets based on spatial and temporal features is crucial to the analysis of spatiotemporal data given the inherent spatial and temporal variability. Since no single clustering algorithm ensures optimal results, researchers have…

Machine Learning · Computer Science 2024-09-20 Francis Ndikum Nji , Omar Faruque , Mostafa Cham , Janeja Vandana , Jianwu Wang

In this article, we introduce a kernel-based consensual aggregation method for regression problems. We aim to flexibly combine individual regression estimators $r_1, r_2, \ldots, r_M$ using a weighted average where the weights are defined…

Methodology · Statistics 2021-04-29 Sothea Has

Long range forecasts are the starting point of many decision support systems that need to draw inference from high-level aggregate patterns on forecasted values. State of the art time-series forecasting methods are either subject to concept…

Machine Learning · Computer Science 2022-05-27 Prathamesh Deshpande , Sunita Sarawagi

Collaboration between different data centers is often challenged by heterogeneity across sites. To account for the heterogeneity, the state-of-the-art method is to re-weight the covariate distributions in each site to match the distribution…

Machine Learning · Statistics 2024-04-25 Tianyu Guo , Sai Praneeth Karimireddy , Michael I. Jordan

The emergence of big data has caused a dramatic shift in the operating regime for optimization algorithms. The performance bottleneck, which used to be computations, is now often communications. Several gradient compression techniques have…

Signal Processing · Electrical Eng. & Systems 2020-06-19 Sarit Khirirat , Sindri Magnússon , Mikael Johansson

Ensembling is commonly regarded as an effective way to improve the general performance of models in machine learning, while also increasing the robustness of predictions. When it comes to algorithmic fairness, heterogeneous ensembles,…

Machine Learning · Computer Science 2025-01-27 Estanislao Claucich , Sara Hooker , Diego H. Milone , Enzo Ferrante , Rodrigo Echeveste

We study a novel heterogeneous multi-agent multi-armed bandit problem with a cluster structure induced by stochastic block models, influencing not only graph topology, but also reward heterogeneity. Specifically, agents are distributed on…

Machine Learning · Computer Science 2025-02-13 Mengfan Xu , Liren Shan , Fatemeh Ghaffari , Xuchuang Wang , Xutong Liu , Mohammad Hajiesmaili

Ensemble techniques have demonstrated remarkable success in improving predictive performance across various domains by aggregating predictions from multiple models [1]. In the realm of recommender systems, this research explores the…

Information Retrieval · Computer Science 2024-07-09 Zainil Mehta , Tobias Vente

We consider the problem of collaborative bearing estimation using a method with historic roots in set theoretic estimation techniques. We refer to this method as the Convex Combination Ellipsoid (CCE) method and show that it provides a less…

Information Theory · Computer Science 2023-04-18 Mohammad Zamani , Jochen Trumpf , Chris Manzie

Augmenting algorithms with learned predictions is a promising approach for going beyond worst-case bounds. Dinitz, Im, Lavastida, Moseley, and Vassilvitskii~(2021) have demonstrated that a warm start with learned dual solutions can improve…

Machine Learning · Computer Science 2022-05-23 Shinsaku Sakaue , Taihei Oki

Mixtures of probabilistic principal component analysis (MPPCA) is a well-known mixture model extension of principal component analysis (PCA). Similar to PCA, MPPCA assumes the data samples in each mixture contain homoscedastic noise.…

Methodology · Statistics 2023-01-27 Alec S. Xu , Laura Balzano , Jeffrey A. Fessler