English
Related papers

Related papers: Online Distributional Regression

200 papers

Scalable machine learning over big data is an important problem that is receiving a lot of attention in recent years. On popular distributed environments such as Hadoop running on a cluster of commodity machines, communication costs are…

Machine Learning · Computer Science 2015-03-18 Dhruv Mahajan , Nikunj Agrawal , S. Sathiya Keerthi , S. Sundararajan , Leon Bottou

Decision-makers often have access to machine-learned predictions about future demand that can help guide online resource allocation decisions. However, such predictions may be inaccurate. We develop a framework for online resource…

Data Structures and Algorithms · Computer Science 2026-05-19 Negin Golrezaei , Patrick Jaillet , Zijie Zhou

Offline reinforcement learning (RL) extends the paradigm of classical RL algorithms to purely learning from static datasets, without interacting with the underlying environment during the learning process. A key challenge of offline RL is…

Machine Learning · Computer Science 2022-06-16 Shentao Yang , Yihao Feng , Shujian Zhang , Mingyuan Zhou

Designing online algorithms with machine learning predictions is a recent technique beyond the worst-case paradigm for various practically relevant online problems (scheduling, caching, clustering, ski rental, etc.). While most previous…

Data Structures and Algorithms · Computer Science 2023-12-25 Enikő Kevi , Kim-Thang Nguyen

We consider the task of learning causal structures from data stored on multiple machines, and propose a novel structure learning method called distributed annealing on regularized likelihood score (DARLS) to solve this problem. We model…

Methodology · Statistics 2024-04-30 Qiaoling Ye , Arash A. Amini , Qing Zhou

Online forecasting under a changing environment has been a problem of increasing importance in many real-world applications. In this paper, we consider the meta-algorithm presented in \citet{zhang2017dynamic} combined with different…

Machine Learning · Computer Science 2020-11-16 Anant Raj , Pierre Gaillard , Christophe Saad

Automated Machine Learning (AutoML) has been used successfully in settings where the learning task is assumed to be static. In many real-world scenarios, however, the data distribution will evolve over time, and it is yet to be shown…

Machine Learning · Computer Science 2022-12-08 Bilge Celik , Prabhant Singh , Joaquin Vanschoren

In this paper, we study the problem where a group of agents aim to collaboratively learn a common static latent function through streaming data. We propose a lightweight distributed Gaussian process regression (GPR) algorithm that is…

Machine Learning · Computer Science 2023-07-11 Zhenyuan Yuan , Minghui Zhu

We establish optimal rates for online regression for arbitrary classes of regression functions in terms of the sequential entropy introduced in (Rakhlin, Sridharan, Tewari, 2010). The optimal rates are shown to exhibit a phase transition…

Machine Learning · Statistics 2014-02-12 Alexander Rakhlin , Karthik Sridharan

We introduce a generalized additive model for location, scale, and shape (GAMLSS) next of kin aiming at distribution-free and parsimonious regression modelling for arbitrary outcomes. We replace the strict parametric distribution…

Methodology · Statistics 2023-12-21 Sandra Siegfried , Lucas Kook , Torsten Hothorn

As foundation models grow in size, fine-tuning them becomes increasingly expensive. While GPU spot instances offer a low-cost alternative to on-demand resources, their volatile prices and availability make deadline-aware scheduling…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-25 Linggao Kong , Yuedong Xu , Lei Jiao , Chuan Xu

This paper presents an adaptive online distributed optimal control approach that is applicable to optimal planning for very-large-scale robotics systems in highly uncertain environments. This approach is developed based on the optimal mass…

Multiagent Systems · Computer Science 2020-03-17 Pingping Zhu , Chang Liu , Silvia Ferrari

In this paper, we investigate a distributed learning scheme for a broad class of stochastic optimization problems and games that arise in signal processing and wireless communications. The proposed algorithm relies on the method of matrix…

Information Theory · Computer Science 2017-04-05 Panayotis Mertikopoulos , E. Veronica Belmega , Romain Negrel , Luca Sanguinetti

Motivated by the prevalence and success of machine learning, a line of recent work has studied learning-augmented algorithms in the streaming model. These results have shown that for natural and practical oracles implemented with machine…

Data Structures and Algorithms · Computer Science 2026-03-04 Soham Nagawanshi , Shalini Panthangi , Chen Wang , David P. Woodruff , Samson Zhou

Large-scale sequential data is often exposed to some degree of inhomogeneity in the form of sudden changes in the parameters of the data-generating process. We consider the problem of detecting such structural changes in a high-dimensional…

Methodology · Statistics 2016-01-15 Florencia Leonardi , Peter Bühlmann

Imitation Learning (IL) has achieved remarkable success across various domains, including robotics, autonomous driving, and healthcare, by enabling agents to learn complex behaviors from expert demonstrations. However, existing IL methods…

Machine Learning · Computer Science 2026-01-06 Shangzhe Li , Zhiao Huang , Hao Su

Mixed linear regression (MLR) is a powerful model for characterizing nonlinear relationships by utilizing a mixture of linear regression sub-models. The identification of MLR is a fundamental problem, where most of the existing results…

Machine Learning · Statistics 2023-12-01 Yujing Liu , Zhixin Liu , Lei Guo

In this work we study the problem of using machine-learned predictions to improve the performance of online algorithms. We consider two classical problems, ski rental and non-clairvoyant job scheduling, and obtain new online algorithms that…

Data Structures and Algorithms · Computer Science 2024-07-26 Ravi Kumar , Manish Purohit , Zoya Svitkina

We study the problem of high-dimensional robust mean estimation in an online setting. Specifically, we consider a scenario where $n$ sensors are measuring some common, ongoing phenomenon. At each time step $t=1,2,\ldots,T$, the $i^{th}$…

Machine Learning · Computer Science 2023-10-26 Daniel M. Kane , Ilias Diakonikolas , Hanshen Xiao , Sihan Liu

Decision problems encountered in practice often possess a highly dynamic and uncertain nature. In particular fast changing forecasts for parameters (e.g., photovoltaic generation forecasts in the context of energy management) pose large…

Systems and Control · Electrical Eng. & Systems 2023-11-21 Jens Hönen , Johann L. Hurink , Bert Zwart