English
Related papers

Related papers: OLR-WA Online Regression with Weighted Average

200 papers

We consider a natural semi-online model for weighted paging, where at any time the algorithm is given predictions, possibly with errors, about the next arrival of each page. The model is inspired by Belady's classic optimal offline…

Data Structures and Algorithms · Computer Science 2021-11-10 Nikhil Bansal , Christian Coester , Ravi Kumar , Manish Purohit , Erik Vee

Personalized medicine has received increasing attention among statisticians, computer scientists, and clinical practitioners. A major component of personalized medicine is the estimation of individualized treatment rules (ITRs). Recently,…

Methodology · Statistics 2015-08-14 Xin Zhou , Nicole Mayer-Hamblett , Umer Khan , Michael R. Kosorok

Recurrent Neural Networks (RNN) are a type of statistical model designed to handle sequential data. The model reads a sequence one symbol at a time. Each symbol is processed based on information collected from the previous symbols. With…

Machine Learning · Statistics 2019-02-18 Jared Ostmeyer , Lindsay Cowell

In federated learning, differences in the data or objectives between the participating nodes motivate approaches to train a personalized machine learning model for each node. One such approach is weighted averaging between a locally trained…

Machine Learning · Computer Science 2021-10-26 Felix Grimberg , Mary-Anne Hartley , Sai P. Karimireddy , Martin Jaggi

Mixed linear regression (MLR) is a powerful model for characterizing nonlinear relationships by utilizing a mixture of linear regression sub-models. The identification of MLR is a fundamental problem, where most of the existing results…

Machine Learning · Statistics 2023-12-01 Yujing Liu , Zhixin Liu , Lei Guo

This paper introduces a new data analysis method for big data using a newly defined regression model named multiple model linear regression(MMLR), which separates input datasets into subsets and construct local linear regression models of…

Machine Learning · Computer Science 2023-08-25 Bohan Lyu , Jianzhong Li

The challenge of Out-of-Distribution (OOD) generalization poses a foundational concern for the application of machine learning algorithms to risk-sensitive areas. Inspired by traditional importance weighting and propensity weighting…

Machine Learning · Computer Science 2025-02-12 Han Yu , Yue He , Renzhe Xu , Dongbai Li , Jiayin Zhang , Wenchao Zou , Peng Cui

In Online Continual Learning (OCL) a learning system receives a stream of data and sequentially performs prediction and training steps. Important challenges in OCL are concerned with automatic adaptation to the particular non-stationary…

Machine Learning · Computer Science 2024-11-11 Michalis K. Titsias , Alexandre Galashov , Amal Rannen-Triki , Razvan Pascanu , Yee Whye Teh , Jorg Bornschein

Transfer learning is an emerging paradigm for leveraging multiple sources to improve the statistical inference on a single target. In this paper, we propose a novel approach named residual importance weighted transfer learning (RIW-TL) for…

Methodology · Statistics 2024-01-04 Junlong Zhao , Shengbin Zheng , Chenlei Leng

Modern decision-making systems, from robots to web recommendation engines, are expected to adapt: to user preferences, changing circumstances or even new tasks. Yet, it is still uncommon to deploy a dynamically learning agent (rather than a…

Machine Learning · Computer Science 2022-11-15 Shengpu Tang , Felipe Vieira Frujeri , Dipendra Misra , Alex Lamb , John Langford , Paul Mineiro , Sebastian Kochman

Link adaptation (LA) is an essential function in modern wireless communication systems that dynamically adjusts the transmission rate of a communication link to match time- and frequency-varying radio link conditions. However, factors such…

Machine Learning · Computer Science 2024-12-02 Samuele Peri , Alessio Russo , Gabor Fodor , Pablo Soldati

The emerging field of learning-augmented online algorithms uses ML techniques to predict future input parameters and thereby improve the performance of online algorithms. Since these parameters are, in general, real-valued functions, a…

Machine Learning · Computer Science 2022-05-26 Keerti Anand , Rong Ge , Amit Kumar , Debmalya Panigrahi

We study distributed training of deep learning models in time-constrained environments. We propose a new algorithm that periodically pulls workers towards the center variable computed as a weighted average of workers, where the weights are…

Machine Learning · Computer Science 2024-03-08 Tolga Dimlioglu , Anna Choromanska

Sample efficiency and performance in the offline setting have emerged as significant challenges of deep reinforcement learning. We introduce Q-Value Weighted Regression (QWR), a simple RL algorithm that excels in these aspects. QWR is an…

Machine Learning · Computer Science 2021-02-16 Piotr Kozakowski , Łukasz Kaiser , Henryk Michalewski , Afroz Mohiuddin , Katarzyna Kańska

In this work, we tackle the problem of online adaptation for stereo depth estimation, that consists in continuously adapting a deep network to a target video recordedin an environment different from that of the source training set. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Zhenyu Zhang , Stéphane Lathuilière , Andrea Pilzer , Nicu Sebe , Elisa Ricci , Jian Yang

Most of current anomaly detection models assume that the normal pattern remains same all the time. However, the normal patterns of Web services change dramatically and frequently. The model trained on old-distribution data is outdated after…

Machine Learning · Computer Science 2024-02-26 Feiyi Chen , Zhen Qin , Yingying Zhang , Shuiguang Deng , Yi Xiao , Guansong Pang , Qingsong Wen

In this paper, we consider a deterministic online linear regression model where we allow the responses to be multivariate. To address this problem, we introduce MultiVAW, a method that extends the well-known Vovk-Azoury-Warmuth algorithm to…

Machine Learning · Statistics 2024-02-23 Massil Hihat , Guillaume Garrigos , Adeline Fermanian , Simon Bussy

In different fields of applications including, but not limited to, behavioral, environmental, medical sciences and econometrics, the use of panel data regression models has become increasingly popular as a general framework for making…

Methodology · Statistics 2020-05-15 Beste Hamiye Beyaztas , Soutir Bandyopadhyay

Online nonparametric estimators are gaining popularity due to their efficient computation and competitive generalization abilities. An important example includes variants of stochastic gradient descent. These algorithms often take one…

Statistics Theory · Mathematics 2025-07-08 Tianyu Zhang , Jing Lei

With the increasing volume of data in the world, the best approach for learning from this data is to exploit an online learning algorithm. Online ensemble methods are online algorithms which take advantage of an ensemble of classifiers to…

Machine Learning · Statistics 2015-02-03 Mohammadzaman Zamani , Hamid Beigy , Amirreza Shaban