English
Related papers

Related papers: Online Inference with Multi-modal Likelihood Funct…

200 papers

This paper studies an online replication problem for distributed data access. The goal is to dynamically create and delete data copies in a multi-server system as time passes to minimize the total storage and network cost of serving access…

Data Structures and Algorithms · Computer Science 2024-04-26 Tianyu Zuo , Xueyan Tang , Bu Sung Lee

In this paper, we revisit the online non-monotone continuous DR-submodular maximization problem over a down-closed convex set, which finds wide real-world applications in the domain of machine learning, economics, and operations research.…

Machine Learning · Computer Science 2022-08-17 Qixin Zhang , Zengde Deng , Zaiyi Chen , Kuangqi Zhou , Haoyuan Hu , Yu Yang

This paper introduces a projected functional gradient descent algorithm (P-FGD) for training nonparametric additive quantile regression models in online settings. This algorithm extends the functional stochastic gradient descent framework…

Machine Learning · Statistics 2026-04-13 Haoran Zhan

Online test-time adaptation (OTTA) of vision-language models (VLMs) has recently garnered increased attention to take advantage of data observed along a stream to improve future predictions. Unfortunately, existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Clément Fuchs , Maxime Zanella , Christophe De Vleeschouwer

We propose an online learning algorithm for a class of machine learning models under a separable stochastic approximation framework. The essence of our idea lies in the observation that certain parameters in the models are easier to…

Machine Learning · Computer Science 2023-05-23 Min Gan , Xiang-xiang Su , Guang-yong Chen , Jing Chen

Online changepoint detection algorithms that are based on likelihood-ratio tests have been shown to have excellent statistical properties. However, a simple online implementation is computationally infeasible as, at time $T$, it involves…

Computation · Statistics 2023-02-10 Kes Ward , Gaetano Romano , Idris Eckley , Paul Fearnhead

We present a novel algorithm for anomaly detection on very large datasets and data streams. The method, named EXPected Similarity Estimation (EXPoSE), is kernel-based and able to efficiently compute the similarity between new data points…

Machine Learning · Computer Science 2016-06-07 Markus Schneider , Wolfgang Ertel , Fabio Ramos

We consider the robust linear regression problem in the online setting where we have access to the data in a streaming manner, one data point after the other. More specifically, for a true parameter $\theta^*$, we consider the corrupted…

Machine Learning · Computer Science 2020-07-02 Scott Pesme , Nicolas Flammarion

This paper presents a method for jointly estimating the state, input, and parameters of linear systems in an online fashion. The method is specially designed for measurements that are corrupted with non-Gaussian noise or outliers, which are…

Systems and Control · Electrical Eng. & Systems 2022-04-13 Jean-Sébastien Brouillon , Keith Moffat , Florian Dörfler , Giancarlo Ferrari-Trecate

We introduce an online outlier detection algorithm to detect outliers in a sequentially observed data stream. For this purpose, we use a two-stage filtering and hedging approach. In the first stage, we construct a multi-modal probability…

Machine Learning · Computer Science 2018-03-13 Mohammadreza Mohaghegh Neyshabouri , Suleyman Serdar Kozat

A sequence of works in unconstrained online convex optimisation have investigated the possibility of adapting simultaneously to the norm $U$ of the comparator and the maximum norm $G$ of the gradients. In full generality, matching upper and…

Machine Learning · Computer Science 2022-06-16 Jack J. Mayo , Hédi Hadiji , Tim van Erven

Large tensor learning algorithms are typically computationally expensive and require storing a vast amount of data. In this paper, we propose a unified online Riemannian gradient descent (oRGrad) algorithm for tensor learning, which is…

Machine Learning · Statistics 2024-10-23 Jingyang Li , Jian-Feng Cai , Yang Chen , Dong Xia

Analytical models developed in offline settings with pre-prepared data are typically used to predict students' performance. However, when data are available over time, this learning method is not suitable anymore. Online learning is…

Computers and Society · Computer Science 2024-07-16 Chahrazed Labba , Anne Boyer

We study online multicalibration beyond the worst-case. We give a single, efficient algorithm which dynamically interpolates between benign and worst-case sequences by adaptively refining a dyadic grid of prediction values. Its error is…

Machine Learning · Computer Science 2026-05-22 Zhiming Huang , Jamie Morgenstern , Aaron Roth , Claire Jie Zhang

We introduce a framework to accelerate the convergence of gradient-based methods with online learning. The framework learns to scale the gradient at each iteration through an online learning algorithm and provably accelerates gradient-based…

Optimization and Control · Mathematics 2024-11-07 Wenzhi Gao , Ya-Chi Chu , Yinyu Ye , Madeleine Udell

We propose a new model for augmenting algorithms with predictions by requiring that they are formally learnable and instance robust. Learnability ensures that predictions can be efficiently constructed from a reasonable amount of past data.…

Machine Learning · Computer Science 2021-07-05 Thomas Lavastida , Benjamin Moseley , R. Ravi , Chenyang Xu

Online-learning literature has focused on designing algorithms that ensure sub-linear growth of the cumulative long-term constraint violations. The drawback of this guarantee is that strictly feasible actions may cancel out constraint…

Optimization and Control · Mathematics 2019-10-22 Ezra Tampubolon , Holger Boche

Likelihood-free Bayesian inference algorithms are popular methods for calibrating the parameters of complex, stochastic models, required when the likelihood of the observed data is intractable. These algorithms characteristically rely…

Computation · Statistics 2021-12-23 Thomas P Prescott , David J Warne , Ruth E Baker

A standard way to obtain convergence guarantees in stochastic convex optimization is to run an online learning algorithm and then output the average of its iterates: the actual iterates of the online learning algorithm do not come with…

Machine Learning · Statistics 2019-03-05 Ashok Cutkosky

We introduce a semiparametric latent space model for analyzing longitudinal network data. The model consists of a static latent space component and a time-varying node-specific baseline component. We develop a semiparametric efficient score…

Statistics Theory · Mathematics 2025-02-14 Yinqiu He , Jiajin Sun , Yuang Tian , Zhiliang Ying , Yang Feng