English
Related papers

Related papers: An Adaptive Algorithm for Learning with Unknown Di…

200 papers

Deploying robust machine learning models has to account for concept drifts arising due to the dynamically changing and non-stationary nature of data. Addressing drifts is particularly imperative in the security domain due to the…

Cryptography and Security · Computer Science 2022-06-16 Aditya Kuppa , Nhien-An Le-Khac

We study nonparametric density estimation in non-stationary drift settings. Given a sequence of independent samples taken from a distribution that gradually changes in time, the goal is to compute the best estimate for the current…

Machine Learning · Computer Science 2023-10-31 Alessio Mazzetto , Eli Upfal

Neural networks are traditionally trained under the assumption that data come from a stationary distribution. However, settings which violate this assumption are becoming more popular; examples include supervised learning under…

Machine Learning · Computer Science 2024-11-11 Alexandre Galashov , Michalis K. Titsias , András György , Clare Lyle , Razvan Pascanu , Yee Whye Teh , Maneesh Sahani

Concept drift refers to a change in the data distribution affecting the data stream of future samples. Consequently, learning models operating on the data stream might become obsolete, and need costly and difficult adjustments such as…

Machine Learning · Computer Science 2023-09-20 André Artelt , Kleanthis Malialis , Christos Panayiotou , Marios Polycarpou , Barbara Hammer

Concept drift describes unforeseeable changes in the underlying distribution of streaming data over time. Concept drift research involves the development of methodologies and techniques for drift detection, understanding and adaptation.…

Machine Learning · Computer Science 2020-04-14 Jie Lu , Anjin Liu , Fan Dong , Feng Gu , Joao Gama , Guangquan Zhang

Classical machine learning algorithms often assume that the data are drawn i.i.d. from a stationary probability distribution. Recently, continual learning emerged as a rapidly growing area of machine learning where this assumption is…

Machine Learning · Computer Science 2022-07-12 Timothée Lesort , Massimo Caccia , Irina Rish

We present a new algorithm for domain adaptation improving upon a discrepancy minimization algorithm previously shown to outperform a number of algorithms for this task. Unlike many previous algorithms for domain adaptation, our algorithm…

Machine Learning · Computer Science 2015-02-24 Corinna Cortes , Mehryar Mohri , Andres Muñoz Medina

A novel approach is suggested for improving the accuracy of fault detection in distribution networks. This technique combines adaptive probability learning and waveform decomposition to optimize the similarity of features. Its objective is…

Signal Processing · Electrical Eng. & Systems 2023-10-03 Xinliang Ma , Weihua Liu , Bingying Jin

Recently there has been much work on selective sampling, an online active learning setting, in which algorithms work in rounds. On each round an algorithm receives an input and makes a prediction. Then, it can decide whether to query a…

Machine Learning · Computer Science 2014-02-18 Edward Moroshko , Koby Crammer

We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity. We derive a new Bayesian online inference approach to simultaneously infer these distribution shifts…

Machine Learning · Statistics 2021-10-28 Aodong Li , Alex Boyd , Padhraic Smyth , Stephan Mandt

The goal of a learner, in standard online learning, is to have the cumulative loss not much larger compared with the best-performing function from some fixed class. Numerous algorithms were shown to have this gap arbitrarily close to zero,…

Machine Learning · Computer Science 2013-03-04 Nina Vaits , Edward Moroshko , Koby Crammer

Machine learning systems must adapt to data distributions that evolve over time, in applications ranging from sensor networks and self-driving car perception modules to brain-machine interfaces. We consider gradual domain adaptation, where…

Machine Learning · Computer Science 2020-02-27 Ananya Kumar , Tengyu Ma , Percy Liang

We study the problem of learning in the presence of a drifting target concept. Specifically, we provide bounds on the error rate at a given time, given a learner with access to a history of independent samples labeled according to a target…

Machine Learning · Computer Science 2015-05-21 Steve Hanneke , Varun Kanade , Liu Yang

Recently, many studies have shed light on the high adaptivity of deep neural network methods in nonparametric regression models, and their superior performance has been established for various function classes. Motivated by this…

Statistics Theory · Mathematics 2023-07-04 Akihiro Oga , Yuta Koike

The notion of concept drift refers to the phenomenon that the distribution, which is underlying the observed data, changes over time. We are interested in an identification of those features, that are most relevant for the observed drift.…

Machine Learning · Computer Science 2020-12-02 Fabian Hinder , Jonathan Jakob , Barbara Hammer

Adapting to concept drift is a challenging task in machine learning, which is usually tackled using incremental learning techniques that periodically re-fit a learning model leveraging newly available data. A primary limitation of these…

We introduce a novel paradigm for learning non-parametric drift and diffusion functions for stochastic differential equation (SDE). The proposed model learns to simulate path distributions that match observations with non-uniform time…

Machine Learning · Statistics 2018-08-01 Cagatay Yildiz , Markus Heinonen , Jukka Intosalmi , Henrik Mannerström , Harri Lähdesmäki

Adaptive gradient methods have achieved remarkable success in training deep neural networks on a wide variety of tasks. However, not much is known about the mathematical and statistical properties of this family of methods. This work aims…

Machine Learning · Computer Science 2021-05-18 Zhang Zhiyi , Liu Ziyin

A fundamental assumption of most machine learning algorithms is that the training and test data are drawn from the same underlying distribution. However, this assumption is violated in almost all practical applications: machine learning…

Machine Learning · Computer Science 2021-12-02 Marvin Zhang , Henrik Marklund , Nikita Dhawan , Abhishek Gupta , Sergey Levine , Chelsea Finn

In Federated Learning (FL), a number of clients or devices collaborate to train a model without sharing their data. Models are optimized locally at each client and further communicated to a central hub for aggregation. While FL is an…

Machine Learning · Computer Science 2023-07-25 Farshid Varno , Marzie Saghayi , Laya Rafiee Sevyeri , Sharut Gupta , Stan Matwin , Mohammad Havaei