English
Related papers

Related papers: TRACE: A Generalizable Drift Detector for Streamin…

200 papers

Practical applications of artificial intelligence increasingly often have to deal with the streaming properties of real data, which, considering the time factor, are subject to phenomena such as periodicity and more or less chaotic…

Machine Learning · Computer Science 2025-03-05 Joanna Komorniczak , Paweł Ksieniewicz

Machine learning-based intrusion detection systems deployed in real-world environments frequently suffer from model degradation due to concept drift, where changes in traffic patterns invalidate training assumptions. To address this, we…

Cryptography and Security · Computer Science 2026-05-05 Seth Barrett , Lin Li , Gokila Dorai , Swarnamugi Rajaganapathy

Classical optimization theory deals with fixed, time-invariant objective functions. However, time-varying optimization has emerged as an important subject for decision-making in dynamic environments. In this work, we study the problem of…

Machine Learning · Computer Science 2025-10-16 Muhammad Faraz Ul Abrar , Nicolò Michelusi , Erik G. Larsson

With the rapid growth of traffic sensors deployed, a massive amount of traffic flow data are collected, revealing the long-term evolution of traffic flows and the gradual expansion of traffic networks. How to accurately forecasting these…

Machine Learning · Computer Science 2021-06-14 Xu Chen , Junshan Wang , Kunqing Xie

A fundamental issue for statistical classification models in a streaming environment is that the joint distribution between predictor and response variables changes over time (a phenomenon also known as concept drifts), such that their…

Machine Learning · Statistics 2019-02-11 Shujian Yu , Zubin Abraham , Heng Wang , Mohak Shah , Yantao Wei , José C. Príncipe

Learning from data streams is an increasingly important topic in data mining, machine learning, and artificial intelligence in general. A major focus in the data stream literature is on designing methods that can deal with concept drift, a…

Machine Learning · Computer Science 2018-10-05 Jesse Read

The transition from monolithic architecture to microservices has enhanced flexibility in application design and its scalable execution. This approach typically uses a computing cluster managed by a container orchestration platform to deploy…

Networking and Internet Architecture · Computer Science 2025-12-02 Ming Chen , Muhammed Tawfiqul Islam , Maria Rodriguez Read , Rajkumar Buyya

Modern technological advances have expanded the scope of applications requiring analysis of large-scale datastreams that comprise multiple indefinitely long time series. There is an acute need for statistical methodologies that perform…

Methodology · Statistics 2021-11-03 Jingshen Wang , Lilun Du , Changliang Zou , Zhenke Wu

Real-world production systems often grapple with maintaining data quality in large-scale, dynamic streams. We introduce Drifter, an efficient and lightweight system for online feature monitoring and verification in recommendation use cases.…

Information Retrieval · Computer Science 2023-09-22 Blaž Škrlj , Nir Ki-Tov , Lee Edelist , Natalia Silberstein , Hila Weisman-Zohar , Blaž Mramor , Davorin Kopič , Naama Ziporin

Modern analytical systems must be ready to process streaming data and correctly respond to data distribution changes. The phenomenon of changes in data distributions is called concept drift, and it may harm the quality of the used models.…

Machine Learning · Computer Science 2021-10-26 Jędrzej Kozal , Filip Guzy , Michał Woźniak

In recent years, with the rapid development of sensing technology and the Internet of Things (IoT), sensors play increasingly important roles in traffic control, medical monitoring, industrial production and etc. They generated high volume…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-11 Hang Zhao , Jie Tang

We present S+t-SNE, an adaptation of the t-SNE algorithm designed to handle infinite data streams. The core idea behind S+t-SNE is to update the t-SNE embedding incrementally as new data arrives, ensuring scalability and adaptability to…

Artificial Intelligence · Computer Science 2025-01-22 Pedro C. Vieira , João P. Montrezol , João T. Vieira , João Gama

In many real-world applications, continuous machine learning (ML) systems are crucial but prone to data drift, a phenomenon where discrepancies between historical training data and future test data lead to significant performance…

Machine Learning · Computer Science 2024-11-26 Vennela Yarabolu , Govind Waghmare , Sonia Gupta , Siddhartha Asthana

Intelligent, large-scale IoT ecosystems have become possible due to recent advancements in sensing technologies, distributed learning, and low-power inference in embedded devices. In traditional cloud-centric approaches, raw data is…

Machine Learning · Computer Science 2023-05-16 Theo Chow , Usman Raza , Ioannis Mavromatis , Aftab Khan

Real-time object detection is critical for the decision-making process for many real-world applications, such as collision avoidance and path planning in autonomous driving. This work presents an innovative real-time streaming perception…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Xiang Zhang , Yufei Cui , Chenchen Fu , Weiwei Wu , Zihao Wang , Yuyang Sun , Xue Liu

One of the significant problems of streaming data classification is the occurrence of concept drift, consisting of the change of probabilistic characteristics of the classification task. This phenomenon destabilizes the performance of the…

Machine Learning · Computer Science 2021-12-21 Michał Woźniak , Paweł Zyblewski , Paweł Ksieniewicz

Concept drift refers to the change of data distributions over time. While drift poses a challenge for learning models, requiring their continual adaption, it is also relevant in system monitoring to detect malfunctions, system failures, and…

Machine Learning · Computer Science 2025-02-07 Fabian Hinder , Valerie Vaquet , Barbara Hammer

Clinical decision support tools built on electronic health records often experience performance drift due to temporal population shifts, particularly when changes in the clinical environment initially affect only a subset of patients,…

Machine Learning · Computer Science 2025-12-16 Mengying Yan , Ziye Tian , Siqi Li , Nan Liu , Benjamin A. Goldstein , Molei Liu , Chuan Hong

In many real-world scenarios, distribution shifts exist in the streaming data across time steps. Many complex sequential data can be effectively divided into distinct regimes that exhibit persistent dynamics. Discovering the shifted…

Machine Learning · Computer Science 2023-09-07 Weijieying Ren , Tianxiang Zhao , Wei Qin , Kunpeng Liu

We introduce ForeSight, a novel joint detection and forecasting framework for vision-based 3D perception in autonomous vehicles. Traditional approaches treat detection and forecasting as separate sequential tasks, limiting their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Sandro Papais , Letian Wang , Brian Cheong , Steven L. Waslander