English
Related papers

Related papers: Dynamic statistical inference in massive datastrea…

200 papers

In this paper we develop an online statistical inference approach for high-dimensional generalized linear models with streaming data for real-time estimation and inference. We propose an online debiased lasso (ODL) method to accommodate the…

Statistics Theory · Mathematics 2021-08-11 Lan Luo , Ruijian Han , Yuanyuan Lin , Jian Huang

Attackers have developed ever more sophisticated and intelligent ways to hack information and communication technology systems. The extent of damage an individual hacker can carry out upon infiltrating a system is well understood. A…

Cryptography and Security · Computer Science 2018-08-20 Cosimo Ieracitano , Ahsan Adeel , Mandar Gogate , Kia Dashtipour , Francesco Carlo Morabito , Hadi Larijani , Ali Raza , Amir Hussain

Anomaly detection in complex, high-dimensional data, such as UAV sensor readings, is essential for operational safety but challenging for existing methods due to their limited sensitivity, scalability, and inability to capture intricate…

Machine Learning · Computer Science 2025-10-28 Mingze Gong , Juan Du , Jianbang You

Mathematical modeling is an essential step, for example, to analyze the transient behavior of a dynamical process and to perform engineering studies such as optimization and control. With the help of first-principles and expert knowledge, a…

Machine Learning · Computer Science 2021-03-30 Pawan Goyal , Peter Benner

Frequency estimation of elements is an important task for summarizing data streams and machine learning applications. The problem is often addressed by using streaming algorithms with sublinear space data structures. These algorithms allow…

Data Structures and Algorithms · Computer Science 2022-04-05 Nikita Seleznev , Senthil Kumar , C. Bayan Bruss

Large volume of networked streaming event data are becoming increasingly available in a wide variety of applications, such as social network analysis, Internet traffic monitoring and healthcare analytics. Streaming event data are discrete…

Machine Learning · Computer Science 2016-09-20 Shuang Li , Yao Xie , Mehrdad Farajtabar , Apurv Verma , Le Song

Inferring the evolution of high-dimensional and multi-modal (e.g., spatio-temporal) physical fields from irregular sparse measurements in real time is a fundamental challenge in science and engineering. Existing approaches, including…

Machine Learning · Computer Science 2026-05-12 Panqi Chen , Yifan Sun , Shikai Fang , Xiao Fu , Lei Cheng

We propose a general privacy-preserving optimization-based framework for real-time environments without requiring trusted data curators. In particular, we introduce a noisy stochastic gradient descent algorithm for online statistical…

Methodology · Statistics 2025-06-11 Jinhan Xie , Enze Shi , Bei Jiang , Linglong Kong , Xuming He

This paper considers the real-time detection of anomalies in high-dimensional systems. The goal is to detect anomalies quickly and accurately so that the appropriate countermeasures could be taken in time, before the system possibly gets…

Machine Learning · Computer Science 2020-07-16 Mahsa Mozaffari , Yasin Yilmaz

This paper considers the detection of change points in parallel data streams, a problem widely encountered when analyzing large-scale real-time streaming data. Each stream may have its own change point, at which its data has a…

Methodology · Statistics 2023-01-18 Zexian Lu , Yunxiao Chen , Xiaoou Li

Often logs hosted in large data centers represent network traffic data over a long period of time. For instance, such network traffic data logged via a TCP dump packet sniffer (as considered in the 1998 DARPA intrusion attack) included…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-07 Prateek Chanda , Malay Bhattacharya

The need to estimate a particular quantile of a distribution is an important problem which frequently arises in many computer vision and signal processing applications. For example, our work was motivated by the requirements of many…

Computer Vision and Pattern Recognition · Computer Science 2015-04-22 Ognjen Arandjelovic , Duc-Son Pham , Svetha Venkatesh

Event-based vision sensors, such as the Dynamic Vision Sensor (DVS), are ideally suited for real-time motion analysis. The unique properties encompassed in the readings of such sensors provide high temporal resolution, superior sensitivity…

Computer Vision and Pattern Recognition · Computer Science 2020-01-14 Anton Mitrokhin , Cornelia Fermuller , Chethan Parameshwara , Yiannis Aloimonos

Complex systems which can be represented in the form of static and dynamic graphs arise in different fields, e.g. communication, engineering and industry. One of the interesting problems in analysing dynamic network structures is to monitor…

Machine Learning · Computer Science 2020-11-13 Anna Malinovskaya , Philipp Otto , Torben Peters

This paper introduces a novel spatiotemporal feature representation model designed to address the limitations of traditional methods in multidimensional time series (MTS) analysis. The proposed approach converts MTS into one-dimensional…

Machine Learning · Computer Science 2024-10-10 Xu Yan , Yaoting Jiang , Wenyi Liu , Didi Yi , Jianjun Wei

Controlling and analyzing cyberphysical and robotics systems is increasingly becoming a Big Data challenge. Pushing this data to, and processing in the cloud is more efficient than on-board processing. However, current cloud-based solutions…

Robotics · Computer Science 2012-12-17 Timothy Hunter , Tathagata Das , Matei Zaharia , Pieter Abbeel , Alexandre M. Bayen

4D panoptic segmentation in a streaming setting is critical for highly dynamic environments, such as evacuating dense crowds and autonomous driving in complex scenarios, where real-time, fine-grained perception within a constrained time…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Ling Liu , Jun Tian , Li Yi

This paper presents an efficient approach for subsequence search in data streams. The problem consists in identifying coherent repetitions of a given reference time-series, eventually multi-variate, within a longer data stream. Dynamic Time…

Machine Learning · Computer Science 2019-07-17 Antonio Candelieri , Stanislav Fedorov , Enza Messina

Prediction modelling of claim frequency is an important task for pricing and risk management in non-life insurance and needed to be updated frequently with the changes in the insured population, regulatory legislation and technology.…

Applications · Statistics 2023-01-10 Jiakun Jiang , Zhengxiao Li , Liang Yang

Triangle counting is a fundamental problem in graph mining, essential for analyzing graph streams with arbitrary edge orders. However, exact counting becomes impractical due to the massive size of real-world graph streams. To address this,…

Data Structures and Algorithms · Computer Science 2026-01-27 Wei Xuan , Yan Liang , Huawei Cao , Ning Lin , Xiaochun Ye , Dongrui Fan