English
Related papers

Related papers: Dynamic trees for streaming and massive data conte…

200 papers

Traditional static functional data analysis is facing new challenges due to streaming data, where data constantly flow in. A major challenge is that storing such an ever-increasing amount of data in memory is nearly impossible. In addition,…

Methodology · Statistics 2023-10-11 Jinhan Xie , Enze Shi , Peijun Sang , Zuofeng Shang , Bei Jiang , Linglong Kong

This paper presents a methodology for creating streaming, distributed inference algorithms for Bayesian nonparametric (BNP) models. In the proposed framework, processing nodes receive a sequence of data minibatches, compute a variational…

Machine Learning · Computer Science 2015-11-02 Trevor Campbell , Julian Straub , John W. Fisher , Jonathan P. How

This paper presents an asynchronous distributed algorithm to manage multiple trees for peer-to-peer streaming in a flow level model. It is assumed that videos are cut into substreams, with or without source coding, to be distributed to all…

Data Structures and Algorithms · Computer Science 2013-08-12 Ji Zhu , Bruce Hajek

Database research can help machine learning performance in many ways. One way is to design better data structures. This paper combines the use of incremental computation and sequential and probabilistic filtering to enable "forgetful"…

Machine Learning · Computer Science 2022-12-16 Zhehu Yuan , Yinqi Sun , Dennis Shasha

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Matthias De Lange , Tinne Tuytelaars

High-dimensional streaming data are becoming increasingly ubiquitous in many fields. They often lie in multiple low-dimensional subspaces, and the manifold structures may change abruptly on the time scale due to pattern shift or occurrence…

Machine Learning · Statistics 2022-04-13 Ruiyu Xu , Jianguo Wu , Xiaowei Yue , Yongxiang Li

Traffic flow count data in networks arise in many applications, such as automobile or aviation transportation, certain directed social network contexts, and Internet studies. Using an example of Internet browser traffic flow through…

Methodology · Statistics 2022-06-07 Xi Chen , Kaoru Irie , David Banks , Robert Haslinger , Jewell Thomas , Mike West

A comprehensive artificial intelligence system needs to not only perceive the environment with different `senses' (e.g., seeing and hearing) but also infer the world's conditional (or even causal) relations and corresponding uncertainty.…

Machine Learning · Statistics 2021-01-07 Hao Wang , Dit-Yan Yeung

Modern streaming data categorization faces significant challenges from concept drift and class imbalanced data. This negatively impacts the output of the classifier, leading to improper classification. Furthermore, other factors such as the…

Machine Learning · Computer Science 2023-09-29 Priya. S , Haribharathi Sivakumar , Vijay Arvind. R

Batch training of machine learning models based on neural networks is now well established, whereas to date streaming methods are largely based on linear models. To go beyond linear in the online setting, nonparametric methods are of…

Signal Processing · Electrical Eng. & Systems 2020-01-22 Alec Koppel , Amrit Singh Bedi , Ketan Rajawat , Brian M. Sadler

We consider the problem of online learning in the presence of distribution shifts that occur at an unknown rate and of unknown intensity. We derive a new Bayesian online inference approach to simultaneously infer these distribution shifts…

Machine Learning · Statistics 2021-10-28 Aodong Li , Alex Boyd , Padhraic Smyth , Stephan Mandt

Emerging applications of machine learning in numerous areas involve continuous gathering of and learning from streams of data. Real-time incorporation of streaming data into the learned models is essential for improved inference in these…

Machine Learning · Computer Science 2020-12-01 Matthew Nokleby , Haroon Raja , Waheed U. Bajwa

The area of online machine learning in big data streams covers algorithms that are (1) distributed and (2) work from data streams with only a limited possibility to store past data. The first requirement mostly concerns software…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-19 András A. Benczúr , Levente Kocsis , Róbert Pálovics

Automated machine learning techniques benefited from tremendous research progress in recently. These developments and the continuous-growing demand for machine learning experts led to the development of numerous AutoML tools. However, these…

Machine Learning · Computer Science 2021-06-15 Alexandru-Ionut Imbrea

Bayesian learning is built on an assumption that the model space contains a true reflection of the data generating mechanism. This assumption is problematic, particularly in complex data environments. Here we present a Bayesian…

Machine Learning · Statistics 2018-11-05 S. P. Lyddon , S. G. Walker , C. C. Holmes

Hierarchical Bayesian models are increasingly used in large, inhomogeneous complex network dynamical systems by modeling parameters as draws from a hyperparameter-governed distribution. However, theoretical guarantees for these estimates as…

Statistics Theory · Mathematics 2026-01-23 Yi Yu , Yubo Hou , Yinchong Wang , Nan Zhang , Jianfeng Feng , Wenlian Lu

Bayesian nonparametric models offer a flexible and powerful framework for statistical model selection, enabling the adaptation of model complexity to the intricacies of diverse datasets. This survey intends to delve into the significance of…

Machine Learning · Computer Science 2024-04-02 Bahman Moraffah

Addressing the challenges of irregularity and concept drift in streaming time series is crucial for real-world predictive modelling. Previous studies in time series continual learning often propose models that require buffering long…

Machine Learning · Computer Science 2025-04-10 Futoon M. Abushaqra , Hao Xue , Yongli Ren , Flora D. Salim

Streaming data applications are becoming more common due to the ability of different information sources to continuously capture or produce data, such as sensors and social media. Despite recent advances, most visualization approaches, in…

Signal Processing · Electrical Eng. & Systems 2020-03-23 Tácito T. A. T. Neves , Rafael M. Martins , Danilo B. Coimbra , Kostiantyn Kucher , Andreas Kerren , Fernando V. Paulovich

Ensemble methods are among the state-of-the-art predictive modeling approaches. Applied to modern big data, these methods often require a large number of sub-learners, where the complexity of each learner typically grows with the size of…

Machine Learning · Computer Science 2018-10-29 Amichai Painsky , Saharon Rosset