English
Related papers

Related papers: Streaming Generalized Cross Entropy

200 papers

Some of the most relevant document schemas used online, such as XML and JSON, have a nested format. In the last decade, the task of extracting data from nested documents over streams has become especially relevant. We focus on the streaming…

Databases · Computer Science 2022-01-11 Martín Muñoz , Cristian Riveros

We develop a mixture procedure to monitor parallel streams of data for a change-point that affects only a subset of them, without assuming a spatial structure relating the data streams to one another. Observations are assumed initially to…

Statistics Theory · Mathematics 2013-05-10 Yao Xie , David Siegmund

Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To…

Information Theory · Computer Science 2023-07-19 Fabrizio Biondi , Yusuke Kawamoto , Axel Legay , Louis-Marie Traonouez

Given a stream of graph edges from a dynamic graph, how can we assign anomaly scores to edges and subgraphs in an online manner, for the purpose of detecting unusual behavior, using constant time and memory? For example, in intrusion…

Data Structures and Algorithms · Computer Science 2023-07-18 Siddharth Bhatia , Mohit Wadhwa , Kenji Kawaguchi , Neil Shah , Philip S. Yu , Bryan Hooi

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel…

Optimization and Control · Mathematics 2019-10-22 Tobias Sutter , David Sutter , Peyman Mohajerin Esfahani , John Lygeros

The problem of change-point estimation is considered under a general framework where the data are generated by unknown stationary ergodic process distributions. In this context, the consistent estimation of the number of change-points is…

Machine Learning · Statistics 2013-02-15 Azaden Khaleghi , Daniil Ryabko

Information entropy has been proved to be an effective tool to quantify the structural importance of complex networks. In the previous work (Xu et al, 2016 \cite{xu2016}), we measure the contribution of a path in link prediction with…

Social and Information Networks · Computer Science 2017-03-08 Zhongqi Xu , Cunlai Pu , Rajput Ramiz Sharafat , Lunbo Li , Jian Yang

Recognising and reacting to change in non-stationary data-streams is a challenging task. The majority of research in this area assumes that the true class label of incoming points are available, either at each time step or intermittently…

Neural and Evolutionary Computing · Computer Science 2023-12-27 Conor Fahy , Shengxiang Yang

We consider sequential change-point detection in parallel data streams, where each stream has its own change point. Once a change is detected in a data stream, this stream is deactivated permanently. The goal is to maximize the normal…

Statistics Theory · Mathematics 2021-07-15 Yunxiao Chen , Xiaoou Li

In todays digital era, data are everywhere from Internet of Things to health care or financial applications. This leads to potentially unbounded ever-growing Big data streams and it needs to be utilized effectively. Data normalization is an…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-24 Vibhuti Gupta , Rattikorn Hewett

We develop a data driven approach to perform clustering and end-to-end feature learning simultaneously for streaming data that can adaptively detect novel clusters in emerging data. Our approach, Adaptive Nonparametric Variational…

Machine Learning · Statistics 2019-10-14 Tingting Zhao , Zifeng Wang , Aria Masoomi , Jennifer G. Dy

Our study focuses on the potential for modifications of Inception-like architecture within the electrocardiogram (ECG) domain. To this end, we introduce IncepSE, a novel network characterized by strategic architectural incorporation that…

Signal Processing · Electrical Eng. & Systems 2023-12-18 Tue Minh Cao , Nhat Hong Tran , Le Phi Nguyen , Hieu Huy Pham , Hung Thanh Nguyen

We consider the estimation of an i.i.d.\ random vector observed through a linear transform followed by a componentwise, probabilistic (possibly nonlinear) measurement channel. A novel algorithm, called generalized approximate message…

Information Theory · Computer Science 2012-08-15 Sundeep Rangan

The aim of this paper is to shed light on the analysis of non-stationary time series by means of the method of diffusion entropy. For this purpose, we first study the case when infinitely many time series, as different realizations of the…

Statistical Mechanics · Physics 2007-05-23 M. Virgilio , P. Grigolini

We present S+t-SNE, an adaptation of the t-SNE algorithm designed to handle infinite data streams. The core idea behind S+t-SNE is to update the t-SNE embedding incrementally as new data arrives, ensuring scalability and adaptability to…

Artificial Intelligence · Computer Science 2025-01-22 Pedro C. Vieira , João P. Montrezol , João T. Vieira , João Gama

In this paper, we propose an efficient numerical implementation of Network Embedding based on commute times, using sparse approximation of a diffusion process on the network obtained by a modified version of the diffusion wavelet algorithm.…

Machine Learning · Computer Science 2023-08-29 Paula Mercurio , Di Liu

Modern streaming data categorization faces significant challenges from concept drift and class imbalanced data. This negatively impacts the output of the classifier, leading to improper classification. Furthermore, other factors such as the…

Machine Learning · Computer Science 2023-09-29 Priya. S , Haribharathi Sivakumar , Vijay Arvind. R

When large amounts of data continuously arrive in streams, online updating is an effective way to reduce storage and computational burden. The key idea of online updating is that the previous estimators are sequentially updated only using…

Methodology · Statistics 2022-10-12 Tianzhen Wang , Haixiang Zhang , Liuquan Sun

Gaussian processes offer a flexible kernel method for regression. While Gaussian processes have many useful theoretical properties and have proven practically useful, they suffer from poor scaling in the number of observations. In…

Machine Learning · Statistics 2021-08-26 Nick Terry , Youngjun Choe

We propose the Linearly Adaptive Cross Entropy Loss function. This is a novel measure derived from the information theory. In comparison to the standard cross entropy loss function, the proposed one has an additional term that depends on…

Machine Learning · Computer Science 2025-07-16 Jae Wan Shim