English
Related papers

Related papers: A Novel Approach for Big Data Analytics in Future …

200 papers

Timely and accurate detection of anomalies in power electronics is becoming increasingly critical for maintaining complex production systems. Robust and explainable strategies help decrease system downtime and preempt or mitigate…

Multi-event detection and recognition in real time is of challenge for a modern grid as its feature is usually non-identifiable. Based on factor model, this paper porposes a data-driven method as an alternative solution under the framework…

Applications · Statistics 2017-12-27 Fan Yang , Xing He , Robert Caiming Qiu , Zenan Ling

The evolving landscape of electric power networks, influenced by the integration of distributed energy resources require the development of novel power system monitoring and control architectures. This paper develops algorithm to monitor…

Systems and Control · Electrical Eng. & Systems 2024-12-05 Erfan Mehdipour Abadi , Masoud H. Nazari

A novel method is proposed for detecting changes in the covariance structure of moderate dimensional time series. This non-linear test statistic has a number of useful properties. Most importantly, it is independent of the underlying…

Methodology · Statistics 2021-08-18 Sean Ryan , Rebecca Killick

Community detection is one of the most important problems in network analysis. Among many algorithms proposed for this task, methods based on statistical inference are of particular interest: they are mathematically sound and were shown to…

Social and Information Networks · Computer Science 2019-02-25 Liudmila Prokhorenkova , Alexey Tikhonov

For a long time, detection and parameter estimation methods for signal processing have relied on asymptotic statistics as the number $n$ of observations of a population grows large comparatively to the population size $N$, i.e. $n/N\to…

Information Theory · Computer Science 2012-06-20 Romain Couillet , Merouane Debbah

Graphs are ubiquitous in modelling relational structures. Recent endeavours in machine learning for graph-structured data have led to many architectures and learning algorithms. However, the graph used by these algorithms is often…

Machine Learning · Statistics 2020-06-25 Soumyasundar Pal , Saber Malekmohammadi , Florence Regol , Yingxue Zhang , Yishi Xu , Mark Coates

With the widely used smart meters in the energy sector, anomaly detection becomes a crucial mean to study the unusual consumption behaviors of customers, and to discover unexpected events of using energy promptly. Detecting consumption…

Databases · Computer Science 2016-06-21 Xiufeng Liu , Per Sieverts Nielsen

The increasing integration of intermittent renewable generation, especially at the distribution level,necessitates advanced planning and optimisation methodologies contingent on the knowledge of thegrid, specifically the admittance matrix…

Systems and Control · Electrical Eng. & Systems 2021-12-21 Jean-Sébastien Brouillon , Emanuele Fabbiani , Pulkit Nahata , Keith Moffat , Florian Dörfler , Giancarlo Ferrari-Trecate

An important tool grid operators use to safeguard against failures, whether naturally occurring or malicious, involves detecting anomalies in the power system SCADA data. In this paper, we aim to solve a real-time anomaly detection problem.…

Machine Learning · Computer Science 2024-04-12 SangWoo Park , Amritanshu Pandey

Anomaly detection is an important task in network management. However, deploying intelligent alert systems in real-world large-scale networking systems is challenging when we take into account (i) scalability, (ii) data heterogeneity, and…

Networking and Internet Architecture · Computer Science 2023-06-16 Yao Zhao , Sophine Zhang , Zhiyuan Yao

This work gives an overview of analytic tools for the design, analysis, and modelling of communication systems which can be described by linear vector channels such as y = Hx+z where the number of components in each vector is large. Tools…

Information Theory · Computer Science 2013-10-22 Ralf R. Müller , Giusi Alfano , Benjamin M. Zaidel , Rodrigo de Miguel

Given sensor readings over time from a power grid, how can we accurately detect when an anomaly occurs? A key part of achieving this goal is to use the network of power grid sensors to quickly detect, in real-time, when any unusual events,…

Machine Learning · Computer Science 2021-12-06 Shimiao Li , Amritanshu Pandey , Bryan Hooi , Christos Faloutsos , Larry Pileggi

This article investigates the performance of grid computing systems whose interconnections are given by random and scale-free complex network models. Regular networks, which are common in parallel computing architectures, are also used as a…

Statistical Mechanics · Physics 2009-11-10 Luciano da Fontoura Costa , Gonzalo Travieso , Carlos Antonio Ruggiero

In our recent works, we developed a probabilistic framework for structural analysis in undirected networks. The key idea of that framework is to sample a network by a symmetric bivariate distribution and then use that bivariate distribution…

Social and Information Networks · Computer Science 2015-10-19 Cheng-Shang Chang , Duan-Shin Lee , Li-Heng Liou , Sheng-Min Lu , Mu-Huan Wu

Accurate assessment of systematic uncertainties is an increasingly vital task in physics studies, where large, high-dimensional datasets, like those collected at the Large Hadron Collider, hold the key to new discoveries. Common approaches…

Methodology · Statistics 2025-10-02 Alexis Romero , Kyle Cranmer , Daniel Whiteson

Network structures underlie the dynamics of many complex phenomena, from gene regulation and foodwebs to power grids and social media. Yet, as they often cannot be observed directly, their connectivities must be inferred from observations…

Machine Learning · Computer Science 2023-11-02 Thomas Gaskin , Grigorios A. Pavliotis , Mark Girolami

Informatics and technological advancements have triggered generation of huge volume of data with varied complexity in its management and analysis. Big Data analytics is the practice of revealing hidden aspects of such data and making…

Databases · Computer Science 2018-03-30 Bikram Karmakar , Indranil Mukhopadhyay

In machine learning, a bias occurs whenever training sets are not representative for the test data, which results in unreliable models. The most common biases in data are arguably class imbalance and covariate shift. In this work, we aim to…

Machine Learning · Computer Science 2018-04-04 Patrick Glauner , Radu State , Petko Valtchev , Diogo Duarte

This paper aims to develop an effective model-free inference procedure for high-dimensional data. We first reformulate the hypothesis testing problem via sufficient dimension reduction framework. With the aid of new reformulation, we…

Methodology · Statistics 2022-05-17 Xu Guo , Runze Li , Zhe Zhang , Changliang Zou