English
Related papers

Related papers: Coo: Rethink Data Anomalies In Databases

200 papers

Bound-to-Bound Data Collaboration (B2BDC) provides a natural framework for addressing both forward and inverse uncertainty quantification problems. In this approach, QOI (quantity of interest) models are constrained by related experimental…

Optimization and Control · Mathematics 2019-04-02 Arun Hegde , Wenyu Li , James Oreluk , Andrew Packard , Michael Frenklach

We consider the problem of aligning a pair of databases with correlated entries. We introduce a new measure of correlation in a joint distribution that we call cycle mutual information. This measure has operational significance: it…

Information Theory · Computer Science 2018-05-11 Daniel Cullina , Prateek Mittal , Negar Kiyavash

Data generalization is a powerful technique for sanitizing multi-attribute data for publication. In a multidimensional model, a subset of attributes called the quasi-identifiers (QI) are used to define the space and a generalization scheme…

Databases · Computer Science 2021-08-12 Bijit Hore , Ravi Jammalamadaka , Sharad Mehrotra , Amedeo D'Ascanio

Anomaly detection is a branch of data analysis and machine learning which aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items)…

Machine Learning · Statistics 2024-07-11 Pavlo Mozharovskyi , Romain Valla

Anomaly detection (AD) is a critical task across domains such as cybersecurity and healthcare. In the unsupervised setting, an effective and theoretically-grounded principle is to train classifiers to distinguish normal data from…

Machine Learning · Statistics 2025-06-18 Matthew Lau , Tian-Yi Zhou , Xiangchi Yuan , Jizhou Chen , Wenke Lee , Xiaoming Huo

The continued digitization of societal processes translates into a proliferation of time series data that cover applications such as fraud detection, intrusion detection, and energy management, where anomaly detection is often essential to…

The growing adoption of IoT systems in industries like transportation, banking, healthcare, and smart energy has increased reliance on sensor networks. However, anomalies in sensor readings can undermine system reliability, making real-time…

Signal Processing · Electrical Eng. & Systems 2025-06-02 Tanish Baranwal , Arnab Das , Srihari Varada , Santanu Das , Mohammad R. Haider

A central question in the era of 'big data' is what to do with the enormous amount of information. One possibility is to characterize it through statistics, e.g., averages, or classify it using machine learning, in order to understand the…

Information Theory · Computer Science 2017-09-12 Anders Høst-Madsen , Elyas Sabeti , Chad Walton

The Age of Information (AoI) is a performance metric that quantifies the freshness of data in systems where timely updates are critical. Most state-of-the-art methods typically assume that packets enter the monitored system with zero age,…

Information Theory · Computer Science 2025-12-01 Fernando Miguelez , Urtzi Ayesta , Josu Doncel , Maria Dolores Ugarte

Detecting anomalies over real-world datasets remains a challenging task. Data annotation is an intensive human labor problem, particularly in sequential datasets, where the start and end time of anomalies are not known. As a result, data…

Machine Learning · Computer Science 2022-10-05 Parastoo Kamranfar , David Lattanzi , Amarda Shehu , Daniel Barbará

When dealing with the Internet of Things (IoT), especially industrial IoT (IIoT), two manifest challenges leap to mind. First is the massive amount of data streaming to and from IoT devices, and second is the fast pace at which these…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-04 Maede Zolanvari , Ali Ghubaish , Raj Jain

Many organisations manage service quality and monitor a large set devices and servers where each entity is associated with telemetry or physical sensor data series. Recently, various methods have been proposed to detect behavioural…

Social and Information Networks · Computer Science 2023-05-10 Len Feremans , Boris Cule , Bart Goethals

Outsourcing anomaly detection to third-parties can allow data owners to overcome resource constraints (e.g., in lightweight IoT devices), facilitate collaborative analysis (e.g., under distributed or multi-party scenarios), and benefit from…

Cryptography and Security · Computer Science 2022-06-28 Meisam Mohammady , Han Wang , Lingyu Wang , Mengyuan Zhang , Yosr Jarraya , Suryadipta Majumdar , Makan Pourzandi , Mourad Debbabi , Yuan Hong

Industrial maintenance is being transformed by the Internet of Things and edge computing, generating continuous data streams that demand real-time, adaptive decision-making under limited computational resources. While data stream mining…

Machine Learning · Computer Science 2025-12-10 Ana Rita Paupério , Diogo Risca , Afonso Lourenço , Goreti Marreiros , Ricardo Martins

Data profilers play a crucial role in the preprocessing phase of data analysis by identifying quality issues such as missing, extreme, or erroneous values. Traditionally, profilers have relied solely on statistical methods, which lead to…

Databases · Computer Science 2024-04-22 Zezhou Huang , Eugene Wu

Deployment, operation and maintenance of large IT systems becomes increasingly complex and puts human experts under extreme stress when problems occur. Therefore, utilization of machine learning (ML) and artificial intelligence (AI) is…

Machine Learning · Computer Science 2021-07-30 Dominik Scheinert , Alexander Acker

This paper primarily addresses the issue of identifying all possible levels of digital anonymity, thereby allowing electronic services and mechanisms to be categorised. For this purpose, we sophisticate the generic idea of anonymity and,…

Cryptography and Security · Computer Science 2012-11-27 Peter Pleva

The accumulation of time-series data and the absence of labels make time-series Anomaly Detection (AD) a self-supervised deep learning task. Single-normality-assumption-based methods, which reveal only a certain aspect of the whole…

Machine Learning · Computer Science 2023-04-18 Rui Wang , Chongwei Liu , Xudong Mou , Kai Gao , Xiaohui Guo , Pin Liu , Tianyu Wo , Xudong Liu

In an era where data underpins decision-making across science, politics, and economics, ensuring high data quality is of paramount importance. Conventional computing algorithms for enhancing data quality, including anomaly detection, demand…

Quantum Physics · Physics 2025-12-02 Sven Groppe , Valter Uotila , Jinghua Groppe

Anomaly detection has many applications ranging from bank-fraud detection and cyber-threat detection to equipment maintenance and health monitoring. However, choosing a suitable algorithm for a given application remains a challenging design…