English
Related papers

Related papers: A Tutorial on Statistically Sound Pattern Discover…

200 papers

Traditional statistical theory assumes that the analysis to be performed on a given data set is selected independently of the data themselves. This assumption breaks downs when data are re-used across analyses and the analysis to be…

Machine Learning · Computer Science 2017-06-06 Adam Smith

We develop inference procedures robust to general forms of weak dependence. The procedures utilize test statistics constructed by resampling in a manner that does not depend on the unknown correlation structure of the data. We prove that…

Econometrics · Economics 2021-08-26 Michael P. Leung

Spatial documentation is exponentially increasing given the availability of Big IoT Data, enabled by the devices miniaturization and data storage capacity. Bayesian spatial statistics is a useful statistical tool to determine the dependence…

Methodology · Statistics 2020-10-01 Francisco Louzada , Diego C. Nascimento , Osafu Augustine Egbon

In this paper we consider the problem of detecting statistically significant sequential patterns in multi-neuronal spike trains. These patterns are characterized by ordered sequences of spikes from different neurons with specific delays…

Neurons and Cognition · Quantitative Biology 2008-08-28 P. S. Sastry , K. P. Unnikrishnan

This paper develops a framework to study the statistical power of revealed-preference tests. With randomly sampled budgets and mild smoothness of demand, statistical learning implies that any model consistent with the data must approximate…

Theoretical Economics · Economics 2026-02-12 Charles Gauthier , Raghav Malhotra , Agustin Troccoli Moretti

Many organisations manage service quality and monitor a large set devices and servers where each entity is associated with telemetry or physical sensor data series. Recently, various methods have been proposed to detect behavioural…

Social and Information Networks · Computer Science 2023-05-10 Len Feremans , Boris Cule , Bart Goethals

The importance of finding the characteristics leading to either a success or a failure is one of the driving forces of data mining. The various application areas of finding success/failure factors cover vast variety of areas such as credit…

Databases · Computer Science 2010-02-08 Yuval Cohen

Objective detection of specific patterns in statistical distributions, like groupings or gaps or abrupt transitions between different subsets, is a task with a rich range of applications in astronomy: Milky Way stellar population analysis,…

Instrumentation and Methods for Astrophysics · Physics 2018-05-09 Roman V. Baluev

Fault detection is a key challenge in the management of complex systems. In the context of SparkCognition's efforts towards predictive maintenance in large scale industrial systems, this problem is often framed in terms of anomaly detection…

Machine Learning · Computer Science 2024-05-29 Elad Liebman

Fake news gains has gained significant momentum, strongly motivating the need for fake news research. Many fake news detection approaches have thus been proposed, where most of them heavily rely on news content. However, network-based clues…

Social and Information Networks · Computer Science 2019-06-12 Xinyi Zhou , Reza Zafarani

Topological models of empirical and formal inquiry are increasingly prevalent. They have emerged in such diverse fields as domain theory [1, 16], formal learning theory [18], epistemology and philosophy of science [10, 15, 8, 9, 2],…

Machine Learning · Computer Science 2017-08-01 Konstantin Genin , Kevin T. Kelly

Statistical Machine Learning (SML) refers to a body of algorithms and methods by which computers are allowed to discover important features of input data sets which are often very large in size. The very task of feature discovery from data…

Machine Learning · Computer Science 2018-11-14 Rajiv Sambasivan , Sourish Das , Sujit K Sahu

Machine learning is the science of discovering statistical dependencies in data, and the use of those dependencies to perform predictions. During the last decade, machine learning has made spectacular progress, surpassing human performance…

Machine Learning · Statistics 2016-07-13 David Lopez-Paz

Causal discovery, the task of inferring causal structure from data, has the potential to uncover mechanistic insights from biological experiments, especially those involving perturbations. However, causal discovery algorithms over larger…

Machine Learning · Computer Science 2025-04-01 Menghua Wu , Yujia Bao , Regina Barzilay , Tommi Jaakkola

Causal discovery aims to learn causal relationships between variables from targeted data, making it a fundamental task in machine learning. However, causal discovery algorithms often rely on unverifiable causal assumptions, which are…

Machine Learning · Computer Science 2025-10-15 Huiyang Yi , Yanyan He , Duxin Chen , Mingyu Kang , He Wang , Wenwu Yu

We analyze a family of methods for statistical causal inference from sample under the so-called Additive Noise Model. While most work on the subject has concentrated on establishing the soundness of the Additive Noise Model, the statistical…

Machine Learning · Computer Science 2014-02-06 Samory Kpotufe , Eleni Sgouritsa , Dominik Janzing , Bernhard Schölkopf

Deep learning methods have proved highly effective for classification and image recognition problems. In this paper, we ask whether this success can be transferred to hypothesis testing: if a neural network can distinguish, for example, an…

Machine Learning · Statistics 2026-04-30 Gery Geenens , Pierre Lafaye de Micheaux , Ivan Muyun Zou

The success of AI models relies on the availability of large, diverse, and high-quality datasets, which can be challenging to obtain due to data scarcity, privacy concerns, and high costs. Synthetic data has emerged as a promising solution…

Computation and Language · Computer Science 2024-08-13 Ruibo Liu , Jerry Wei , Fangyu Liu , Chenglei Si , Yanzhe Zhang , Jinmeng Rao , Steven Zheng , Daiyi Peng , Diyi Yang , Denny Zhou , Andrew M. Dai

Ensuring that analyses performed on a dataset are representative of the entire population is one of the central problems in statistics. Most classical techniques assume that the dataset is independent of the analyst's query and break down…

Machine Learning · Computer Science 2024-09-25 Guy Blanc

A powerful approach to detecting erroneous data is to check which potentially dirty data records are incompatible with a user's domain knowledge. Previous approaches allow the user to specify domain knowledge in the form of logical…

Databases · Computer Science 2019-02-27 Jing Nathan Yan , Oliver Schulte , Jiannan Wang , Reynold Cheng