English
Related papers

Related papers: Controlling False Positives in Association Rule Mi…

200 papers

We consider a simple control problem in which the underlying dynamics depend on a parameter $a$ that is unknown and must be learned. We study three variants of the control problem: Bayesian control, in which we have a prior belief about…

Optimization and Control · Mathematics 2024-03-12 Jacob Carruth , Maximilian F. Eggl , Charles Fefferman , Clarence W. Rowley

In this paper a new mining algorithm is defined based on frequent item set. Apriori Algorithm scans the database every time when it finds the frequent item set so it is very time consuming and at each step it generates candidate item set.…

Databases · Computer Science 2012-02-23 Sanober Shaikh , Madhuri rao

We consider one of the most basic multiple testing problems that compares expectations of multivariate data among several groups. As a test statistic, a conventional (approximate) $t$-statistic is considered, and we determine its rejection…

Methodology · Statistics 2016-12-20 Yoshiyuki Ninomiya , Satoshi Kuriki , Toshihiko Shiroishi , Toyoyuki Takada

An association rule is statistically significant, if it has a small probability to occur by chance. It is well-known that the traditional frequency-confidence framework does not produce statistically significant rules. It can both accept…

Databases · Computer Science 2014-05-07 Wilhelmiina Hämäläinen

Most link prediction methods return estimates of the connection probability of missing edges in a graph. Such output can be used to rank the missing edges from most to least likely to be a true edge, but does not directly provide a…

Methodology · Statistics 2024-03-26 Ariane Marandon

Some existing notions of redundancy among association rules allow for a logical-style characterization and lead to irredundant bases of absolutely minimum size. One can push the intuition of redundancy further and find an intuitive notion…

Databases · Computer Science 2011-03-25 José L. Balcázar

In this paper, we consider a stochastic Model Predictive Control able to account for effects of additive stochastic disturbance with unbounded support, and requiring no restrictive assumption on either independence nor Gaussianity. We…

Systems and Control · Electrical Eng. & Systems 2020-03-17 Martina Mammarella , Teodoro Alamo , Sergio Lucia , Fabrizio Dabbene

Conformal prediction is a valuable tool for quantifying predictive uncertainty of machine learning models. However, its applicability relies on the assumption of data exchangeability, a condition which is often not met in real-world…

Machine Learning · Statistics 2024-12-30 Aleksandr Podkopaev , Darren Xu , Kuang-Chih Lee

Negative sampling is essential for implicit-feedback-based collaborative filtering, which is used to constitute negative signals from massive unlabeled data to guide supervised learning. The state-of-the-art idea is to utilize hard negative…

Information Retrieval · Computer Science 2023-08-14 Yuhan Zhao , Rui Chen , Riwei Lai , Qilong Han , Hongtao Song , Li Chen

In this paper, we propose a cost function that corresponds to the mean square errors between estimated values and true values of conditional probability in a discrete distribution. We then obtain the values that minimize the cost function.…

Applications · Statistics 2017-09-26 Kento Kawakami , Masato Kikuchi , Mitsuo Yoshida , Eiko Yamamoto , Kyoji Umemura

[Background:] Software effort prediction methods and models typically assume positive correlation between software product complexity and development effort. However, conflicting observations, i.e. negative correlation between product…

Software Engineering · Computer Science 2015-09-29 Zheng Li , Liam O'Brien , Ye Yang

Model-free knockoffs is a recently proposed technique for identifying covariates that is likely to have an effect on a response variable. The method is an efficient method to control the false discovery rate in hypothesis tests for separate…

Methodology · Statistics 2019-03-29 Lars Holden , Kristoffer Hellton

The use of weights provides an effective strategy to incorporate prior domain knowledge in large-scale inference. This paper studies weighted multiple testing in a decision-theoretic framework. We develop oracle and data-driven procedures…

Methodology · Statistics 2017-05-10 Pallavi Basu , T. Tony Cai , Kiranmoy Das , Wenguang Sun

In genome-wide association (GWA) studies the goal is to detect associations between genetic markers and a given phenotype. The number of genetic markers can be large and effective methods for control of the overall error rate is a central…

Methodology · Statistics 2017-05-09 Kari Krizak Halle , Mette Langaas

Rule-based cloud security posture management (CSPM) solutions are known to produce a lot of false positives based on the limited contextual understanding and dependence on static heuristics testing. This paper introduces a validation-driven…

Cryptography and Security · Computer Science 2025-08-19 Dikshant , Verma

Unmeasured confounding is a threat to causal inference in observational studies. In recent years, use of negative controls to mitigate unmeasured confounding has gained increasing recognition and popularity. Negative controls have a…

Methodology · Statistics 2019-09-05 Xu Shi , Wang Miao , Jennifer C. Nelson , Eric J. Tchetgen Tchetgen

Multiple hypothesis testing problems arise naturally in science. In this paper, we introduce the new Fast Closed Testing (FACT) method for multiple testing, controlling the family-wise error rate. This error rate is state of the art in many…

Methodology · Statistics 2020-01-22 Edgar Dobriban

In this paper, we propose a new practical association rule mining algorithm for anomaly detection in Intrusion Detection System (IDS). First, with a view of anomaly cases being relatively rarely occurred in network packet database, we…

Cryptography and Security · Computer Science 2016-10-17 Hyeok Kong , Cholyong Jong , Unhyok Ryang

Obtaining high-quality labels for large datasets is expensive, requiring massive annotations from human experts. While AI models offer a cost-effective alternative by predicting labels, their label quality is compromised by the unavoidable…

Machine Learning · Computer Science 2026-02-17 Huipeng Huang , Wenbo Liao , Huajun Xi , Hao Zeng , Mengchen Zhao , Hongxin Wei

In variable or graph selection problems, finding a right-sized model or controlling the number of false positives is notoriously difficult. Recently, a meta-algorithm called Stability Selection was proposed that can provide reliable…

Machine Learning · Statistics 2017-12-14 George Philipp , Seunghak Lee , Eric P. Xing