English
Related papers

Related papers: Sequential Kernelized Independence Testing

200 papers

In many real-world scenarios, interested variables are often represented as discretized values due to measurement limitations. Applying Conditional Independence (CI) tests directly to such discretized data, however, can lead to incorrect…

Artificial Intelligence · Computer Science 2025-06-11 Boyang Sun , Yu Yao , Xinshuai Dong , Zongfang Liu , Tongliang Liu , Yumou Qiu , Kun Zhang

Recently, the binary expansion testing framework was introduced to test the independence of two continuous random variables by utilizing symmetry statistics that are complete sufficient statistics for dependence. We develop a new test based…

Statistics Theory · Mathematics 2021-01-11 Duyeol Lee , Kai Zhang , Michael R. Kosorok

We consider a quantum system that is being continuously monitored, giving rise to a measurement signal. From such a stream of data, information needs to be inferred about the underlying system's dynamics. Here we focus on hypothesis testing…

Quantum Physics · Physics 2024-03-27 Giulio Gasbarri , Matias Bilkis , Elisabet Roda-Salichs , John Calsamiglia

In this paper, we propose a general method for testing composite hypotheses. Our idea is to use confidence limits to define stopping and decision rules. The requirements of operating characteristic function can be satisfied by adjusting the…

Statistics Theory · Mathematics 2012-02-10 Xinjia Chen

Measuring and testing dependence between complex objects is of great importance in modern statistics. Most existing work relied on the distance between random variables, which inevitably required the moment conditions to guarantee the…

Methodology · Statistics 2023-04-19 Yilin Zhang , Songshan Yang

Testing conditional independence has many applications, such as in Bayesian network learning and causal discovery. Different test methods have been proposed. However, existing methods generally can not work when only discretized…

Machine Learning · Statistics 2025-03-19 Boyang Sun , Yu Yao , Guang-Yuan Hao , Yumou Qiu , Kun Zhang

Testing (conditional) independence of multivariate random variables is a task central to statistical inference and modelling in general - though unfortunately one for which to date there does not exist a practicable workflow. State-of-art…

Machine Learning · Statistics 2018-05-01 Samuel Burkart , Franz J Király

Testing independence among a number of (ultra) high-dimensional random samples is a fundamental and challenging problem. By arranging $n$ identically distributed $p$-dimensional random vectors into a $p \times n$ data matrix, we investigate…

Statistics Theory · Mathematics 2017-03-28 Xi Chen , Weidong Liu

Constraint-based (CB) learning is a formalism for learning a causal network with a database D by performing a series of conditional-independence tests to infer structural information. This paper considers a new test of independence that…

Artificial Intelligence · Computer Science 2012-12-12 Denver Dash , Marek J. Druzdzel

Independence and conditional independence are fundamental concepts for reasoning about groups of random variables in probabilistic programs. Verification methods for independence are still nascent, and existing methods cannot handle…

Logic in Computer Science · Computer Science 2021-05-04 Jialu Bao , Simon Docherty , Justin Hsu , Alexandra Silva

Refining one's hypotheses in the light of data is a common scientific practice; however, the dependency on the data introduces selection bias and can lead to specious statistical analysis. An approach for addressing this is via conditioning…

Machine Learning · Computer Science 2020-03-03 Jen Ning Lim , Makoto Yamada , Wittawat Jitkrittum , Yoshikazu Terada , Shigeyuki Matsui , Hidetoshi Shimodaira

Kernel dependence measures yield accurate estimates of nonlinear relations between random variables, and they are also endorsed with solid theoretical properties and convergence rates. Besides, the empirical estimates are easy to compute in…

Machine Learning · Statistics 2016-11-03 Adrián Pérez-Suay , Gustau Camps-Valls

The independence clustering problem is considered in the following formulation: given a set $S$ of random variables, it is required to find the finest partitioning $\{U_1,\dots,U_k\}$ of $S$ into clusters such that the clusters…

Machine Learning · Computer Science 2017-03-21 Daniil Ryabko

The K-sample testing problem involves determining whether K groups of data points are each drawn from the same distribution. Analysis of variance is arguably the most classical method to test mean differences, along with several recent…

Machine Learning · Statistics 2024-10-04 Sambit Panda , Cencheng Shen , Ronan Perry , Jelle Zorn , Antoine Lutz , Carey E. Priebe , Joshua T. Vogelstein

It is a common saying that testing for conditional independence, i.e., testing whether whether two random vectors $X$ and $Y$ are independent, given $Z$, is a hard statistical problem if $Z$ is a continuous random variable (or vector). In…

Statistics Theory · Mathematics 2022-03-25 Rajen D. Shah , Jonas Peters

The sequential hypothesis testing problem is a class of statistical analyses where the sample size is not fixed in advance. Instead, the decision-process takes in new observations sequentially to make real-time decisions for testing an…

Machine Learning · Statistics 2022-04-12 Wanrong Zhang , Yajun Mei , Rachel Cummings

We investigate the problem of testing whether $d$ random variables, which may or may not be continuous, are jointly (or mutually) independent. Our method builds on ideas of the two variable Hilbert-Schmidt independence criterion (HSIC) but…

Statistics Theory · Mathematics 2016-11-07 Niklas Pfister , Peter Bühlmann , Bernhard Schölkopf , Jonas Peters

Recently, the importance of analysing data and collecting valuable insight efficiently has been increasing in various fields. Estimating mutual information (MI) plays a critical role to investigate the relationship among multiple random…

Quantum Physics · Physics 2025-03-10 Yota Maeda , Hideaki Kawaguchi , Hiroyuki Tezuka

In online multiple testing, an a priori unknown number of hypotheses are tested sequentially, i.e. at each time point a test decision for the current hypothesis has to be made using only the data available so far. Although many powerful…

Methodology · Statistics 2025-03-11 Vincent Jankovic , Lasse Fischer , Werner Brannath

We present a sequential version of the kernelized Stein discrepancy goodness-of-fit test, which allows for conducting goodness-of-fit tests for unnormalized densities that are continuously monitored and adaptively stopped. That is, the…

Machine Learning · Statistics 2025-04-18 Diego Martinez-Taboada , Aaditya Ramdas