English
Related papers

Related papers: Generating knockoffs via conditional independence

200 papers

We develop a general framework for distribution-free predictive inference in regression, using conformal inference. The proposed methodology allows for the construction of a prediction band for the response variable using any estimator of…

Methodology · Statistics 2017-03-09 Jing Lei , Max G'Sell , Alessandro Rinaldo , Ryan J. Tibshirani , Larry Wasserman

The knockoff filter, recently developed by Barber and Candes, is an effective procedure to perform variable selection with a controlled false discovery rate (FDR). We propose a private version of the knockoff filter by incorporating…

Machine Learning · Statistics 2022-02-01 Mehrdad Pournaderi , Yu Xiang

We present and evaluate the Fast (conditional) Independence Test (FIT) -- a nonparametric conditional independence test. The test is based on the idea that when $P(X \mid Y, Z) = P(X \mid Y)$, $Z$ is not useful as a feature to predict $X$,…

Machine Learning · Statistics 2018-04-10 Krzysztof Chalupka , Pietro Perona , Frederick Eberhardt

We introduce a new test for conditional independence which is based on what we call the weighted generalised covariance measure (WGCM). It is an extension of the recently introduced generalised covariance measure (GCM). To test the null…

Methodology · Statistics 2022-05-17 Cyrill Scheidegger , Julia Hörrmann , Peter Bühlmann

It is well-known that the expected scaled maximum of non-negative random variables with unit mean defines a stable tail dependence function associated with some extreme-value copula. In the special case when these random variables are…

Methodology · Statistics 2018-05-30 Jan-Frederik Mai

The paper is split in two parts: in the first part, we construct the exact likelihood for a discretely observed rough differential equation, driven by a piecewise linear path. In the second part, we use this likelihood in order to construct…

Statistics Theory · Mathematics 2018-07-10 Anastasia Papavasiliou , Kasia B. Taylor

In prescriptive analytics, the decision-maker observes historical samples of $(X, Y)$, where $Y$ is the uncertain problem parameter and $X$ is the concurrent covariate, without knowing the joint distribution. Given an additional covariate…

Optimization and Control · Mathematics 2021-06-11 Tianyu Wang , Ningyuan Chen , Chun Wang

Conformal inference, cross-validation+, and the jackknife+ are hold-out methods that can be combined with virtually any machine learning algorithm to construct prediction sets with guaranteed marginal coverage. In this paper, we develop…

Methodology · Statistics 2021-02-24 Yaniv Romano , Matteo Sesia , Emmanuel J. Candès

The paper presents a new copula based method for measuring dependence between random variables. Our approach extends the Maximum Mean Discrepancy to the copula of the joint distribution. We prove that this approach has several advantageous…

Machine Learning · Computer Science 2019-08-15 Barnabas Poczos , Zoubin Ghahramani , Jeff Schneider

The Laplace approximation has been one of the workhorses of Bayesian inference. It often delivers good approximations in practice despite the fact that it does not strictly take into account where the volume of posterior density lies.…

Machine Learning · Statistics 2022-03-02 Nikolaos Gianniotis

We consider the problem of sequentially testing a simple null hypothesis versus a composite alternative hypothesis that consists of a finite set of densities. We study sequential tests that are based on thresholding of mixture-based…

Statistics Theory · Mathematics 2013-01-23 Georgios Fellouris , Alexander G. Tartakovsky

We introduce a variant of the $k$-nearest neighbor classifier in which $k$ is chosen adaptively for each query, rather than supplied as a parameter. The choice of $k$ depends on properties of each neighborhood, and therefore may…

Machine Learning · Computer Science 2019-05-31 Akshay Balsubramani , Sanjoy Dasgupta , Yoav Freund , Shay Moran

We develop a framework for the operationalization of models and parameters by combining de Finetti's representation theorem with a conditional form of Sanov's theorem. This synthesis, the tilted de Finetti theorem, shows that conditioning…

Statistics Theory · Mathematics 2025-09-17 Nicholas G. Polson , Daniel Zantedeschi

We give a decomposition of the posterior predictive variance using the law of total variance and conditioning on a finite dimensional discrete random variable. This random variable summarizes various features of modeling that are used to…

Methodology · Statistics 2022-09-02 Dean Dustin , Bertrand Clarke

Let the random variable $X\, :=\, e(\mathcal{H}[B])$ count the number of edges of a hypergraph $\mathcal{H}$ induced by a random $m$ element subset $B$ of its vertex set. Focussing on the case that $\mathcal{H}$ satisfies some regularity…

Combinatorics · Mathematics 2021-04-01 Gonzalo Fiz Pontiveros , Simon Griffiths , Matheus Secco , Oriol Serra

Maximum composite likelihood estimation is a useful alternative to maximum likelihood estimation when data arise from data generating processes (DGPs) that do not admit tractable joint specification. We demonstrate that generic composite…

Methodology · Statistics 2021-06-29 Hien D Nguyen , Jessica Bagnall-Guerreiro , Andrew T Jones

A randomized algorithm for a search problem is *pseudodeterministic* if it produces a fixed canonical solution to the search problem with high probability. In their seminal work on the topic, Gat and Goldwasser posed as their main open…

Computational Complexity · Computer Science 2025-12-05 Lijie Chen , Zhenjian Lu , Igor C. Oliveira , Hanlin Ren , Rahul Santhanam

In this paper we propose an alternative to the coupling of Berkes, Liu and Wu [1] to obtain strong approximations for partial sums of dependent sequences. The main tool is a new Rosen-thal type inequality expressed in terms of the coupling…

Probability · Mathematics 2018-02-14 Christophe Cuny , Jérôme Dedecker , Florence Merlevède

We prove general de Finetti type theorems for classical and free independence. The de Finetti type theorems work for all non-easy quantum groups, which generalize a recent work of Banica, Curran and Speicher. We determine maximal…

Operator Algebras · Mathematics 2019-04-26 Weihua Liu

We prove bounds on statistical distances between high-dimensional exchangeable mixture distributions (which we call \emph{permutation mixtures}) and their i.i.d. counterparts. Our results are based on a novel method for controlling $\chi^2$…

Statistics Theory · Mathematics 2025-09-17 Yanjun Han , Jonathan Niles-Weed