English
Related papers

Related papers: Finding Statistically Significant Interactions bet…

200 papers

We study contextual search, a generalization of binary search in higher dimensions, which captures settings such as feature-based dynamic pricing. Standard formulations of this problem assume that agents act in accordance with a specific…

Machine Learning · Computer Science 2022-08-09 Akshay Krishnamurthy , Thodoris Lykouris , Chara Podimata , Robert Schapire

An important problem in machine learning and statistics is to identify features that causally affect the outcome. This is often impossible to do from purely observational data, and a natural relaxation is to identify features that are…

Machine Learning · Statistics 2019-05-30 Jaime Roquero Gimenez , Amirata Ghorbani , James Zou

Causal discovery studies the problem of mining causal relationships between variables from data, which is of primary interest in science. During the past decades, significant amount of progresses have been made toward this fundamental data…

Artificial Intelligence · Computer Science 2016-11-28 Kui Yu , Jiuyong Li , Lin Liu

Feature selection (FS) has become an indispensable task in dealing with today's highly complex pattern recognition problems with massive number of features. In this study, we propose a new wrapper approach for FS based on binary…

Machine Learning · Statistics 2016-03-08 Vural Aksakalli , Milad Malekipirbazari

Selecting relevant features is an important and necessary step for intelligent machines to maximize their chances of success. However, intelligent machines generally have no enough computing resources when faced with huge volume of data.…

Machine Learning · Computer Science 2025-07-04 Hexiang Bai , Deyu Li , Jiye Liang , Yanhui Zhai

Multi-parton interactions are a fascinating phenomenon that occur in almost every high-energy hadron--hadron collision, yet are remarkably difficult to study quantitatively. In this letter we present a strategy to optimally disentangle…

High Energy Physics - Phenomenology · Physics 2024-05-20 Jeppe R. Andersen , Pier Francesco Monni , Luca Rottoli , Gavin P. Salam , Alba Soto-Ontoso

Including pairwise interactions between the predictors of a regression model can produce better predicting models. However, to fit such interaction models on typical data sets in biology and other fields can often require solving enormous…

Methodology · Statistics 2023-02-14 Guo Yu , Jacob Bien , Ryan Tibshirani

A natural way to improve the detection of objects is to consider the contextual constraints imposed by the detection of additional objects in a given scene. In this work, we exploit the spatial relations between objects in order to improve…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Ehud Barnea , Ohad Ben-Shahar

In many high-dimensional problems,polynomial-time algorithms fall short of achieving the statistical limits attainable without computational constraints. A powerful approach to probe the limits of polynomial-time algorithms is to study the…

Statistics Theory · Mathematics 2025-07-11 Bertrand Even , Christophe Giraud , Nicolas Verzelen

Destructive interference between signal and background processes poses a fundamental challenge in searches for top-philic scalar resonances, significantly reducing experimental sensitivity to well-motivated extensions of the Higgs sector.…

High Energy Physics - Phenomenology · Physics 2026-04-29 Diego A. Baron Moreno , Christoph Englert , Yvonne Peters

Automated high-stake decision-making such as medical diagnosis requires models with high interpretability and reliability. As one of the interpretable and reliable models with good prediction ability, we consider Sparse High-order…

Machine Learning · Statistics 2021-06-10 Diptesh Das , Vo Nguyen Le Duy , Hiroyuki Hanada , Koji Tsuda , Ichiro Takeuchi

High-dimensional data is common in multiple areas, such as health care and genomics, where the number of features can be tens of thousands. In such scenarios, the large number of features often leads to inefficient learning. Constraint…

Machine Learning · Statistics 2023-06-13 Kartheek Bondugula , Santiago Mazuelas , Aritz Pérez

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

Multi-objective feature selection is one of the most significant issues in the field of pattern recognition. It is challenging because it maximizes the classification performance and, at the same time, minimizes the number of selected…

Artificial Intelligence · Computer Science 2022-11-11 Motahare Namakin , Modjtaba Rouhani , Mostafa Sabzekar

We address a classical problem in statistics: adding two-way interaction terms to a regression model. As the covariate dimension increases quadratically, we develop an estimator that adapts well to this increase, while providing accurate…

Methodology · Statistics 2023-09-26 Mark A. van de Wiel , Matteo Amestoy , Jeroen Hoogland

We present a new algorithm which detects the maximal possible number of matched disjoint pairs satisfying a given caliper when a bipartite matching is done with respect to a scalar index (e.g., propensity score), and constructs a…

Computation · Statistics 2022-07-20 Pavel S. Ruzankin

Feature selection can efficiently identify the most informative features with respect to the target feature used in training. However, state-of-the-art vector-based methods are unable to encapsulate the relationships between feature samples…

Machine Learning · Computer Science 2018-09-11 Lixin Cui , Lu Bai , Zhihong Zhang , Yue Wang , Edwin R. Hancock

We derive the statistical distribution functions for the Hubbard chain with infinite Coulomb repulsion among particles and for the statistical spin liquid with an arbitrary magnitude of the local interaction in momentum space. Haldane's…

Condensed Matter · Physics 2009-10-22 Krzysztof Byczuk , Jozef Spalek

High dimensional statistical problems arise from diverse fields of scientific research and technological development. Variable selection plays a pivotal role in contemporary statistical learning and scientific discoveries. The traditional…

Statistics Theory · Mathematics 2009-10-08 Jianqing Fan , Jinchi Lv

Datasets containing both categorical and continuous variables are frequently encountered in many areas, and with the rapid development of modern measurement technologies, the dimensions of these variables can be very high. Despite the…

Methodology · Statistics 2024-01-03 Binyan Jiang , Chenlei Leng , Cheng Wang , Zhongqing Yang , Xinyang Yu