English
Related papers

Related papers: Learning Optimal Test Statistics in the Presence o…

200 papers

We study the problem of parameter-free stochastic optimization, inquiring whether, and under what conditions, do fully parameter-free methods exist: these are methods that achieve convergence rates competitive with optimally tuned methods,…

Machine Learning · Computer Science 2024-10-22 Amit Attia , Tomer Koren

So-called linear rank statistics provide a means for distribution-free (even in finite samples), yet highly flexible, two-sample testing in the setting of univariate random variables. Their flexibility derives from a choice of weights that…

Methodology · Statistics 2023-10-03 Dan D. Erdmann-Pham

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

In this paper, we consider a statistical problem of learning a linear model from noisy samples. Existing work has focused on approximating the least squares solution by using leverage-based scores as an importance sampling distribution.…

Machine Learning · Statistics 2016-02-11 Siheng Chen , Rohan Varma , Aarti Singh , Jelena Kovačević

Comparison of two univariate distributions based on independent samples from them is a fundamental problem in statistics, with applications in a wide variety of scientific disciplines. In many situations, we might hypothesize that the two…

Methodology · Statistics 2021-07-08 Ted Westling , Kevin J. Downes , Dylan S. Small

Profile likelihood intervals of large quantiles in Extreme Value distributions provide a good way to estimate these parameters of interest since they take into account the asymmetry of the likelihood surface in the case of small and…

Applications · Statistics 2010-05-21 A. Bolívar , E. Díaz-Francés , J. Ortega , E. Vilchis

Although the log-likelihood is widely used in model selection, the log-likelihood ratio has had few applications in this area. We develop a log-likelihood ratio based method for selecting regression models by focusing on the set of models…

Methodology · Statistics 2021-09-28 Min Tsao

Sampling algorithms play a pivotal role in probabilistic AI. However, verifying if a sampler program indeed samples from the claimed distribution is a notoriously hard problem. Provably correct testers like Barbarik, Teq, Flash, CubeProbe…

Data Structures and Algorithms · Computer Science 2025-12-09 Rishiraj Bhattacharyya , Sourav Chakraborty , Yash Pote , Uddalok Sarkar , Sayantan Sen

This paper considers the maximum likelihood estimation of factor models of high dimension, where the number of variables (N) is comparable with or even greater than the number of observations (T). An inferential theory is developed. We…

Statistics Theory · Mathematics 2012-05-31 Jushan Bai , Kunpeng Li

Optimal experimental design is a well studied field in applied science and engineering. Techniques for estimating such a design are commonly used within the framework of parameter estimation. Nonetheless, in recent years parameter…

Machine Learning · Statistics 2025-01-13 Md Shahriar Rahim Siddiqui , Arman Rahmim , Eldad Haber

The EM-algorithm is a general procedure to get maximum likelihood estimates if part of the observations on the variables of a network are missing. In this paper a stochastic version of the algorithm is adapted to probabilistic neural…

Artificial Intelligence · Computer Science 2013-03-26 Gerhard Paass

Statistical prediction plays an important role in many decision processes such as university budgeting (depending on the number of students who will enroll), capital budgeting (depending on the remaining lifetime of a fleet of systems), the…

Methodology · Statistics 2021-10-14 Qinglong Tian , Daniel J. Nordman , William Q. Meeker

The model-X conditional randomization test is a generic framework for conditional independence testing, unlocking new possibilities to discover features that are conditionally associated with a response of interest while controlling type-I…

Machine Learning · Computer Science 2023-02-21 Shalev Shaer , Yaniv Romano

It is often not possible to construct a probability density function that describes the data. This can happen if there is no analytic description, and the number of parameters is too large so that it is impossible to simulate and tabulate…

Instrumentation and Methods for Astrophysics · Physics 2013-11-28 Dmitry Chirkin

We develop a new statistical ideal observer model that performs holistic visual search (or gist) processing in part by placing thresholds on minimum extractable image features. In this model, the ideal observer reduces the number of free…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Howard C. Gifford

We construct optimal designs for group testing experiments where the goal is to estimate the prevalence of a trait by using a test with uncertain sensitivity and specificity. Using optimal design theory for approximate designs, we show that…

Statistics Theory · Mathematics 2017-01-05 Shih-Hao Huang , Mong-Na Lo Huang , Kerby Shedden , Weng Kee Wong

Ordinal categorical data are widely collected in psychology, education, and other social sciences, appearing commonly in questionnaires, assessments, and surveys. Latent class models provide a flexible framework for uncovering unobserved…

Machine Learning · Statistics 2026-02-26 Huan Qing

In simulation-based optimization, the optimal setting of the input parameters of the objective function can be determined by heuristic optimization techniques. However, when simulators model the stochasticity of real-world problems, their…

Machine Learning · Statistics 2020-05-26 Manuel Dalcastagné , Andrea Mariello , Roberto Battiti

Selecting the best code solution from multiple generated ones is an essential task in code generation, which can be achieved by using some reliable validators (e.g., developer-written test cases) for assistance. Since reliable test cases…

Software Engineering · Computer Science 2024-10-22 Mouxiang Chen , Zhongxin Liu , He Tao , Yusu Hong , David Lo , Xin Xia , Jianling Sun

Given samples from an unknown distribution $p$, is it possible to distinguish whether $p$ belongs to some class of distributions $\mathcal{C}$ versus $p$ being far from every distribution in $\mathcal{C}$? This fundamental question has…

Data Structures and Algorithms · Computer Science 2015-12-09 Jayadev Acharya , Constantinos Daskalakis , Gautam Kamath