English
Related papers

Related papers: Inference in a class of optimization problems: Con…

200 papers

The vast majority of theoretical results in machine learning and statistics assume that the available training data is a reasonably reliable reflection of the phenomena to be learned or estimated. Similarly, the majority of machine learning…

Machine Learning · Computer Science 2017-06-13 Moses Charikar , Jacob Steinhardt , Gregory Valiant

Survey sampling is concerned with the estimation of finite population parameters. In practice, survey data suffer from item nonresponse, which is commonly handled through imputation, i.e., replacing missing values with predicted values. As…

Methodology · Statistics 2026-03-06 Ziming An , Mehdi Dagdoug , David Haziza

There is a recent proliferation of research on the integration of machine learning and optimization. One expansive area within this research stream is predictive-model embedded optimization, which proposes the use of pre-trained predictive…

Machine Learning · Computer Science 2022-10-20 Chenbo Shi , Mohsen Emadikhiav , Leonardo Lozano , David Bergman

Semisupervised methods are techniques for using labeled data $(X_1,Y_1),\ldots,(X_n,Y_n)$ together with unlabeled data $X_{n+1},\ldots,X_N$ to make predictions. These methods invoke some assumptions that link the marginal distribution $P_X$…

Statistics Theory · Mathematics 2013-05-27 Martin Azizyan , Aarti Singh , Larry Wasserman

This paper considers an empirical likelihood inference for parameters defined by general estimating equations, when data are missing at random. The efficiency of existing estimators depends critically on correctly specifying the conditional…

Methodology · Statistics 2016-12-06 Tianqing Liu , Xiaohui Yuan , Zhaohai Li , Aiyi Liu

Semiparametric inference on average causal effects from observational data is based on assumptions yielding identification of the effects. In practice, several distinct identifying assumptions may be plausible; an analyst has to make a…

Methodology · Statistics 2025-10-07 Tetiana Gorbach , Xavier de Luna , Juha Karvanen , Ingeborg Waernbaum

Causal inference is a critical research topic across many domains, such as statistics, computer science, education, public policy and economics, for decades. Nowadays, estimating causal effect from observational data has become an appealing…

Methodology · Statistics 2020-02-10 Liuyi Yao , Zhixuan Chu , Sheng Li , Yaliang Li , Jing Gao , Aidong Zhang

We show that the way inference is performed in few-shot segmentation tasks has a substantial effect on performances -- an aspect often overlooked in the literature in favor of the meta-learning paradigm. We introduce a transductive…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Malik Boudiaf , Hoel Kervadec , Ziko Imtiaz Masud , Pablo Piantanida , Ismail Ben Ayed , Jose Dolz

The No Unmeasured Confounding Assumption is widely used to identify causal effects in observational studies. Recent work on proximal inference has provided alternative identification results that succeed even in the presence of unobserved…

Machine Learning · Statistics 2022-10-17 Benjamin Kompa , David R. Bellamy , Thomas Kolokotrones , James M. Robins , Andrew L. Beam

Penalized estimation principle is fundamental to high-dimensional problems. In the literature, it has been extensively and successfully applied to various models with only structural parameters. As a contrast, in this paper, we apply this…

Statistics Theory · Mathematics 2017-08-03 Jianqing Fan , Runlong Tang , Xiaofeng Shi

This paper presents robust inference methods for general linear hypotheses in linear panel data models with latent group structure in the coefficients. We employ a selective conditional inference approach, deriving the conditional…

Econometrics · Economics 2025-11-25 Oguzhan Akgun , Ryo Okui

A number of algorithms have been developed to solve probabilistic inference problems on belief networks. These algorithms can be divided into two main groups: exact techniques which exploit the conditional independence revealed when the…

Artificial Intelligence · Computer Science 2013-04-08 Ross D. Shachter , Mark Alan Peot

In this paper, an optimization problem with uncertain constraint coefficients is considered. Possibility theory is used to model the uncertainty. Namely, a joint possibility distribution in constraint coefficient realizations, called…

Optimization and Control · Mathematics 2023-09-07 Romain Guillaume , Adam Kasperski , Pawel Zielinski

Simulation-based inference enables learning the parameters of a model even when its likelihood cannot be computed in practice. One class of methods uses data simulated with different parameters to infer models of the likelihood-to-evidence…

Machine Learning · Computer Science 2022-06-08 Giulio Isacchini , Natanael Spisak , Armita Nourmohammad , Thierry Mora , Aleksandra M. Walczak

Modern large-scale statistical models require to estimate thousands to millions of parameters. This is often accomplished by iterative algorithms such as gradient descent, projected gradient descent or their accelerated versions. What are…

Machine Learning · Statistics 2020-03-04 Michael Celentano , Andrea Montanari , Yuchen Wu

This paper addresses the challenge of identifying a minimal subset of discrete, independent variables that best predicts a binary class. We propose an efficient iterative method that sequentially selects variables based on which one…

Computation · Statistics 2025-11-03 María del Carmen Romero , Mariana del Fresno , Alejandro Clausse

The partial monitoring (PM) framework provides a theoretical formulation of sequential learning problems with incomplete feedback. On each round, a learning agent plays an action while the environment simultaneously chooses an outcome. The…

Machine Learning · Computer Science 2024-05-17 Maxime Heuillet , Ola Ahmad , Audrey Durand

Data-driven risk analysis involves the inference of probability distributions from measured or simulated data. In the case of a highly reliable system, such as the electricity grid, the amount of relevant data is often exceedingly limited,…

Methodology · Statistics 2017-07-11 Simon H. Tindemans , Goran Strbac

We propose a general semi-supervised inference framework focused on the estimation of the population mean. As usual in semi-supervised settings, there exists an unlabeled sample of covariate vectors and a labeled sample consisting of…

Methodology · Statistics 2018-08-15 Anru Zhang , Lawrence D. Brown , T. Tony Cai

Fixed effect estimators of nonlinear panel data models suffer from the incidental parameter problem. This leads to two undesirable consequences in applied research: (1) point estimates are subject to large biases, and (2) confidence…

Econometrics · Economics 2022-04-18 Shuowen Chen