English
Related papers

Related papers: On the Optimal Boolean Function for Prediction und…

200 papers

We consider the function computation problem in a three node network with one encoder and two decoders. The encoder has access to two correlated sources $X$ and $Y$. The encoder encodes $X^n$ and $Y^n$ into a message which is given to two…

Information Theory · Computer Science 2016-10-05 Jithin Ravi , Bikash Kumar Dey

We study a controlled version of the Bayesian sequential testing problem for the drift of a Wiener process, in which the observer exercises discretion over the signal intensity. This control incurs a running cost that reflects the resource…

Optimization and Control · Mathematics 2025-09-24 Steven Campbell , Georgy Gaitsgori , Richard Groenewald

We consider bivariate observations $(X_1,Y_1), \ldots, (X_n,Y_n)$ such that, conditional on the $X_i$, the $Y_i$ are independent random variables with distribution functions $F_{X_i}$, where $(F_x)_x$ is an unknown family of distribution…

Statistics Theory · Mathematics 2020-09-09 Alexandre Mösching , Lutz Duembgen

The notion of omnipredictors (Gopalan, Kalai, Reingold, Sharan and Wieder ITCS 2021), suggested a new paradigm for loss minimization. Rather than learning a predictor based on a known loss function, omnipredictors can easily be…

Machine Learning · Computer Science 2023-02-17 Lunjia Hu , Inbal Livni-Navon , Omer Reingold , Chutong Yang

We consider a stochastic optimization problem involving two random variables: a context variable $X$ and a dependent variable $Y$. The objective is to minimize the expected value of a nonlinear loss functional applied to the conditional…

Optimization and Control · Mathematics 2026-03-16 Noel Smith , Andrzej Ruszczynski

We consider the problem of learning a loss function which, when minimized over a training dataset, yields a model that approximately minimizes a validation error metric. Though learning an optimal loss function is NP-hard, we present an…

Machine Learning · Computer Science 2019-07-02 Matthew Streeter

We consider two questions at the heart of machine learning; how can we predict if a minimum will generalize to the test set, and why does stochastic gradient descent find minima that generalize well? Our work responds to Zhang et al.…

Machine Learning · Computer Science 2018-02-16 Samuel L. Smith , Quoc V. Le

Data-driven control of nonlinear systems with rigorous guarantees is a challenging problem as it usually calls for nonconvex optimization and requires often knowledge of the true basis functions of the system dynamics. To tackle these…

Optimization and Control · Mathematics 2023-03-27 Tim Martin , Thomas B. Schön , Frank Allgöwer

In many security and healthcare systems a sequence of features/sensors/tests are used for detection and diagnosis. Each test outputs a prediction of the latent state, and carries with it inherent costs. Our objective is to {\it learn}…

Machine Learning · Computer Science 2016-10-19 Manjesh Hanawal , Csaba Szepesvari , Venkatesh Saligrama

We consider the transmission of nonexponentially many messages through a binary symmetric channel with noiseless feedback. We obtain an upper bound for the best decoding error exponent. Combined with the corresponding known lower bound,…

Information Theory · Computer Science 2022-10-14 Marat V. Burnashev

The statistical properties of nonlinear phase noise, often called the Gordon-Mollenauer effect, is studied analytically when the number of fiber spans is very large. The joint characteristic functions of the nonlinear phase noise with…

Optics · Physics 2007-05-23 Keang-Po Ho

In this article we study the asymptotic predictive optimality of a model selection criterion based on the cross-validatory predictive density, already available in the literature. For a dependent variable and associated explanatory…

Statistics Theory · Mathematics 2008-12-18 Arijit Chakrabarti , Tapas Samanta

We study stochastic programs where the decision-maker cannot observe the distribution of the exogenous uncertainties but has access to a finite set of independent samples from this distribution. In this setting, the goal is to find a…

Optimization and Control · Mathematics 2019-12-24 Bart P. G. Van Parys , Peyman Mohajerin Esfahani , Daniel Kuhn

We address the estimation of the loss parameter of a bosonic channel probed by arbitrary signals. Unlike the optimal Gaussian probes, which can attain the ultimate bound on precision asymptotically either for very small or very large…

Quantum Physics · Physics 2009-04-23 G. Adesso , F. Dell'Anno , S. De Siena , F. Illuminati , L. A. M. Souza

Multicalibration is a notion of fairness for predictors that requires them to provide calibrated predictions across a large set of protected groups. Multicalibration is known to be a distinct goal than loss minimization, even for simple…

Machine Learning · Computer Science 2023-12-11 Jarosław Błasiok , Parikshit Gopalan , Lunjia Hu , Adam Tauman Kalai , Preetum Nakkiran

This paper presents a finite difference quasi-Newton method for the minimization of noisy functions. The method takes advantage of the scalability and power of BFGS updating, and employs an adaptive procedure for choosing the differencing…

Optimization and Control · Mathematics 2019-01-09 Albert S. Berahas , Richard H. Byrd , Jorge Nocedal

In this article, we construct semiparametrically efficient estimators of linear functionals of a probability measure in the presence of side information using an easy empirical likelihood approach. We use estimated constraint functions and…

Methodology · Statistics 2023-03-01 Shan Wang , Hanxiang Peng

The paper studies a class of quadratic optimal control problems for partially observable linear dynamical systems. In contrast to the full information case, the control is required to be adapted to the filtration generated by the…

Optimization and Control · Mathematics 2022-03-01 Jingrui Sun , Jie Xiong

We asked GPT-5 Pro to look for counterexamples among a public list of open problems (the Simons ``Real Analysis in Computer Science'' collection). After several numerical experiments, it suggested a counterexample for the Non-Interactive…

Probability · Mathematics 2025-10-24 Paata Ivanisvili , Xinyuan Xie

A probability distribution over the Boolean cube is monotone if flipping the value of a coordinate from zero to one can only increase the probability of an element. Given samples of an unknown monotone distribution over the Boolean cube, we…

Data Structures and Algorithms · Computer Science 2020-02-11 Ronitt Rubinfeld , Arsen Vasilyan