English
Related papers

Related papers: Statistics with Set-Valued Functions: Applications…

200 papers

We suggest two nonparametric approaches, based on kernel methods and orthogonal series to estimating regression functions in the presence of instrumental variables. For the first time in this class of problems, we derive optimal convergence…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Joel L. Horowitz

Inconsistent values are commonly encountered in real-world applications, which can negatively impact data analysis and decision-making. While existing research primarily focuses on identifying the smallest removal set to resolve…

Data Structures and Algorithms · Computer Science 2025-12-23 Haoda Li , Jiahui Chen , Yu Sun , Shaoxu Song , Haiwei Zhang , Xiaojie Yuan

Since the seminal papers by Giannessi, an interesting topic in vector optimization has been the characterization of (weak) efficiency thorough Minty and Stampacchia type variational inequalities. Several results have been proved to extend…

Optimization and Control · Mathematics 2016-12-02 Giovanni P. Crespi , Carola Schrage

In this document, we aim to gather various results related to a compositional/categorical approach to rigorous Statistical Mechanics. Rigorous Statistical Mechanics is centered on the mathematical study of statistical systems. Central…

Mathematical Physics · Physics 2024-03-26 Grégoire Sergeant-Perthuis

Variance reduction is a family of powerful mechanisms for stochastic optimization that appears to be helpful in many machine learning tasks. It is based on estimating the exact gradient with some recursive sequences. Previously, many papers…

Optimization and Control · Mathematics 2025-11-07 Aleksandr Shestakov , Valery Parfenov , Aleksandr Beznosikov

Vectorization is a technique that replaces a set-valued optimization problem with a vector optimization problem. In this work, by using an extension of Gerstewitz function [1], a vectorizing function is defined to replace a given set-valued…

Optimization and Control · Mathematics 2017-06-09 Emrah Karaman , İlknur Atasever Güvenç , Mustafa Soyertem , Didem Tozkan , Mahide Küçük , Yalçın Küçük

Aligning partially overlapping point sets where there is no prior information about the value of the transformation is a challenging problem in computer vision. To achieve this goal, we first reduce the objective of the robust point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Wei Lian , WangMeng Zuo , Lei Zhang

Evaluating performance across optimization algorithms on many problems presents a complex challenge due to the diversity of numerical scales involved. Traditional data processing methods, such as hypothesis testing and Bayesian inference,…

Optimization and Control · Mathematics 2024-09-10 Yunpeng Jinng , Qunfeng Liu

It has been found that stochastic algorithms often find good solutions much more rapidly than inherently-batch approaches. Indeed, a very useful rule of thumb is that often, when solving a machine learning problem, an iterative technique…

Machine Learning · Computer Science 2013-08-19 Andrew Cotter

Approximations of functions with finite data often do not respect certain "structural" properties of the functions. For example, if a given function is non-negative, a polynomial approximation of the function is not necessarily also…

Numerical Analysis · Mathematics 2020-08-20 Vidhi Zala , Robert M. Kirby , Akil Narayan

Uncertainty in the estimation of the causal effect in observational studies is often due to unmeasured confounding, i.e., the presence of unobserved covariates linking treatments and outcomes. Instrumental Variables (IV) are commonly used…

Methodology · Statistics 2019-07-30 M. Usaid Awan , Yameng Liu , Marco Morucci , Sudeepa Roy , Cynthia Rudin , Alexander Volfovsky

Conformal prediction provides a principled framework for constructing predictive sets with finite-sample validity. While much of the focus has been on univariate response variables, existing multivariate methods either impose rigid…

Machine Learning · Statistics 2026-03-19 Sacha Braun , Liviu Aolaritei , Michael I. Jordan , Francis Bach

We consider the task of constructing a data structure for associating a static set of keys with values, while allowing arbitrary output values for queries involving keys outside the set. Compared to hash tables, these so-called static…

Data Structures and Algorithms · Computer Science 2026-05-20 Stefan Hermann , Hans-Peter Lehmann , Giorgio Vinciguerra , Stefan Walzer

In this paper, we propose a generic framework for devising an adaptive approximation scheme for value function approximation in reinforcement learning, which introduces multiscale approximation. The two basic ingredients are multiresolution…

Machine Learning · Computer Science 2019-08-26 Tao Li , Quanyan Zhu

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

We consider stochastic optimization problems with the dual tasks of (i) effectively finding the optimizer and (ii) reliably conducting statistical inference for the optimal objective function value. We find that classical simulation…

Methodology · Statistics 2025-09-15 Yuhang Wu , Zeyu Zheng , Yingfei Wang , Guangyu Zhang , Zuohua Zhang , Chu Wang

The paper is about developing a solver for maximizing a real-valued function of binary variables. The solver relies on an algorithm that estimates the optimal objective-function value of instances from the underlying distribution of…

Machine Learning · Computer Science 2025-11-05 Nimrod Megiddo , Segev Wasserkrug , Orit Davidovich , Shimrit Shtern

Optimization of convex functions subject to eigenvalue constraints is intriguing because of peculiar analytical properties of eigenvalues, and is of practical interest because of wide range of applications in fields such as structural…

Numerical Analysis · Mathematics 2013-10-08 Emre Mengi

We propose a new approach to linear ill-posed inverse problems. Our algorithm alternates between enforcing two constraints: the measurements and the statistical correlation structure in some transformed space. We use a non-linear multiscale…

Computational Engineering, Finance, and Science · Computer Science 2018-12-04 Ivan Dokmanić , Joan Bruna , Stéphane Mallat , Maarten de Hoop

Set-functions appear in many areas of computer science and applied mathematics, such as machine learning, computer vision, operations research or electrical networks. Among these set-functions, submodular functions play an important role,…

Machine Learning · Computer Science 2010-11-17 Francis Bach