English
Related papers

Related papers: Majorizing Measures for the Optimizer

200 papers

Gaussian processes can be considered as subsets of a standard Hilbert space, but the geometric understanding that would relate the size of a set with the size of its convex hull is still lacking. In this work, we adopt a geometric approach…

Probability · Mathematics 2022-08-09 Shih-Yu Chang

Let $X$ be a random variable with distribution function $F,$ and $X_{1},X_{2},...,X_{n}$ are independent copies of $X.$ Consider the order statistics $X_{i:n},$ $i=1,2,...,n$ and denote $F_{i:n}(x)=P\{X_{i:n}\leq x\}.$ Using majorization…

Statistics Theory · Mathematics 2011-09-02 Ismihan Bairamov

We study two empirical process of special structure: firstly, the centred multiplier process indexed by a class $F$, $f \to \left|\sum_{i=1}^N (\xi_i f(X_i) - \E \xi f)\right|$, where the i.i.d. multipliers $(\xi_i)_{i=1}^N$ need not be…

Probability · Mathematics 2015-10-05 Shahar Mendelson

We study the approximation of general multiobjective optimization problems with the help of scalarizations. Existing results state that multiobjective minimization problems can be approximated well by norm-based scalarizations. However, for…

Optimization and Control · Mathematics 2023-05-25 Stephan Helfrich , Arne Herzel , Stefan Ruzika , Clemens Thielen

The F-measure, which has originally been introduced in information retrieval, is nowadays routinely used as a performance metric for problems such as binary classification, multi-label classification, and structured output prediction.…

Machine Learning · Statistics 2015-03-09 Willem Waegeman , Krzysztof Dembczynski , Arkadiusz Jachnik , Weiwei Cheng , Eyke Hullermeier

Self-normalized processes are basic to many probabilistic and statistical studies. They arise naturally in the the study of stochastic integrals, martingale inequalities and limit theorems, likelihood-based methods in hypothesis testing and…

Probability · Mathematics 2009-09-29 Victor H. de la Peña , Michael J. Klass , Tze Leung Lai

Measurements are shown to be processes designed to return figures: they are effective. This effectivity allows for a formalization as Turing machines, which can be described employing computation theory. Inspired in the halting problem we…

Other Computer Science · Computer Science 2020-08-26 Aldo F. G. Solis-Labastida , Jorge G. Hirsch

The problem of minimizing a continuously differentiable convex function over an intersection of closed convex sets is ubiquitous in applied mathematics. It is particularly interesting when it is easy to project onto each separate set, but…

Optimization and Control · Mathematics 2014-08-06 Eric C. Chi , Hua Zhou , Kenneth Lange

We consider a generalization of the Bauer maximum principle. We work with tensorial products of convex measures sets, that are non necessarily compact but generated by their extreme points. We show that the maximum of a quasi-convex lower…

Probability · Mathematics 2020-10-09 Jerome Stenger , Fabrice Gamboa , Merlin Keller

This paper is devoted to investigation of supremum of averaged deviations $|X(t)-f(t)-\int_{\mathbb {T}}(X(u)-f(u))\,\mathrm {d}\mu(u)/\mu(\mathbb {T})|$ of a stochastic process from Orlicz space of random variables using the method of…

Probability · Mathematics 2016-11-21 Rostyslav Yamnenko

We present a primal-dual majorization-minimization method for solving large-scale linear programs. A smooth barrier augmented Lagrangian (SBAL) function with strict convexity for the dual linear program is derived. The…

Optimization and Control · Mathematics 2022-08-09 Xin-Wei Liu , Yu-Hong Dai , Ya-Kui Huang

Majorisation, also called rearrangement inequalities, yields a type of stochastic ordering in which two or more distributions can be compared. In this paper we argue that majorisation is a good candidate as a theory for uncertainty. We…

Statistics Theory · Mathematics 2021-06-17 Victoria Volodina , Nikki Sonenberg , Edward Wheatcroft , Henry Wynn

With the widespread adoption of machine learning systems, the need to curtail their behavior has become increasingly apparent. This is evidenced by recent advancements towards developing models that satisfy robustness, safety, and fairness…

Machine Learning · Computer Science 2024-03-19 Juan Elenter , Luiz F. O. Chamon , Alejandro Ribeiro

The superiorization methodology can be thought of as lying conceptually between feasibility-seeking and constrained minimization. It is not trying to solve the full-fledged constrained minimization problem composed from the modeling…

Optimization and Control · Mathematics 2023-01-02 Yair Censor

One of the principal scientific challenges in deep learning is explaining generalization, i.e., why the particular way the community now trains networks to achieve small training error also leads to small error on held-out data from the…

Modeled along the truncated approach in Panigrahi (2016), selection-adjusted inference in a Bayesian regime is based on a selective posterior. Such a posterior is determined together by a generative model imposed on data and the selection…

Methodology · Statistics 2017-09-12 Snigdha Panigrahi , Jonathan Taylor

The generic chaining method provides a sharp description of the suprema of many random processes in terms of the geometry of their index sets. The chaining functionals that arise in this theory are however notoriously difficult to control…

Probability · Mathematics 2018-06-22 Ramon van Handel

We develop a method to carry out MAP estimation for a class of Bayesian regression models in which coefficients are assigned with Gaussian-based spike and slab priors. The objective function in the corresponding optimization problem has a…

Methodology · Statistics 2012-11-26 Tso-Jung Yen

Concentration of measure is a phenomenon in which a random variable that depends in a smooth way on a large number of independent random variables is essentially constant. The random variable will "concentrate" around its median or…

Probability · Mathematics 2015-08-25 Meg Walters

Motivated by the need to uncover some underlying mathematical structure of optimal quantum computation, we carry out a systematic analysis of a wide variety of quantum algorithms from the majorization theory point of view. We conclude that…

Quantum Physics · Physics 2009-11-07 Roman Orus , Jose I. Latorre , Miguel A. Martin-Delgado