English
Related papers

Related papers: Beyond Coordinates: Meta-Equivariance in Statistic…

200 papers

We define a class of "optimal" coordinate systems by requiring that the deviation from an exact Robertson-Walker metric is "as small as possible" within a given four dimensional volume. The optimization is performed by minimizing several…

General Relativity and Quantum Cosmology · Physics 2011-11-28 Dieter Gromes

This paper revisits a fundamental problem in statistical inference from a non-asymptotic theoretical viewpoint $\unicode{x2013}$ the construction of confidence sets. We establish a finite-sample bound for the estimator, characterizing its…

Statistics Theory · Mathematics 2023-01-03 Lang Liu , Zaid Harchaoui

Robust and distributionally robust optimization are modeling paradigms for decision-making under uncertainty where the uncertain parameters are only known to reside in an uncertainty set or are governed by any probability distribution from…

Optimization and Control · Mathematics 2023-07-21 Jianzhe Zhen , Daniel Kuhn , Wolfram Wiesemann

We develop an approach to risk minimization and stochastic optimization that provides a convex surrogate for variance, allowing near-optimal and computationally efficient trading between approximation and estimation error. Our approach…

Machine Learning · Statistics 2017-12-15 John Duchi , Hongseok Namkoong

This paper introduces a new way to calculate distance-based statistics, particularly when the data are multivariate. The main idea is to pre-calculate the optimal projection directions given the variable dimension, and to project…

Computation · Statistics 2019-11-11 Chuanping Yu , Xiaoming Huo

We study the problem of learning a directed acyclic graph from data generated according to an additive, non-linear structural equation model with Gaussian noise. We express each non-linear function through a basis expansion, and derive a…

Methodology · Statistics 2025-11-27 Xiaozhu Zhang , Nir Keret , Ali Shojaie , Armeen Taeb

Equivariance encodes known symmetries into neural networks, often enhancing generalization. However, equivariant networks cannot break symmetries: the output of an equivariant network must, by definition, have at least the same…

Machine Learning · Computer Science 2025-03-31 Hannah Lawrence , Vasco Portilheiro , Yan Zhang , Sékou-Oumar Kaba

This paper proposes a statistically optimal approach for learning a function value using a confidence interval in a wide range of models, including general non-parametric estimation of an expected loss described as a stochastic programming…

Machine Learning · Statistics 2025-08-07 Arnab Ganguly , Tobias Sutter

Units equivariance (or units covariance) is the exact symmetry that follows from the requirement that relationships among measured quantities of physics relevance must obey self-consistent dimensional scalings. Here, we express this…

Machine Learning · Statistics 2023-06-26 Soledad Villar , Weichi Yao , David W. Hogg , Ben Blum-Smith , Bianca Dumitrascu

In this chapter, we identify fundamental geometric structures that underlie the problems of sampling, optimisation, inference and adaptive decision-making. Based on this identification, we derive algorithms that exploit these geometric…

The pathwise coordinate optimization is one of the most important computational frameworks for high dimensional convex and nonconvex sparse learning problems. It differs from the classical coordinate optimization algorithms in three salient…

Machine Learning · Statistics 2017-06-06 Tuo Zhao , Han Liu , Tong Zhang

This work investigates the finite-horizon optimal covariance steering problem for discrete-time linear systems subject to both additive and multiplicative uncertainties as well as state and input chance constraints. In particular, a…

Optimization and Control · Mathematics 2023-01-19 Jacob Knaup , Panagiotis Tsiotras

Artificial Neural Networks (ANN) comprise important symmetry properties, which can influence the performance of Monte Carlo methods in Neuroevolution. The problem of the symmetries is also known as the competing conventions problem or…

Neural and Evolutionary Computing · Computer Science 2011-07-25 Onay Urfalioglu , Orhan Arikan

We consider stochastic variational inequality problems where the mapping is monotone over a compact convex set. We present two robust variants of stochastic extragradient algorithms for solving such problems. Of these, the first scheme…

Optimization and Control · Mathematics 2014-03-25 Farzad Yousefian , Angelia Nedic , Uday V. Shanbhag

When both the difference between two quantities and their individual values can be measured or computational predicted, multiple quantities can be determined from the measurements or predictions of select individual quantities and select…

Methodology · Statistics 2021-12-24 Huafeng Xu

Maximizing the precision in estimating parameters in a quantum system subject to instrumentation constraints is cast as a convex optimization problem. We account for prior knowledge about the parameter range by developing a worst-case and…

Quantum Physics · Physics 2008-04-01 Robert L. Kosut

Statistical modeling of spatiotemporal phenomena often requires selecting a covariance matrix from a covariance class. Yet standard parametric covariance families can be insufficiently flexible for practical applications, while…

Computation · Statistics 2020-12-24 Antoni Musolas , Steven T. Smith , Youssef Marzouk

We study over a number field, the iterates of automorphisms of the affine space. More precisely, we are interested in the periodic and non-periodic points; for the former the questions are similar to the ones about torsion points on abelian…

Number Theory · Mathematics 2009-09-29 Sandra Marcello

Many quantities we are interested in predicting are geometric tensors; we refer to this class of problems as geometric prediction. Attempts to perform geometric prediction in real-world scenarios have been limited to approximating them…

Machine Learning · Computer Science 2020-06-26 Raphael J. L. Townshend , Brent Townshend , Stephan Eismann , Ron O. Dror

We introduce a new sparse estimator of the covariance matrix for high-dimensional models in which the variables have a known ordering. Our estimator, which is the solution to a convex optimization problem, is equivalently expressed as an…

Statistics Theory · Mathematics 2014-05-27 Jacob Bien , Florentina Bunea , Luo Xiao