English
Related papers

Related papers: The Equivariance Criterion in a Linear Model for F…

200 papers

We develop a rotation-invariant neural network that provides the global minimum-variance portfolio by jointly learning how to lag-transform historical returns and marginal volatilities and how to regularise the eigenvalues of large equity…

Portfolio Management · Quantitative Finance 2026-04-22 Christian Bongiorno , Efstratios Manolakis , Rosario Nunzio Mantegna

Most machine learning techniques are based upon statistical learning theory, often simplified for the sake of computing speed. This paper is focused on the uncertainty aspect of mathematical modeling in machine learning. Regression analysis…

Machine Learning · Computer Science 2022-06-07 Valentin Arkov

A significant obstacle in the development of robust machine learning models is covariate shift, a form of distribution shift that occurs when the input distributions of the training and test sets differ while the conditional label…

Machine Learning · Statistics 2021-11-17 Nilesh Tripuraneni , Ben Adlam , Jeffrey Pennington

Variational regularization is commonly used to solve linear inverse problems, and involves augmenting a data fidelity by a regularizer. The regularizer is used to promote a priori information and is weighted by a regularization parameter.…

Optimization and Control · Mathematics 2024-01-23 Matthias J. Ehrhardt , Silvia Gazzola , Sebastian J. Scott

Fair calibration is a widely desirable fairness criteria in risk prediction contexts. One way to measure and achieve fair calibration is with multicalibration. Multicalibration constrains calibration error among flexibly-defined…

Machine Learning · Computer Science 2023-09-04 William La Cava , Elle Lett , Guangya Wan

This study explores the concept of equivariance in vision-language foundation models (VLMs), focusing specifically on the multimodal similarity function that is not only the major training objective but also the core delivery to support…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Tan Wang , Kevin Lin , Linjie Li , Chung-Ching Lin , Zhengyuan Yang , Hanwang Zhang , Zicheng Liu , Lijuan Wang

Geometric quantum machine learning uses the symmetries inherent in data to design tailored machine learning tasks with reduced search space dimension. The field has been well-studied recently in an effort to avoid barren plateau issues…

Quantum Physics · Physics 2025-07-14 Zachary P. Bradshaw , Ethan N. Evans , Matthew Cook , Margarite L. LaBorde

In this paper, we propose a model averaging approach for addressing model uncertainty in the context of partial linear functional additive models. These models are designed to describe the relation between a response and mixed-types of…

Methodology · Statistics 2023-06-12 Shishi Liu , Jingxiao Zhang

How can one meaningfully make a measurement, if the meter does not conform to any standard and its scale expands or shrinks depending on what is measured? In the present work it is argued that current evaluation practices for…

Machine Learning · Computer Science 2023-02-24 K. Dyrland , A. S. Lundervold , P. G. L. Porta Mana

In this paper, we present a sharp analysis for a class of alternating projected gradient descent algorithms which are used to solve the covariate adjusted precision matrix estimation problem in the high-dimensional setting. We demonstrate…

Information Theory · Computer Science 2022-01-13 Xiao Lv , Wei Cui , Yulong Liu

Invariant prediction uses the prediction stability of causal relationships across different environments to identify causal variables. Conversely, using causal variables gives prediction guarantees even in out-of-sample data settings. In…

Methodology · Statistics 2025-11-04 Lucas Kania , Ernst Wit

High-dimensional tests are applied to find relevant sets of variables and relevant models. If variables are selected by analyzing the sums of products matrices and a corresponding mean-value test is performed, there is the danger that the…

Methodology · Statistics 2012-02-10 Juergen Laeuter , Maciej Rosolowski , Ekkehard Glimm

Many classes of images exhibit rotational symmetry. Convolutional neural networks are sometimes trained using data augmentation to exploit this, but they are still required to learn the rotation equivariance properties from the data.…

Machine Learning · Computer Science 2016-05-27 Sander Dieleman , Jeffrey De Fauw , Koray Kavukcuoglu

It is common practice to collect observations of feature and response pairs from different environments. A natural question is how to identify features that have consistent prediction power across environments. The invariant causal…

Information Theory · Computer Science 2022-07-01 Austin Goddard , Yu Xiang , Ilya Soloveychik

In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of research into…

Unitary equivariance is a natural symmetry that occurs in many contexts in physics and mathematics. Optimization problems with such symmetry can often be formulated as semidefinite programs for a $d^{p+q}$-dimensional matrix variable that…

Quantum Physics · Physics 2025-01-07 Dmitry Grinko , Maris Ozols

Matrix valued data has become increasingly prevalent in many applications. Most of the existing clustering methods for this type of data are tailored to the mean model and do not account for the dependence structure of the features, which…

Machine Learning · Statistics 2023-12-07 Inbeom Lee , Siyi Deng , Yang Ning

We study prediction in the functional linear model with functional outputs : $Y=SX+\epsilon $ where the covariates $X$ and $Y$ belong to some functional space and $S$ is a linear operator. We provide the asymptotic mean square prediction…

Statistics Theory · Mathematics 2011-02-14 Christophe Crambes , André Mas

Mixture models are widely used in Bayesian statistics and machine learning, in particular in computational biology, natural language processing and many other fields. Variational inference, a technique for approximating intractable…

Statistics Theory · Mathematics 2020-08-03 Badr-Eddine Chérief-Abdellatif , Pierre Alquier

The theory of quasi-arithmetic means is a powerful tool in the study of covariance functions across space-time. In the present study we use quasi-arithmetic functionals to make inferences about the permissibility of averages of functions…

Probability · Mathematics 2007-06-13 E. Porcu , J. Mateu , G. Christakos