English
Related papers

Related papers: Projection matrices and the sweep operator

200 papers

This article surveys the mathematics of the cut and project method as applied to point sets, called here {\em model sets}. It covers the geometric, arithmetic, and analytical sides of this theory as well as diffraction and the connection…

Metric Geometry · Mathematics 2007-05-23 Robert V. Moody

Self-attention is essential to Transformer architectures, yet how information is embedded in the self-attention matrices and how different objective functions impact this process remains unclear. We present a mathematical framework to…

Machine Learning · Computer Science 2025-06-04 Matteo Saponati , Pascal Sager , Pau Vilimelis Aceituno , Thilo Stadelmann , Benjamin Grewe

This commentary proposes a framework for understanding the role of statistics in policy-making, regulation, and bureaucratic systems. I introduce the concept of "ex ante policy," describing statistical rules and procedures designed before…

Other Statistics · Statistics 2025-01-08 Benjamin Recht

The Mat\'ern model has been a cornerstone of spatial statistics for more than half a century. More recently, the Mat\'ern model has been central to disciplines as diverse as numerical analysis, approximation theory, computational…

Statistics Theory · Mathematics 2023-03-07 Emilio Porcu , Moreno Bevilacqua , Robert Schaback , Chris J. Oates

Manipulation planning is the task of computing robot trajectories that move a set of objects to their target configuration while satisfying physically feasibility. In contrast to existing works that assume known object templates, we are…

Robotics · Computer Science 2019-09-17 Wei Gao , Russ Tedrake

This paper analyzes the convergence for a large class of Riemannian stochastic approximation (SA) schemes, which aim at tackling stochastic optimization problems. In particular, the recursions we study use either the exponential map of the…

Machine Learning · Statistics 2021-05-20 Alain Durmus , Pablo Jiménez , Éric Moulines , Salem Said , Hoi-To Wai

We investigate the techniques and ideas used in the convergence analysis of two proximal ADMM algorithms for solving convex optimization problems involving compositions with linear operators. Besides this, we formulate a variant of the ADMM…

Optimization and Control · Mathematics 2019-12-20 Sebastian Banert , Radu Ioan Bot , Ernö Robert Csetnek

Data annotation using visual inspection (supervision) of each training sample can be laborious. Interactive solutions alleviate this by helping experts propagate labels from a few supervised samples to unlabeled ones based solely on the…

The aim of this paper is to deepen the convergence analysis of the scaled gradient projection (SGP) method, proposed by Bonettini et al. in a recent paper for constrained smooth optimization. The main feature of SGP is the presence of a…

Numerical Analysis · Mathematics 2015-09-10 Silvia Bonettini , Marco Prato

For a tall $n\times d$ matrix $A$ and a random $m\times n$ sketching matrix $S$, the sketched estimate of the inverse covariance matrix $(A^\top A)^{-1}$ is typically biased: $E[(\tilde A^\top\tilde A)^{-1}]\ne(A^\top A)^{-1}$, where…

Data Structures and Algorithms · Computer Science 2021-07-13 Michał Dereziński , Zhenyu Liao , Edgar Dobriban , Michael W. Mahoney

Training deep learning neural networks often requires massive amounts of computational ressources. We propose to sequentially monitor network predictions to trigger retraining only if the predictions are no longer valid. This can reduce…

Statistics Theory · Mathematics 2026-01-30 Ansgar Steland

Due to its amazing three-dimensional effects, holography is a very motivating, yet very demanding subject for physics classes at the upper level in school. For this reason an instruction unit on holography that supplement holographic…

Physics Education · Physics 2007-05-23 Martin Erik Horn , Helmut F. Mikelskis

Seeking informative projecting directions has been an important task in utilizing sliced Wasserstein distance in applications. However, finding these directions usually requires an iterative optimization procedure over the space of…

Machine Learning · Statistics 2022-09-26 Khai Nguyen , Nhat Ho

Sequence comparison is a basic task to capture similarities and differences between two or more sequences of symbols, with countless applications such as in computational biology. An alignment is a way to compare sequences, where a giving…

Discrete Mathematics · Computer Science 2023-03-16 Eloi Araujo , Fábio V. Martinez , Carlos H. A. Higa , José Soares

We introduce a new approach to prediction in graphical models with latent-shift adaptation, i.e., where source and target environments differ in the distribution of an unobserved confounding latent variable. Previous work has shown that as…

Machine Learning · Statistics 2023-06-26 William I. Walker , Arthur Gretton , Maneesh Sahani

Probabilistic programs provide an expressive representation language for generative models. Given a probabilistic program, we are interested in the task of posterior inference: estimating a latent variable given a set of observed variables.…

Machine Learning · Computer Science 2022-09-01 Mike Wu , Noah Goodman

With the rapid rise of generative AI in higher education and the unreliability of current AI detection tools, developing policies that encourage student learning and critical thinking has become increasingly important. This study examines…

Artificial Intelligence · Computer Science 2025-09-18 Hannah Klawa , Shraddha Rajpal , Cigole Thomas

Diffusion Probabilistic Models (DPMs) have achieved strong generative performance, yet their inductive biases remain largely implicit. In this work, we aim to build inductive biases into the training and sampling of diffusion models to…

Machine Learning · Computer Science 2025-12-11 Luca Scimeca , Thomas Jiralerspong , Berton Earnshaw , Jason Hartford , Yoshua Bengio

A numerical description of an algebraic subvariety of projective space is given by a general linear section, called a witness set. For a subvariety of a product of projective spaces (a multiprojective variety), the corresponding numerical…

Algebraic Geometry · Mathematics 2020-04-30 Jonathan D. Hauenstein , Anton Leykin , Jose Israel Rodriguez , Frank Sottile

Operator learning has emerged as a powerful tool in scientific computing for approximating mappings between infinite-dimensional function spaces. A primary application of operator learning is the development of surrogate models for the…

Machine Learning · Statistics 2025-04-07 Unique Subedi , Ambuj Tewari