English
Related papers

Related papers: Topologically penalized regression on manifolds

200 papers

This paper is motivated by recent research in the $d$-dimensional stochastic linear bandit literature, which has revealed an unsettling discrepancy: algorithms like Thompson sampling and Greedy demonstrate promising empirical performance,…

Machine Learning · Computer Science 2025-05-20 Yuwei Luo , Mohsen Bayati

We consider the problem of inferring the unobserved edges of a graph from data supported on its nodes. In line with existing approaches, we propose a convex program for recovering a graph Laplacian that is approximately diagonalizable by a…

Signal Processing · Electrical Eng. & Systems 2020-10-16 T. Mitchell Roddenberry , Madeline Navarro , Santiago Segarra

We propose a globally-accelerated, first-order method for the optimization of smooth and (strongly or not) geodesically-convex functions in a wide class of Hadamard manifolds. We achieve the same convergence rates as Nesterov's accelerated…

Optimization and Control · Mathematics 2023-01-18 David Martínez-Rubio , Sebastian Pokutta

Decisions are increasingly taken by both humans and machine learning models. However, machine learning models are currently trained for full automation -- they are not aware that some of the decisions may still be taken by humans. In this…

Machine Learning · Computer Science 2021-03-16 Abir De , Nastaran Okati , Paramita Koley , Niloy Ganguly , Manuel Gomez-Rodriguez

In this paper we study the kernel multiple ridge regression framework, which we refer to as multi-task regression, using penalization techniques. The theoretical analysis of this problem shows that the key element appearing for an optimal…

Statistics Theory · Mathematics 2012-10-25 Matthieu Solnon , Sylvain Arlot , Francis Bach

In this article, model selection via penalized empirical loss minimization in nonparametric classification problems is studied. Data-dependent penalties are constructed, which are based on estimates of the complexity of a small subclass of…

Statistics Theory · Mathematics 2007-06-13 Gabor Lugosi , Marten Wegkamp

In this paper, we get estimates on the higher eigenvalues of the Dirac operator on locally reducible Riemannian manifolds, in terms of the eigenvalues of the Laplace-Beltrami operator and the scalar curvature. These estimates are sharp, in…

Differential Geometry · Mathematics 2018-10-09 Yongfa Chen

Penalties that induce smoothness are common in nonparametric regression. In many settings, the amount of smoothness in the data generating function will not be known. Simon and Shojaie (2021) derived convergence rates for nonparametric…

Statistics Theory · Mathematics 2023-08-04 Marlena S. Bannick , Noah Simon

We show that singular Riemannian foliations, or, more generally, manifold submetries, defined on a compact normal homogeneous space, have algebraic nature. Moreover, in this case there exists a one-to-one correspondence between algebras of…

Differential Geometry · Mathematics 2025-12-19 Samuel Lin , Ricardo A. E. Mendes , Marco Radeschi

Given i.i.d. observations uniformly distributed on a closed submanifold of the Euclidean space, we study higher-order generalizations of graph Laplacians, so-called Hodge Laplacians on graphs, as approximations of the Laplace-Beltrami…

Statistics Theory · Mathematics 2025-04-07 Jan-Paul Lerch , Martin Wahl

The paper is devoted to investigation of the spectrum of a perturbed Laplace-Beltrami operator on manifolds with closed geodesics of the same length and where metric is a perturbation of the metric of the unit sphere. As the result, we give…

Spectral Theory · Mathematics 2014-04-21 T. Zykova

Tensor linear regression is an important and useful tool for analyzing tensor data. To deal with high dimensionality, CANDECOMP/PARAFAC (CP) low-rank constraints are often imposed on the coefficient tensor parameter in the (penalized)…

Machine Learning · Statistics 2024-04-02 Ya Zhou , Raymond K. W. Wong , Kejun He

Modern multivariate machine learning and statistical methodologies estimate parameters of interest while leveraging prior knowledge of the association between outcome variables. The methods that do allow for estimation of relationships do…

Methodology · Statistics 2021-06-10 Ben Sherwood , Bradley S. Price

In the present paper we study some kinds of the problems for the bi-drifting Laplacian operator and get some sharp lower bounds for the first eigenvalue for these eigenvalue problems on compact manifolds with boundary (also called a smooth…

Differential Geometry · Mathematics 2019-03-19 Adriano Cavalcante Bezerra , Changyu Xia

In many problems in optimal control, one seeks to minimise an objective function subject to constraints on the velocity of the system. Imposing these constraints directly -- the ``hard-constrained'' approach -- is often analytically and…

Optimization and Control · Mathematics 2026-04-27 Rufus Lawrence , Aleš Wodecki , Johannes Aspman , Jakub Mareček

The manifold Helmholtzian (1-Laplacian) operator $\Delta_1$ elegantly generalizes the Laplace-Beltrami operator to vector fields on a manifold $\mathcal M$. In this work, we propose the estimation of the manifold Helmholtzian from point…

Machine Learning · Statistics 2023-11-01 Yu-Chia Chen , Weicheng Wu , Marina Meilă , Ioannis G. Kevrekidis

In this paper we study the statistical properties of Laplacian smoothing, a graph-based approach to nonparametric regression. Under standard regularity conditions, we establish upper bounds on the error of the Laplacian smoothing estimator…

Statistics Theory · Mathematics 2021-06-04 Alden Green , Sivaraman Balakrishnan , Ryan J. Tibshirani

Manifold learning methods play a prominent role in nonlinear dimensionality reduction and other tasks involving high-dimensional data sets with low intrinsic dimensionality. Many of these methods are graph-based: they associate a vertex…

Machine Learning · Computer Science 2021-11-16 Joe Kileel , Amit Moscovich , Nathan Zelesko , Amit Singer

Under a partially linear models we study a family of robust estimates for the regression parameter and the regression function when some of the predictor variables take values on a Riemannian manifold. We obtain the consistency and the…

Statistics Theory · Mathematics 2011-05-26 Guillermo Henry , Daniela Rodriguez

We consider a network topology design problem in which an initial undirected graph underlying the network is given and the objective is to select a set of edges to add to the graph to optimize the coherence of the resulting network. We show…

Optimization and Control · Mathematics 2014-11-19 Tyler Summers , Iman Shames , John Lygeros , Florian Dörfler