English
Related papers

Related papers: Proper Generalized Decomposition for Nonlinear Con…

200 papers

In this paper, we consider the problem of learning high-dimensional tensor regression problems with low-rank structure. One of the core challenges associated with learning high-dimensional models is computation since the underlying…

Machine Learning · Statistics 2016-12-01 Han Chen , Garvesh Raskutti , Ming Yuan

We introduce two nonlinear sufficient dimension reduction methods for regressions with tensor-valued predictors. Our goal is two-fold: the first is to preserve the tensor structure when performing dimension reduction, particularly the…

Statistics Theory · Mathematics 2025-12-24 Dianjun Lin , Bing Li , Lingzhou Xue

With the advances in data acquisition technology, tensor objects are collected in a variety of applications including multimedia, medical and hyperspectral imaging. As the dimensionality of tensor objects is usually very high,…

Image and Video Processing · Electrical Eng. & Systems 2019-11-06 Seyyid Emre Sofuoglu , Selin Aviyente

The representer theorem is one of the most important mathematical foundations for regularised learning and kernel methods. Classical formulations of the theorem state sufficient conditions under which a regularisation problem on a Hilbert…

Functional Analysis · Mathematics 2019-11-04 Kevin Schlegel

Tensor decompositions, which represent an $N$-order tensor using approximately $N$ factors of much smaller dimensions, can significantly reduce the number of parameters. This is particularly beneficial for high-order tensors, as the number…

Machine Learning · Computer Science 2025-06-23 Zhen Qin , Michael B. Wakin , Zhihui Zhu

Tensor decomposition, a collection of factorization techniques for multidimensional arrays, are among the most general and powerful tools for scientific analysis. However, because of their increasing size, today's data sets require more…

Machine Learning · Computer Science 2020-03-11 Jeremy Charlier , Vladimir Makarenkov

This paper addresses Tikhonov like regularization methods with convex penalty functionals for solving nonlinear ill-posed operator equations formulated in Banach or, more general, topological spaces. We present an approach for proving…

Numerical Analysis · Mathematics 2009-06-19 Jens Geissler , Bernd Hofmann

Tensor decomposition is an effective approach to compress over-parameterized neural networks and to enable their deployment on resource-constrained hardware platforms. However, directly applying tensor compression in the training process is…

Machine Learning · Computer Science 2019-05-28 Cole Hawkins , Zheng Zhang

This paper establishes several new facts on generalized polyhedral convex sets and shows how they can be used in vector optimization. Among other things, a scalarization formula for the efficient solution sets of generalized vector…

Optimization and Control · Mathematics 2017-05-22 Nguyen Ngoc Luan

The Multiscale Hierarchical Decomposition Method (MHDM) was introduced as an iterative method for total variation regularization, with the aim of recovering details at various scales from images corrupted by additive or multiplicative…

Numerical Analysis · Mathematics 2023-09-28 Stefan Kindermann , Elena Resmerita , Tobias Wolf

Low-rank tensor approximation approaches have become an important tool in the scientific computing community. The aim is to enable the simulation and analysis of high-dimensional problems which cannot be solved using conventional methods…

Numerical Analysis · Mathematics 2019-02-26 Patrick Gelß , Stefan Klus , Sebastian Matera , Christof Schütte

We consider ill-posed linear operator equations with operators acting between Banach spaces. For solution approximation, the methods of choice here are projection methods onto finite dimensional subspaces, thus extending existing results…

Numerical Analysis · Mathematics 2016-04-26 Uno Hämarik , Barbara Kaltenbacher , Urve Kangro , Elena Resmerita

The tensor decomposition addressed in this paper may be seen as a generalisation of Singular Value Decomposition of matrices. We consider general multilinear and multihomogeneous tensors. We show how to reduce the problem to a truncated…

Algebraic Geometry · Mathematics 2012-10-17 Alessandra Bernardi , Jerome Brachat , Pierre Comon , Bernard Mourrain

In this work, we address three non-convex optimization problems associated with the training of shallow neural networks (NNs) for exact and approximate representation, as well as for regression tasks. Through a mean-field approach, we…

Machine Learning · Computer Science 2025-04-04 Kang Liu , Enrique Zuazua

In this paper, we propose a method for the approximation of the solution of high-dimensional weakly coercive problems formulated in tensor spaces using low-rank approximation formats. The method can be seen as a perturbation of a minimal…

Numerical Analysis · Mathematics 2015-02-13 Marie Billaud-Friess , Anthony Nouy , Olivier Zahm

Inverse problems are ubiquitous in nature, arising in almost all areas of science and engineering ranging from geophysics and climate science to astrophysics and biomechanics. One of the central challenges in solving inverse problems is…

Machine Learning · Statistics 2022-09-21 Dhruv V Patel , Deep Ray , Assad A Oberai

We propose and study a class of novel algorithms that aim at solving bilinear and quadratic inverse problems. Using a convex relaxation based on tensorial lifting, and applying first-order proximal algorithms, these problems could be solved…

Optimization and Control · Mathematics 2021-03-19 Robert Beinert , Kristian Bredies

Generative models have emerged as powerful priors for solving inverse problems. These models typically represent a class of natural signals using a single fixed complexity or dimensionality. This can be limiting: depending on the problem, a…

Machine Learning · Computer Science 2026-03-11 Sean Gunn , Jorio Cocola , Oliver De Candido , Vaggos Chatziafratis , Paul Hand

In numerous applications, binary reactions or event counts are observed and stored within high-order tensors. Tensor decompositions (TDs) serve as a powerful tool to handle such high-dimensional and sparse data. However, many traditional…

Machine Learning · Computer Science 2024-01-17 Zerui Tao , Toshihisa Tanaka , Qibin Zhao

The development of energy selective, photon counting X-ray detectors allows for a wide range of new possibilities in the area of computed tomographic image formation. Under the assumption of perfect energy resolution, here we propose a…

Computer Vision and Pattern Recognition · Computer Science 2015-06-16 Oguz Semerci , Ning Hao , Misha E. Kilmer , Eric L. Miller