English
Related papers

Related papers: Multiscale analysis via pseudo-reversing and appli…

200 papers

We address the problem of approximating an unknown function from its discrete samples given at arbitrarily scattered sites. This problem is essential in numerical sciences, where modern applications also highlight the need for a solution to…

Numerical Analysis · Mathematics 2023-05-16 Nir Sharon , Rafael Sherbu Cohen , Holger Wendland

Deep learning models with a large number of parameters, often referred to as over-parameterized models, have achieved exceptional performance across various tasks. Despite concerns about overfitting, these models frequently generalize well…

Machine Learning · Computer Science 2025-06-10 Ilya Kaufman Sirot , Omri Azencot

We consider the topic of multivariate regression on manifold-valued output, that is, for a multivariate observation, its output response lies on a manifold. Moreover, we propose a new regression model to deal with the presence of grossly…

Machine Learning · Statistics 2017-09-12 Xiaowei Zhang , Xudong Shi , Yu Sun , Li Cheng

Image reconstruction under multiple light scattering is crucial in a number of applications such as diffraction tomography. The reconstruction problem is often formulated as a nonconvex optimization, where a nonlinear measurement model is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Yu Sun , Zhihao Xia , Ulugbek S. Kamilov

We propose and show the efficacy of a new method to address generic inverse problems. Inverse modeling is the task whereby one seeks to determine the control parameters of a natural system that produce a given set of observed measurements.…

Machine Learning · Computer Science 2023-08-15 Gregory P. Spell , Simiao Ren , Leslie M. Collins , Jordan M. Malof

In the last decades the Moore-Penrose pseudoinverse has found a wide range of applications in many areas of Science and became a useful tool for physicists dealing, for instance, with optimization problems, with data analysis, with the…

Mathematical Physics · Physics 2015-06-03 J. C. A. Barata , M. S. Hussein

Representation learning plays a critical role in the analysis of time series data and has high practical value across a wide range of applications. including trend analysis, time series data retrieval and forecasting. In practice, data…

Machine Learning · Computer Science 2023-12-13 Chengyang Ye , Qiang Ma

Many approaches in the field of machine learning and data analysis rely on the assumption that the observed data lies on lower-dimensional manifolds. This assumption has been verified empirically for many real data sets. To make use of this…

Machine Learning · Computer Science 2022-09-27 Erik Thordsen , Erich Schubert

Inversion of operators is a fundamental concept in data processing. Inversion of linear operators is well studied, supported by established theory. When an inverse either does not exist or is not unique, generalized inverses are used. Most…

Statistics Theory · Mathematics 2024-04-02 Eyal Gofer , Guy Gilboa

Normal multi-scale transform [4] is a nonlinear multi-scale transform for representing geometric objects that has been recently investigated [1, 7, 10]. The restrictive role of the exact order of polynomial reproduction $P_e$ of the…

Numerical Analysis · Mathematics 2013-11-19 Stanislav Harizanov

Transformers have achieved great success in effectively processing sequential data such as text. Their architecture consisting of several attention and feedforward blocks can model relations between elements of a sequence in parallel…

Machine Learning · Computer Science 2025-02-20 Jaemu Heo , Eldor Fozilov , Hyunmin Song , Taehwan Kim

We introduce a novel diffusion-based spectral algorithm to tackle regression analysis on high-dimensional data, particularly data embedded within lower-dimensional manifolds. Traditional spectral algorithms often fall short in such…

Machine Learning · Statistics 2024-10-21 Weichun Xia , Jiaxin Jiang , Lei Shi

The widespread use of multisensor technology and the emergence of big datasets have created the need to develop tools to reduce, approximate, and classify large and multimodal data such as higher-order tensors. While early approaches…

Numerical Analysis · Computer Science 2018-07-03 Alp Ozdemir , Ali Zare , Mark A. Iwen , Selin Aviyente

In the present work, we demonstrate how the pseudoinverse concept from linear algebra can be used to represent and analyze the boundary conditions of linear systems of partial differential equations. This approach has theoretical and…

Numerical Analysis · Mathematics 2024-01-05 Pelle Olsson

We consider the problem of estimating a signal from noisy circularly-translated versions of itself, called multireference alignment (MRA). One natural approach to MRA could be to estimate the shifts of the observations first, and infer the…

Information Theory · Computer Science 2018-02-14 Tamir Bendory , Nicolas Boumal , Chao Ma , Zhizhen Zhao , Amit Singer

We adapt a manifold sampling algorithm for the nonsmooth, nonconvex formulations of learning that arise when imposing robustness to outliers present in the training data. We demonstrate the approach on objectives based on trimmed loss.…

Optimization and Control · Mathematics 2018-07-10 Matt Menickelly , Stefan M. Wild

Low-rank structures play important role in recent advances of many problems in image science and data science. As a natural extension of low-rank structures for data with nonlinear structures, the concept of the low-dimensional manifold…

Computer Vision and Pattern Recognition · Computer Science 2017-02-10 Rongjie Lai , Jia Li

Supervised manifold learning methods learn data representations by preserving the geometric structure of data while enhancing the separation between data samples from different classes. In this work, we propose a theoretical study of…

Machine Learning · Computer Science 2018-01-08 Elif Vural , Christine Guillemot

We present a novel multiscale framework for analyzing sequences of probability measures in Wasserstein spaces over Euclidean domains. Exploiting the intrinsic geometry of optimal transport, we construct a multiscale transform applicable to…

Numerical Analysis · Mathematics 2026-04-13 Wael Mattar , Nir Sharon

It is often possible to perform reduced order modelling by specifying linear subspace which accurately captures the dynamics of the system. This approach becomes especially appealing when linear subspace explicitly depends on parameters of…

Machine Learning · Computer Science 2026-04-17 Vladimir Fanaskov , Vladislav Trifonov , Alexander Rudikov , Ekaterina Muravleva , Ivan Oseledets