English
Related papers

Related papers: On Nonlinear Dimensionality Reduction, Linear Smoo…

200 papers

This paper introduces a smoothed proximal Lagrangian method for minimizing a nonconvex smooth function over a convex domain with additional explicit convex nonlinear constraints. Two key features are 1) the proposed method is single-looped,…

Optimization and Control · Mathematics 2024-08-28 Wenqiang Pu , Kaizhao Sun , Jiawei Zhang

We introduce and develop a novel approach to outlier detection based on adaptation of random subspace learning. Our proposed method handles both high-dimension low-sample size and traditional low-dimensional high-sample size datasets.…

Machine Learning · Statistics 2015-05-05 Bohan Liu , Ernest Fokoue

The recovery of the intrinsic geometric structures of data collections is an important problem in data analysis. Supervised extensions of several manifold learning approaches have been proposed in the recent years. Meanwhile, existing…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Cem Ornek , Elif Vural

Neural networks (NNs) have gained significant attention across various engineering disciplines, particularly in design optimization, where they are used to build surrogate models for high-dimensional regression problems. Despite their power…

Computational Engineering, Finance, and Science · Computer Science 2026-03-30 Timm Gödde , Eisso H. Atzema , Bojana Rosić

The evaluation and treatment of acute cerebral ischemia requires a technique that can determine the total area of tissue at risk for infarction using diagnostic magnetic resonance imaging (MRI) sequences. Typical MRI data sets consist of…

Computer Vision and Pattern Recognition · Computer Science 2016-06-14 Vishwa S. Parekh , Jeremy R. Jacobs , Michael A. Jacobs

Originally introduced in the fluid mechanics community, dynamic mode decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of nonlinear systems. However, existing DMD theory deals primarily with sequential time…

Numerical Analysis · Mathematics 2014-12-17 Jonathan H. Tu , Clarence W. Rowley , Dirk M. Luchtenburg , Steven L. Brunton , J. Nathan Kutz

We develop a novel framework to study smooth and strongly convex optimization algorithms, both deterministic and stochastic. Focusing on quadratic functions we are able to examine optimization algorithms as a recursive application of linear…

Optimization and Control · Mathematics 2015-03-25 Yossi Arjevani , Shai Shalev-Shwartz , Ohad Shamir

In this thesis we develop a novel framework to study smooth and strongly convex optimization algorithms, both deterministic and stochastic. Focusing on quadratic functions we are able to examine optimization algorithms as a recursive…

Optimization and Control · Mathematics 2014-10-24 Yossi Arjevani

Using nonlinear projections and preserving structure in model order reduction (MOR) are currently active research fields. In this paper, we provide a novel differential geometric framework for model reduction on smooth manifolds, which…

Numerical Analysis · Mathematics 2024-04-03 Patrick Buchfink , Silke Glas , Bernard Haasdonk , Benjamin Unger

Nonnegative Tucker decomposition (NTD) is a powerful tool for the extraction of nonnegative parts-based and physically meaningful latent components from high-dimensional tensor data while preserving the natural multilinear structure of…

Machine Learning · Computer Science 2015-09-17 Guoxu Zhou , Andrzej Cichocki , Qibin Zhao , Shengli Xie

Supervised manifold learning methods learn data representations by preserving the geometric structure of data while enhancing the separation between data samples from different classes. In this work, we propose a theoretical study of…

Machine Learning · Computer Science 2018-01-08 Elif Vural , Christine Guillemot

This paper provides a new avenue for exploiting deep neural networks to improve physics-based simulation. Specifically, we integrate the classic Lagrangian mechanics with a deep autoencoder to accelerate elastic simulation of deformable…

Machine Learning · Computer Science 2021-02-23 Siyuan Shen , Yang Yin , Tianjia Shao , He Wang , Chenfanfu Jiang , Lei Lan , Kun Zhou

In deep learning, processing multidimensional inputs (e.g., images, medical scans, and time series) is an important task that often requires flattening the inputs. We introduce $\mathit{NdLinear}$, a drop-in replacement for linear layers…

We present a novel approach for learning nonlinear dynamic models, which leads to a new set of tools capable of solving problems that are otherwise difficult. We provide theory showing this new approach is consistent for models with long…

Artificial Intelligence · Computer Science 2009-06-03 John Langford , Ruslan Salakhutdinov , Tong Zhang

The reduction of Hamiltonian systems aims to build smaller reduced models, valid over a certain range of time and parameters, in order to reduce computing time. By maintaining the Hamiltonian structure in the reduced model, certain…

Numerical Analysis · Mathematics 2024-09-17 Raphaël Côte , Emmanuel Franck , Laurent Navoret , Guillaume Steimer , Vincent Vigon

A variance reduction technique in nonparametric smoothing is proposed: at each point of estimation, form a linear combination of a preliminary estimator evaluated at nearby points with the coefficients specified so that the asymptotic bias…

Statistics Theory · Mathematics 2007-08-22 Ming-Yen Cheng , Liang Peng , Jyh-Shyang Wu

LiDAR-based localization and mapping is one of the core components in many modern robotic systems due to the direct integration of range and geometry, allowing for precise motion estimation and generation of high quality maps in real-time.…

Robotics · Computer Science 2022-08-02 Julian Nubert , Etienne Walther , Shehryar Khattak , Marco Hutter

Dynamical systems theory has long provided a foundation for understanding evolving phenomena across scientific domains. Yet, the application of this theory to complex real-world systems remains challenging due to issues in mathematical…

Machine Learning · Computer Science 2024-11-05 Samuel A. Moore , Brian P. Mann , Boyuan Chen

Dimensionality reduction is a fundamental task in modern data science. Several projection methods specifically tailored to take into account the non-linearity of the data via local embeddings have been proposed. Such methods are often based…

Machine Learning · Statistics 2026-01-28 Antonio Di Noia , Federico Ravenda , Antonietta Mira

In many scientific disciplines, we are interested in inferring the nonlinear dynamical system underlying a set of observed time series, a challenging task in the face of chaotic behavior and noise. Previous deep learning approaches toward…

Machine Learning · Computer Science 2022-07-07 Manuel Brenner , Florian Hess , Jonas M. Mikhaeil , Leonard Bereska , Zahra Monfared , Po-Chen Kuo , Daniel Durstewitz