English
Related papers

Related papers: Learning latent representations in high-dimensiona…

200 papers

Representation learning plays a crucial role in automated feature selection, particularly in the context of high-dimensional data, where non-parametric methods often struggle. In this study, we focus on supervised learning scenarios where…

Methodology · Statistics 2024-08-08 Bertille Follain , Francis Bach

In this paper, a systematic approach is developed to embed the dynamical description of a nonlinear system into a linear parameter-varying (LPV) system representation. Initially, the nonlinear functions in the model representation are…

Systems and Control · Electrical Eng. & Systems 2020-11-09 Arash Sadeghzadeh , Roland Toth

We propose a representation learning framework for medical diagnosis domain. It is based on heterogeneous network-based model of diagnostic data as well as modified metapath2vec algorithm for learning latent node representation. We compare…

Machine Learning · Computer Science 2020-01-24 Karol Antczak

In this paper, we focus on learning a linear time-invariant (LTI) model with low-dimensional latent variables but high-dimensional observations. We provide an algorithm that recovers the high-dimensional features, i.e. column space of the…

Systems and Control · Electrical Eng. & Systems 2024-06-27 Yuyang Zhang , Shahriar Talebi , Na Li

Dynamical models underpin our ability to understand and predict the behavior of natural systems. Whether dynamical models are developed from first-principles derivations or from observational data, they are predicated on our choice of state…

Machine Learning · Computer Science 2023-01-11 Daniel Floryan , Michael D. Graham

A key task in the field of modeling and analyzing nonlinear dynamical systems is the recovery of unknown governing equations from measurement data only. There is a wide range of application areas for this important instance of system…

Dynamical Systems · Mathematics 2019-04-11 Patrick Gelß , Stefan Klus , Jens Eisert , Christof Schütte

We present a new data-driven reduced-order modeling approach to efficiently solve parametrized partial differential equations (PDEs) for many-query problems. This work is inspired by the concept of implicit neural representation (INR),…

Numerical Analysis · Mathematics 2023-11-30 Tianshu Wen , Kookjin Lee , Youngsoo Choi

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

Applications · Statistics 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

Learning from demonstration is an effective method for human users to instruct desired robot behaviour. However, for most non-trivial tasks of practical interest, efficient learning from demonstration depends crucially on inductive bias in…

Robotics · Computer Science 2019-10-08 Yordan Hristov , Daniel Angelov , Michael Burke , Alex Lascarides , Subramanian Ramamoorthy

We propose a method for learning topology-preserving data representations (dimensionality reduction). The method aims to provide topological similarity between the data manifold and its latent representation via enforcing the similarity in…

Machine Learning · Computer Science 2023-05-05 Ilya Trofimov , Daniil Cherniavskii , Eduard Tulchinskii , Nikita Balabin , Evgeny Burnaev , Serguei Barannikov

Euclidean representations distort data with intrinsic non-Euclidean structure. While Riemannian representation learning offers a solution by embedding data onto matching manifolds, it typically relies on an encoder to estimate densities on…

Machine Learning · Computer Science 2026-05-05 Andreas Bjerregaard , Søren Hauberg , Anders Krogh

One fundamental goal of high-dimensional statistics is to detect or recover planted structure (such as a low-rank matrix) hidden in noisy data. A growing body of work studies low-degree polynomials as a restricted model of computation for…

Statistics Theory · Mathematics 2022-06-22 Tselil Schramm , Alexander S. Wein

We present a new latent model of natural images that can be learned on large-scale datasets. The learning process provides a latent embedding for every image in the training dataset, as well as a deep convolutional network that maps the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-06 ShahRukh Athar , Evgeny Burnaev , Victor Lempitsky

As sequential neural architectures become deeper and more complex, uncertainty estimation is more and more challenging. Efforts in quantifying uncertainty often rely on specific training procedures, and bear additional computational costs…

Machine Learning · Statistics 2023-07-06 Max Cohen , Maurice Charbit , Sylvain Le Corff

Projection-based model reduction has become a popular approach to reduce the cost associated with integrating large-scale dynamical systems so they can be used in many-query settings such as optimization and uncertainty quantification. For…

Numerical Analysis · Mathematics 2020-08-26 Han Gao , Jian-Xun Wang , Matthew J. Zahr

We consider the problem of learning discriminative representations for data in a high-dimensional space with distribution supported on or around multiple low-dimensional linear subspaces. That is, we wish to compute a linear injective map…

Machine Learning · Statistics 2022-10-07 Druv Pai , Michael Psenka , Chih-Yuan Chiu , Manxi Wu , Edgar Dobriban , Yi Ma

Discovering governing equations from data, in particular high dimensional data, is challenging in various fields of science and engineering, and it has potential to revolutionise the science and technology in this big data era. This paper…

Fluid Dynamics · Physics 2024-01-12 X. Lin , D. Xiao , F. Fang

A generative modeling framework is proposed that combines diffusion models and manifold learning to efficiently sample data densities on manifolds. The approach utilizes Diffusion Maps to uncover possible low-dimensional underlying (latent)…

Machine Learning · Computer Science 2025-04-22 Dimitris G. Giovanis , Ellis Crabtree , Roger G. Ghanem , Ioannis G. Kevrekidis

While the existence of low-dimensional embedding manifolds has been shown in patterns of collective motion, the current battery of nonlinear dimensionality reduction methods are not amenable to the analysis of such manifolds. This is mainly…

Numerical Analysis · Mathematics 2017-07-21 Kelum Gajamannage , Sachit Butail , Maurizio Porfiri , Erik M. Bollt

State estimation is key to both analyzing physical mechanisms and enabling real-time control of fluid flows. A common estimation approach is to relate sensor measurements to a reduced state governed by a reduced-order model (ROM). (When…

Fluid Dynamics · Physics 2020-06-10 Nirmal J. Nair , Andres Goza