English
Related papers

Related papers: DIRESA, a distance-preserving nonlinear dimension …

200 papers

Unsupervised dimensionality reduction is one of the commonly used techniques in the field of high dimensional data recognition problems. The deep autoencoder network which constrains the weights to be non-negative, can learn a low…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Anyong Qin , Zhaowei Shang , Zhuolin Tan , Taiping Zhang , Yuan Yan Tang

Dimensionality-reduction methods are a fundamental tool in the analysis of large data sets. These algorithms work on the assumption that the "intrinsic dimension" of the data is generally much smaller than the ambient dimension in which it…

Machine Learning · Computer Science 2018-10-30 Henry Kvinge , Elin Farnell , Michael Kirby , Chris Peterson

Modeling data as being sampled from a union of independent subspaces has been widely applied to a number of real world applications. However, dimensionality reduction approaches that theoretically preserve this independence assumption have…

Machine Learning · Computer Science 2016-04-08 Devansh Arpit , Ifeoma Nwogu , Venu Govindaraju

This paper considers physical systems described by hidden states and indirectly observed through repeated measurements corrupted by unmodeled nuisance parameters. A network-based representation learns to disentangle the coherent information…

Computational Physics · Physics 2022-02-08 Pawan Bharadwaj , Matthew Li , Laurent Demanet

Dimensionality reduction is an effective method for learning high-dimensional data, which can provide better understanding of decision boundaries in human-readable low-dimensional subspace. Linear methods, such as principal component…

Machine Learning · Computer Science 2020-07-09 Koji Maruhashi , Heewon Park , Rui Yamaguchi , Satoru Miyano

Distribution System State Estimation (DSSE) is becoming increasingly important with the integration of Distributed Energy Resources (DERs) and the active operation of distribution networks (DNs), but it remains challenging due to the…

Optimization and Control · Mathematics 2026-05-25 J. G. De la Varga , S. Pineda , A. Stratigakos , J. M. Morales

We explore linear and non-linear dimensionality reduction techniques for statistical inference of parameters in cosmology. Given the importance of compressing the increasingly complex data vectors used in cosmology, we address questions…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-12 Minsu Park , Marco Gatti , Bhuvnesh Jain

In many machine learning problems, large-scale datasets have become the de-facto standard to train state-of-the-art deep networks at the price of heavy computation load. In this paper, we focus on condensing large training sets into…

Machine Learning · Computer Science 2021-06-11 Bo Zhao , Hakan Bilen

Large-scale LiDAR mappings and localization leverage place recognition techniques to mitigate odometry drifts, ensuring accurate mapping. These techniques utilize scene representations from LiDAR point clouds to identify previously visited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Raktim Gautam Goswami , Naman Patel , Prashanth Krishnamurthy , Farshad Khorrami

In contrast to fully-supervised models, self-supervised representation learning only needs a fraction of data to be labeled and often achieves the same or even higher downstream performance. The goal is to pre-train deep neural networks on…

Machine Learning · Computer Science 2025-04-09 Friederike Baier , Sebastian Mair , Samuel G. Fadel

This paper introduces a hybrid attention and autoencoder (AE) model for unsupervised online anomaly detection in time series. The autoencoder captures local structural patterns in short embeddings, while the attention model learns long-term…

Machine Learning · Computer Science 2024-01-09 Seyed Amirhossein Najafi , Mohammad Hassan Asemani , Peyman Setoodeh

The monitoring and management of high-volume feature-rich traffic in large networks offers significant challenges in storage, transmission and computational costs. The predominant approach to reducing these costs is based on performing a…

Machine Learning · Computer Science 2016-06-16 Tingshan Huang , Harish Sethu , Nagarajan Kandasamy

Geological parameterization entails the representation of a geomodel using a small set of latent variables and a mapping from these variables to grid-block properties such as porosity and permeability. Parameterization is useful for data…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Guido Di Federico , Louis J. Durlofsky

Bridging the gap between data-rich training regimes and observation-sparse deployment conditions remains a central challenge in spatiotemporal field reconstruction, particularly when target domains exhibit distributional shifts,…

Machine Learning · Computer Science 2026-01-30 Xingyue Zhang , Yuxuan Bao , Mars Liyao Gao , J. Nathan Kutz

Analyzing data from paleoclimate archives such as tree rings or lake sediments offers the opportunity of inferring information on past climate variability. Often, such data sets are univariate and a proper reconstruction of the system's…

Data Analysis, Statistics and Probability · Physics 2018-08-29 Jaqueline Lekscha , Reik V. Donner

PDE-constrained inverse problems are some of the most challenging and computationally demanding problems in computational science today. Fine meshes that are required to accurately compute the PDE solution introduce an enormous number of…

Numerical Analysis · Mathematics 2023-04-12 Jonathan Wittmer , Jacob Badger , Hari Sundar , Tan Bui-Thanh

Many applications such as scientific simulation, sensing, and power grid monitoring tend to generate massive amounts of data, which should be compressed first prior to storage and transmission. These data, mostly comprised of floating-point…

Databases · Computer Science 2019-11-19 Dongeun Lee , Alex Sim , Jaesik Choi , Kesheng Wu

Neural networks have seen limited use in prediction for high-dimensional data with small sample sizes, because they tend to overfit and require tuning many more hyperparameters than existing off-the-shelf machine learning methods. With…

Machine Learning · Statistics 2020-05-12 Jean Feng , Noah Simon

Unsupervised learning-based anomaly detection in latent space has gained importance since discriminating anomalies from normal data becomes difficult in high-dimensional space. Both density estimation and distance-based methods to detect…

Machine Learning · Computer Science 2024-02-16 Padmaksha Roy

Over the past years, the ever-growing trend on data storage demand, more specifically for "cold" data (rarely accessed data), has motivated research for alternative systems of data storage. Because of its biochemical characteristics,…

Image and Video Processing · Electrical Eng. & Systems 2023-06-23 Xavier Pic , Eva Gil San Antonio , Melpomeni Dimopoulou , Marc Antonini