English
Related papers

Related papers: Intrinsic Dimension Estimating Autoencoder (IDEA) …

200 papers

Active Infrared thermography (AIRT) is a widely adopted non-destructive testing (NDT) technique for detecting subsurface anomalies in industrial components. Due to the high dimensionality of AIRT data, current approaches employ non-linear…

Image and Video Processing · Electrical Eng. & Systems 2025-08-12 Mohammed Salah , Numan Saeed , Davor Svetinovic , Stefano Sfarra , Mohammed Omar , Yusra Abdulrahman

In one-class novelty detection, a model learns solely on the in-class data to single out out-class instances. Autoencoder (AE) variants aim to compactly model the in-class data to reconstruct it exclusively, thus differentiating the…

Machine Learning · Computer Science 2022-07-25 Jaewoo Park , Yoon Gyo Jung , Andrew Beng Jin Teoh

Existing manifold learning methods are not appropriate for image retrieval task, because most of them are unable to process query image and they have much additional computational cost especially for large scale database. Therefore, we…

Computer Vision and Pattern Recognition · Computer Science 2018-04-04 Jian Xu , Chunheng Wang , Chengzuo Qi , Cunzhao Shi , Baihua Xiao

In this study, we measure the Intrinsic Dimension (ID) of token embedding to estimate the intrinsic dimensions of the manifolds spanned by the representations, so as to evaluate their redundancy quantitatively compared to their extrinsic…

Computation and Language · Computer Science 2025-03-05 Takuya Kataiwa , Cho Hakaze , Tetsushi Ohki

Many efforts have been devoted to designing sampling, mining, and weighting strategies in high-level deep metric learning (DML) loss objectives. However, little attention has been paid to low-level but essential data transformation. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Zhiyuan Chen , Guang Yao , Wennan Ma , Lin Xu

This article proposes a data-driven methodology to achieve a fast design support, in order to generate or develop novel designs covering multiple object categories. This methodology implements two state-of-the-art Variational Autoencoder…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Zhangsihao Yang , Haoliang Jiang , Zou Lan

The analysis of neural representation has become an integral part of research aiming to better understand the inner workings of neural networks. While there are many different approaches to investigate neural representations, an important…

Machine Learning · Computer Science 2026-04-23 Rickmer Schulte , David Rügamer

We address the intrinsic dimensionality (ID) of high-dimensional trajectories, comprising $n_s = 4\,000\,000$ data points, of the Fermi-Pasta-Ulam-Tsingou (FPUT) $\beta$ model with $N = 32$ oscillators. To this end, a deep autoencoder (DAE)…

Statistical Mechanics · Physics 2026-03-19 Gionni Marchetti

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

This paper presents a new solution for reconstructing missing data in power system measurements. An Enhanced Denoising Autoencoder (EDAE) is proposed to reconstruct the missing data through the input vector space reconstruction based on the…

Signal Processing · Electrical Eng. & Systems 2019-07-30 You Lin , Jianhui Wang , Mingjian Cui

An autoencoder is a neural network which data projects to and from a lower dimensional latent space, where this data is easier to understand and model. The autoencoder consists of two sub-networks, the encoder and the decoder, which carry…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Saïd Ladjal , Alasdair Newson , Chi-Hieu Pham

Real world-datasets characterized by discrete features are ubiquitous: from categorical surveys to clinical questionnaires, from unweighted networks to DNA sequences. Nevertheless, the most common unsupervised dimensional reduction methods…

Machine Learning · Statistics 2023-03-14 Iuri Macocco , Aldo Glielmo , Jacopo Grilli , Alessandro Laio

Autoencoders, which consist of an encoder and a decoder, are widely used in machine learning for dimension reduction of high-dimensional data. The encoder embeds the input data manifold into a lower-dimensional latent space, while the…

Numerical Analysis · Mathematics 2024-03-29 Juliane Braunsmann , Marko Rajković , Martin Rumpf , Benedikt Wirth

In meteorology, finding similar weather patterns or analogs in historical datasets can be useful for data assimilation, forecasting, and postprocessing. In climate science, analogs in historical and climate projection data are used for…

Machine Learning · Computer Science 2025-04-29 Geert De Paepe , Lesley De Cruz

Local intrinsic dimension (LID) estimation methods have received a lot of attention in recent years thanks to the progress in deep neural networks and generative modeling. In opposition to old non-parametric methods, new methods use…

Machine Learning · Statistics 2024-12-24 Piotr Tempczyk , Łukasz Garncarek , Dominik Filipiak , Adam Kurpisz

In order to process efficiently ever-higher dimensional data such as images, sentences, or audio recordings, one needs to find a proper way to reduce the dimensionality of such data. In this regard, SVD-based methods including PCA and…

Machine Learning · Computer Science 2021-03-09 Quentin Fournier , Daniel Aloise

Anomaly detection using dimensionality reduction has been an essential technique for monitoring multidimensional data. Although deep learning-based methods have been well studied for their remarkable detection performance, their…

Machine Learning · Statistics 2018-12-24 Yasuhiro Ikeda , Kengo Tajiri , Yuusuke Nakano , Keishiro Watanabe , Keisuke Ishibashi

Time-delay embedding is a powerful technique for reconstructing the state space of nonlinear time series. However, the fidelity of reconstruction relies on the assumption that the time-delay map is an embedding, which is implicitly…

Computation · Statistics 2026-02-02 Yiting Duan , Zhikun Zhang , Yi Guo

The concept of dimension is essential to grasp the complexity of data. A naive approach to determine the dimension of a dataset is based on the number of attributes. More sophisticated methods derive a notion of intrinsic dimension (ID)…

Machine Learning · Computer Science 2023-04-18 Maximilian Stubbemann , Tom Hanika , Friedrich Martin Schneider

Inspection of insulators is important to ensure reliable operation of the power system. Deep learning is being increasingly exploited to automate the inspection process by leveraging object detection models to analyse aerial images captured…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Laya Das , Blazhe Gjorgiev , Giovanni Sansavini