English
Related papers

Related papers: Rank Reduction AutoEncoders for Mechanical Design:…

200 papers

Video autoencoders compress videos into compact latent representations for efficient reconstruction, playing a vital role in enhancing the quality and efficiency of video generation. However, existing video autoencoders often entangle…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Cuifeng Shen , Lumin Xu , Xingguo Zhu , Gengdai Liu

Autoencoders (AE) provide a useful method for nonlinear dimensionality reduction but are ill-suited for low data regimes. Conversely, Principal Component Analysis (PCA) is data-efficient but is limited to linear dimensionality reduction,…

This paper investigates a novel algorithmic approach to data representation based on kernel methods. Assuming that the observations lie in a Hilbert space X, the introduced Kernel Autoencoder (KAE) is the composition of mappings from…

Machine Learning · Statistics 2020-12-03 Pierre Laforgue , Stephan Clémençon , Florence d'Alché-Buc

Is there really much more to say about sparse autoencoders (SAEs)? Autoencoders in general, and SAEs in particular, represent deep architectures that are capable of modeling low-dimensional latent structure in data. Such structure could…

Machine Learning · Computer Science 2025-06-09 Yin Lu , Xuening Zhu , Tong He , David Wipf

Physics-based models often involve large systems of parametrized partial differential equations, where design parameters control various properties. However, high-fidelity simulations of such systems on large domains or with high grid…

Computational Physics · Physics 2025-05-15 Diba Behnoudfar

Unraveling the relation between structural information and the dynamic properties of supercooled liquids is one of the grand challenges of physics. Dynamic heterogeneity, characterized by the propensity of particles, is often used as a…

Disordered Systems and Neural Networks · Physics 2024-04-26 Yunrui Qiu , Inhyuk Jang , Xuhui Huang , Arun Yethiraj

Due to their high computational efficiency on a continuous space, gradient optimization methods have shown great potential in the neural architecture search (NAS) domain. The mapping of network representation from the discrete space to a…

Machine Learning · Computer Science 2020-06-20 Jian Li , Yong Liu , Jiankun Liu , Weiping Wang

Deep latent variable models, trained using variational autoencoders or generative adversarial networks, are now a key technique for representation learning of continuous structures. However, applying similar methods to discrete structures,…

Machine Learning · Computer Science 2018-07-02 Jake Zhao , Yoon Kim , Kelly Zhang , Alexander M. Rush , Yann LeCun

Leveraging the framework of Optimal Transport, we introduce a new family of generative autoencoders with a learnable prior, called Symmetric Wasserstein Autoencoders (SWAEs). We propose to symmetrically match the joint distributions of the…

Machine Learning · Computer Science 2021-06-25 Sun Sun , Hongyu Guo

Topology optimization (TO) is a popular and powerful computational approach for designing novel structures, materials, and devices. Two computational challenges have limited the applicability of TO to a variety of industrial applications.…

Computational Engineering, Finance, and Science · Computer Science 2020-12-01 Sirui Bi , Jiaxin Zhang , Guannan Zhang

In autonomous embedded systems, it is often vital to reduce the amount of actions taken in the real world and energy required to learn a policy. Training reinforcement learning agents from high dimensional image representations can be very…

Machine Learning · Computer Science 2019-03-26 Bharat Prakash , Mark Horton , Nicholas R. Waytowich , William David Hairston , Tim Oates , Tinoosh Mohsenin

As deep Variational Auto-Encoder (VAE) frameworks become more widely used for modeling biomolecular simulation data, we emphasize the capability of the VAE architecture to concurrently maximize the timescale of the latent space while…

Chemical Physics · Physics 2021-12-08 Hannah K. Wayment-Steele , Vijay S. Pande

Any model order reduced dynamical system that evolves a modal decomposition to approximate the discretized solution of a stochastic PDE can be related to a vector field tangent to the manifold of fixed rank matrices. The Dynamically…

Dynamical Systems · Mathematics 2018-04-04 Florian Feppon , Pierre F. J. Lermusiaux

Shape illustration images (SIIs) are common and important in describing the cross-sections of industrial products. Same as MNIST, the handwritten digit images, SIIs are gray or binary and containing shapes that are surrounded by large areas…

Image and Video Processing · Electrical Eng. & Systems 2020-02-07 Qianwei Zhou , Peng Tao , Xiaoxin Li , Shengyong Chen , Fan Zhang , Haigen Hu

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a traditional autoencoder.…

Machine Learning · Statistics 2017-07-12 Gautam Ramachandra

Autoencoders have been widely used for dimensional reduction and feature extraction. Various types of autoencoders have been proposed by introducing regularization terms. Most of these regularizations improve representation learning by…

Machine Learning · Computer Science 2020-06-26 Yuzhu Guo , Kang Pan , Simeng Li , Zongchang Han , Kexin Wang , Li Li

Autoencoders are neural network formulations where the input and output of the network are identical and the goal is to identify the hidden representation in the provided datasets. Generally, autoencoders project the data nonlinearly onto a…

Signal Processing · Electrical Eng. & Systems 2019-07-10 Debjani Bhowick , Deepak K. Gupta , Saumen Maiti , Uma Shankar

Dense retrievers encode queries and documents and map them in an embedding space using pre-trained language models. These embeddings need to be high-dimensional to fit training signals and guarantee the retrieval effectiveness of dense…

Information Retrieval · Computer Science 2022-10-25 Zhenghao Liu , Han Zhang , Chenyan Xiong , Zhiyuan Liu , Yu Gu , Xiaohua Li

Topology optimization (TO) has experienced a dramatic development over the last decades aided by the arising of metamaterials and additive manufacturing (AM) techniques, and it is intended to achieve the current and future challenges. In…

Engineers learn from every design they create, building intuition that helps them quickly identify promising solutions for new problems. Topology optimization (TO) - a well-established computational method for designing structures with…

Computational Engineering, Finance, and Science · Computer Science 2025-02-05 Igor Kuszczak , Gawel Kus , Federico Bosi , Miguel A. Bessa