English
Related papers

Related papers: Theory-guided Auto-Encoder for Surrogate Construct…

200 papers

In this work we present a hybrid physics-based and data-driven learning approach to construct surrogate models for concurrent multiscale simulations of complex material behavior. We start from robust but inflexible physics-based…

Numerical Analysis · Mathematics 2023-02-01 I. B. C. M. Rocha , P. Kerfriden , F. P. van der Meer

A critical factor in trustworthy machine learning is to develop robust representations of the training data. Only under this guarantee methods are legitimate to artificially generate data, for example, to counteract imbalanced datasets or…

Machine Learning · Computer Science 2024-12-12 Leon Scharwächter , Sebastian Otte

We present a new supervised learning technique for the Variational AutoEncoder (VAE) that allows it to learn a causally disentangled representation and generate causally disentangled outcomes simultaneously. We call this approach Causally…

Machine Learning · Statistics 2023-10-10 Seunghwan An , Kyungwoo Song , Jong-June Jeon

Temporal graph neural networks (TGNNs) outperform regular GNNs by incorporating time information into graph-based operations. However, TGNNs adopt specialized models (e.g., TGN, TGAT, and APAN ) and require tailored training frameworks…

Machine Learning · Computer Science 2024-09-19 Qiang Huang , Xiao Yan , Xin Wang , Susie Xi Rao , Zhichao Han , Fangcheng Fu , Wentao Zhang , Jiawei Jiang

In design, fabrication, and control problems, we are often faced with the task of synthesis, in which we must generate an object or configuration that satisfies a set of constraints while maximizing one or more objective functions. The…

Machine Learning · Computer Science 2021-11-08 Xingyuan Sun , Tianju Xue , Szymon Rusinkiewicz , Ryan P. Adams

Solving inverse problems in cardiac electrophysiology consists in the recovery of physiological parameters from surface electrocardiogram (ECG) measurements, a task which is often computationally unfeasible due to the severe ill-posedness…

Numerical Analysis · Mathematics 2026-05-05 Edoardo Centofanti , Giovanni Ziarelli , Simone Scacchi , Luca Franco Pavarino

Invertible transformation of large graphs into fixed dimensional vectors (embeddings) remains a challenge. Its overcoming would reduce any operation on graphs to an operation in a vector space. However, most existing methods are limited to…

Machine Learning · Computer Science 2022-07-12 Adam Małkowski , Jakub Grzechociński , Paweł Wawrzyński

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

Machine Learning · Statistics 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

Representing graph data in a low-dimensional space for subsequent tasks is the purpose of attributed graph embedding. Most existing neural network approaches learn latent representations by minimizing reconstruction errors. Rare work…

Machine Learning · Computer Science 2024-01-15 Bozhen Hu , Zelin Zang , Jun Xia , Lirong Wu , Cheng Tan , Stan Z. Li

In this work we provide a theoretical framework for structured prediction that generalizes the existing theory of surrogate methods for binary and multiclass classification based on estimating conditional probabilities with smooth convex…

Machine Learning · Computer Science 2019-02-14 Alex Nowak-Vila , Francis Bach , Alessandro Rudi

Determining the proper level of details to develop and solve physical models is usually difficult when one encounters new engineering problems. Such difficulty comes from how to balance the time (simulation cost) and accuracy for the…

Artificial Intelligence · Computer Science 2022-02-03 Randi Wang , Morad Behandish

Objects are composed of a set of geometrically organized parts. We introduce an unsupervised capsule autoencoder (SCAE), which explicitly uses geometric relationships between parts to reason about objects. Since these relationships do not…

Machine Learning · Statistics 2019-12-03 Adam R. Kosiorek , Sara Sabour , Yee Whye Teh , Geoffrey E. Hinton

We present a Bayesian tomography framework operating with prior-knowledge-based parametrization that is accelerated by surrogate models. Standard high-fidelity forward solvers solve wave equations with natural spatial parametrizations based…

Geophysics · Physics 2022-06-29 Giovanni Angelo Meles , Niklas Linde , Stefano Marelli

The increased penetration of wind power introduces more operational changes of critical corridors and the traditional time-consuming transient stability constrained total transfer capability (TTC) operational planning is unable to meet the…

Systems and Control · Electrical Eng. & Systems 2020-06-30 Gao Qiu , Youbo Liu , Junyong Liu , Junbo Zhao , Lingfeng Wang , Tingjian Liu , Hongjun Gao

A key bottleneck in quantum machine learning is the computational cost of repeated quantum circuit evaluations during the inference phase. To address this, we present a framework for constructing fast, cheap, provably accurate classical…

Quantum Physics · Physics 2026-04-29 Sreeraj Rajindran Nair , Christopher Ferrie

Inverse modeling for the estimation of non-Gaussian hydraulic conductivity fields in subsurface flow and solute transport models remains a challenging problem. This is mainly due to the non-Gaussian property, the non-linear physics, and the…

Computational Physics · Physics 2021-03-23 Shaoxing Mo , Nicholas Zabaras , Xiaoqing Shi , Jichun Wu

In this paper, we present list autoencoder (listAE) to mimic list decoding used in classical coding theory. With listAE, the decoder network outputs a list of decoded message word candidates. To train the listAE, a genie is assumed to be…

Information Theory · Computer Science 2022-08-04 Hamid Saber , Homayoon Hatami , Jung Hyun Bae

The field of neural generative models is dominated by the highly successful Generative Adversarial Networks (GANs) despite their challenges, such as training instability and mode collapse. Auto-Encoders (AE) with regularized latent space…

Computer Vision and Pattern Recognition · Computer Science 2020-05-19 Arnab Kumar Mondal , Sankalan Pal Chowdhury , Aravind Jayendran , Parag Singla , Himanshu Asnani , Prathosh AP

Graph self-supervised learning seeks to learn effective graph representations without relying on labeled data. Among various approaches, graph autoencoders (GAEs) have gained significant attention for their efficiency and scalability.…

Machine Learning · Computer Science 2025-06-17 Yang Liu , Deyu Bo , Wenxuan Cao , Yuan Fang , Yawen Li , Chuan Shi

Autoencoders and generative neural network models have recently gained popularity in fluid mechanics due to their spontaneity and low processing time instead of high fidelity CFD simulations. Auto encoders are used as model order reduction…

Fluid Dynamics · Physics 2022-03-04 Kanishk , Tanishk Nandal , Prince Tyagi , Raj Kumar Singh