English
Related papers

Related papers: Machine Learning Techniques for Data Reduction of …

200 papers

Scientific applications in fields such as high energy physics, computational fluid dynamics, and climate science generate vast amounts of data at high velocities. This exponential growth in data production is surpassing the advancements in…

Machine Learning · Computer Science 2024-09-10 Xiao Li , Jaemoon Lee , Anand Rangarajan , Sanjay Ranka

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been…

Fluid Dynamics · Physics 2022-10-18 Alberto Olmo , Ahmed Zamzam , Andrew Glaws , Ryan King

This paper proposes a new compression paradigm -- Guaranteed Conditional Diffusion with Tensor Correction (GCDTC) -- for lossy scientific data compression. The framework is based on recent conditional diffusion (CD) generative models, and…

Machine Learning · Computer Science 2025-02-19 Jaemoon Lee , Xiao Li , Liangji Zhu , Sanjay Ranka , Anand Rangarajan

In the realm of computational fluid dynamics (CFD), accurate prediction of aerodynamic behaviour plays a pivotal role in aerofoil design and optimization. This study proposes a novel approach that synergistically combines autoencoders and…

Fluid Dynamics · Physics 2023-05-31 Tanishk Nandal , Vaibhav Fulara , Raj Kumar Singh

Computational Fluid Dynamics (CFD) plays a pivotal role in fluid mechanics, enabling precise simulations of fluid behavior through partial differential equations (PDEs). However, traditional CFD methods are resource-intensive, particularly…

Computational Engineering, Finance, and Science · Computer Science 2025-02-06 Tiffany Fan , Murray Cutforth , Marta D'Elia , Alexandre Cortiella , Alireza Doostan , Eric Darve

Data collection often results in records that have missing values or variables. This investigation compares 3 different data imputation models and identifies their merits by using accuracy measures. Autoencoder Neural Networks, Principal…

Artificial Intelligence · Computer Science 2007-09-18 Vukosi N. Marivate , Fulufhelo V. Nelwamodo , Tshilidzi Marwala

An autoencoder is a neural network which data projects to and from a lower dimensional latent space, where this data is easier to understand and model. The autoencoder consists of two sub-networks, the encoder and the decoder, which carry…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Saïd Ladjal , Alasdair Newson , Chi-Hieu Pham

High-fidelity computational fluid dynamics (CFD) simulations for design space explorations can be exceedingly expensive due to the cost associated with resolving the finer scales. This computational cost/accuracy trade-off is a major…

Fluid Dynamics · Physics 2024-03-14 Peetak Mitra , Majid Haghshenas , Niccolo Dal Santo , Conor Daly , David P. Schmidt

We present regression and compression algorithms for lattice QCD data utilizing the efficient binary optimization ability of quantum annealers. In the regression algorithm, we encode the correlation between the input and output variables…

High Energy Physics - Lattice · Physics 2021-12-07 Boram Yoon , Chia Cheng Chang , Garrett T. Kenyon , Nga T. T. Nguyen , Ermal Rrapaj

We introduce a simple yet significant improvement to the time-evolving block decimation (TEBD) tensor network algorithm for simulating the time dynamics of strongly correlated one-dimensional (1D) mixed quantum states. The efficiency of 1D…

Quantum Physics · Physics 2026-05-19 Sayak Guha Roy , Kevin Slagle

Generative models have demonstrated strong performance in conditional settings and can be viewed as a form of data compression, where the condition serves as a compact representation. However, their limited controllability and…

Machine Learning · Computer Science 2025-07-04 Xiao Li , Liangji Zhu , Anand Rangarajan , Sanjay Ranka

For effective human-robot teaming, it is important for the robots to be able to share their visual perception with the human operators. In a harsh remote collaboration setting, data compression techniques such as autoencoder can be utilized…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Hyeonwoo Yu , Jean Oh

Many real-world datasets are represented as tensors, i.e., multi-dimensional arrays of numerical values. Storing them without compression often requires substantial space, which grows exponentially with the order. While many tensor…

Machine Learning · Computer Science 2023-09-21 Taehyung Kwon , Jihoon Ko , Jinhong Jung , Kijung Shin

Learning compressed representations of multivariate time series (MTS) facilitates data analysis in the presence of noise and redundant information, and for a large number of variates and time steps. However, classical dimensionality…

Neural and Evolutionary Computing · Computer Science 2019-07-17 Filippo Maria Bianchi , Lorenzo Livi , Karl Øyvind Mikalsen , Michael Kampffmeyer , Robert Jenssen

Autoencoders and generative neural network models have recently gained popularity in fluid mechanics due to their spontaneity and low processing time instead of high fidelity CFD simulations. Auto encoders are used as model order reduction…

Fluid Dynamics · Physics 2022-03-04 Kanishk , Tanishk Nandal , Prince Tyagi , Raj Kumar Singh

We propose a method for reducing the spatial discretization error of coarse computational fluid dynamics (CFD) problems by enhancing the quality of low-resolution simulations using deep learning. We feed the model with fine-grid data after…

Machine Learning · Computer Science 2024-09-27 Jesus Gonzalez-Sieiro , David Pardo , Vincenzo Nava , Victor M. Calo , Markus Towara

This paper presents an approach to improve the forecast of computational fluid dynamics (CFD) simulations of urban air pollution using deep learning, and most specifically adversarial training. This adversarial approach aims to reduce the…

Machine Learning · Computer Science 2021-04-19 César Quilodrán-Casas , Rossella Arcucci , Laetitia Mottet , Yike Guo , Christopher Pain

This paper focuses on addressing challenges posed by non-homogeneous unstructured grids, commonly used in Computational Fluid Dynamics (CFD). Their prevalence in CFD scenarios has motivated the exploration of innovative approaches for…

Computational Engineering, Finance, and Science · Computer Science 2024-05-08 Gabriele Immordino , Andrea Vaiuso , Andrea Da Ronch , Marcello Righi

In the framework of multidimensional Compressed Sensing (CS), we introduce an analytical reconstruction formula that allows one to recover an $N$th-order $(I_1\times I_2\times \cdots \times I_N)$ data tensor $\underline{\mathbf{X}}$ from a…

Information Theory · Computer Science 2015-06-19 Cesar F. Caiafa , Andrzej Cichocki

Error-bounded lossy compression is becoming an indispensable technique for the success of today's scientific projects with vast volumes of data produced during simulations or instrument data acquisitions. Not only can it significantly…

Machine Learning · Computer Science 2023-10-24 Jinyang Liu , Sheng Di , Kai Zhao , Sian Jin , Dingwen Tao , Xin Liang , Zizhong Chen , Franck Cappello
‹ Prev 1 2 3 10 Next ›