English
Related papers

Related papers: An autoencoder compression approach for accelerati…

200 papers

We address the problem of optimal experimental design (OED) for Bayesian nonlinear inverse problems governed by PDEs. The goal is to find a placement of sensors, at which experimental data are collected, so as to minimize the uncertainty in…

Optimization and Control · Mathematics 2015-11-04 Alen Alexanderian , Noemi Petra , Georg Stadler , Omar Ghattas

We target time-dependent partial differential equations (PDEs) with heterogeneous coefficients in space and time. To tackle these problems, we construct reduced basis/ multiscale ansatz functions defined in space that can be combined with…

Numerical Analysis · Mathematics 2022-10-04 Julia Schleuß , Kathrin Smetana , Lukas ter Maat

This paper is concerned with the theory, construction and application of variable-stepsize implicit Peer two-step methods that are super-convergent for variable stepsizes, i.e., preserve their classical order achieved for uniform stepsizes…

Optimization and Control · Mathematics 2026-02-12 Jens Lang , Bernhard A. Schmitt

Deep learning is a kind of feature learning method with strong nonliear feature transformation and becomes more and more important in many fields of artificial intelligence. Deep autoencoder is one representative method of the deep learning…

Machine Learning · Computer Science 2020-02-18 Yongming Li , Yan Lei , Pin Wang , Yuchuan Liu

In order to process efficiently ever-higher dimensional data such as images, sentences, or audio recordings, one needs to find a proper way to reduce the dimensionality of such data. In this regard, SVD-based methods including PCA and…

Machine Learning · Computer Science 2021-03-09 Quentin Fournier , Daniel Aloise

This work proposes and analyzes a generalized acceleration technique for decreasing the computational complexity of using stochastic collocation (SC) methods to solve partial differential equations (PDEs) with random input data. The SC…

Numerical Analysis · Mathematics 2015-05-05 Diego Galindo , Peter Jantsch , Clayton G. Webster , Guannan Zhang

In autonomous embedded systems, it is often vital to reduce the amount of actions taken in the real world and energy required to learn a policy. Training reinforcement learning agents from high dimensional image representations can be very…

Machine Learning · Computer Science 2019-03-26 Bharat Prakash , Mark Horton , Nicholas R. Waytowich , William David Hairston , Tim Oates , Tinoosh Mohsenin

During the training of Large Language Models (LLMs), tensor data is periodically "checkpointed" to persistent storage to allow recovery of work done in the event of failure. The volume of data that must be copied during each checkpoint,…

Machine Learning · Computer Science 2025-05-16 Daniel Waddington , Cornel Constantinescu

There has been a lot of recent interest in designing neural network models to estimate a distribution from a set of examples. We introduce a simple modification for autoencoder neural networks that yields powerful generative models. Our…

Machine Learning · Computer Science 2015-06-08 Mathieu Germain , Karol Gregor , Iain Murray , Hugo Larochelle

Autoencoders gained popularity in the deep learning revolution given their ability to compress data and provide dimensionality reduction. Although prominent deep learning methods have been used to enhance autoencoders, the need to provide…

Machine Learning · Computer Science 2022-04-29 Rohitash Chandra , Mahir Jain , Manavendra Maharana , Pavel N. Krivitsky

Adaptive block-based compressive sensing (ABCS) algorithms are studied in the context of the practical realization of compressive sensing on resource-constrained image and video sensing platforms that use single-pixel cameras, multi-pixel…

Image and Video Processing · Electrical Eng. & Systems 2020-07-10 Joseph Zammit , Ian J. Wassell

By utilizing only depth information, the paper introduces a novel but efficient local planning approach that enhances not only computational efficiency but also planning performances for memoryless local planners. The sampling is first…

Robotics · Computer Science 2023-10-24 Thai Binh Nguyen , Linh Nguyen , Tanveer Choudhury , Kathleen Keogh , Manzur Murshed

Compression methods based on inpainting are an evolving alternative to classical transform-based codecs for still images. Attempts to apply these ideas to video compression are rare, since reaching real-time performance is very challenging.…

Image and Video Processing · Electrical Eng. & Systems 2021-05-05 Sarah Andris , Pascal Peter , Rahul Mohideen Kaja Mohideen , Joachim Weickert , Sebastian Hoffmann

The future of high-performance computing, specifically on future Exascale computers, will presumably see memory capacity and bandwidth fail to keep pace with data generated, for instance, from massively parallel partial differential…

Computational Physics · Physics 2020-01-29 Alec M. Dunton , Lluís Jofre , Gianluca Iaccarino , Alireza Doostan

In this paper, we address the challenging problem of optimal experimental design (OED) of constrained inverse problems. We consider two OED formulations that allow reducing the experimental costs by minimizing the number of measurements.…

Numerical Analysis · Mathematics 2017-08-17 Lars Ruthotto , Julianne Chung , Matthias Chung

Neural ordinary differential equations (neural ODEs) have emerged as a novel network architecture that bridges dynamical systems and deep learning. However, the gradient obtained with the continuous adjoint method in the vanilla neural ODE…

Machine Learning · Computer Science 2023-06-12 Hong Zhang , Wenjun Zhao

Distributed model training suffers from communication bottlenecks due to frequent model updates transmitted across compute nodes. To alleviate these bottlenecks, practitioners use gradient compression techniques like sparsification,…

Machine Learning · Computer Science 2020-11-02 Saurabh Agarwal , Hongyi Wang , Kangwook Lee , Shivaram Venkataraman , Dimitris Papailiopoulos

This paper presents an autoencoder-based neural network architecture to compress histopathological images while retaining the denser and more meaningful representation of the original images. Current research into improving compression…

Image and Video Processing · Electrical Eng. & Systems 2023-05-15 Agnes Barsi , Suvendu Chandan Nayak , Sasmita Parida , Raj Mani Shukla

Generative priors have been shown to provide improved results over sparsity priors in linear inverse problems. However, current state of the art methods suffer from one or more of the following drawbacks: (a) speed of recovery is slow; (b)…

Image and Video Processing · Electrical Eng. & Systems 2021-01-14 Jasjeet Dhaliwal , Kyle Hambrook

Many important problems in science and engineering require solving the so-called parametric partial differential equations (PDEs), i.e., PDEs with different physical parameters, boundary conditions, shapes of computation domains, etc.…

Machine Learning · Computer Science 2022-11-22 Xiang Huang , Zhanhong Ye , Hongsheng Liu , Beiji Shi , Zidong Wang , Kang Yang , Yang Li , Bingya Weng , Min Wang , Haotian Chu , Fan Yu , Bei Hua , Lei Chen , Bin Dong