English
Related papers

Related papers: Combining Checkpointing and Data Compression to Ac…

200 papers

PDE-constrained inverse problems are some of the most challenging and computationally demanding problems in computational science today. Fine meshes that are required to accurately compute the PDE solution introduce an enormous number of…

Numerical Analysis · Mathematics 2023-04-12 Jonathan Wittmer , Jacob Badger , Hari Sundar , Tan Bui-Thanh

Inversion and PDE-constrained optimization problems often rely on solving the adjoint problem to calculate the gradient of the objec- tive function. This requires storing large amounts of intermediate data, setting a limit to the largest…

Mathematical Software · Computer Science 2018-02-08 Navjot Kukreja , Jan Hückelheim , Michael Lange , Mathias Louboutin , Andrea Walther , Simon W. Funke , Gerard Gorman

This paper proposes a new method that combines check-pointing methods with error-controlled lossy compression for large-scale high-performance Full-Waveform Inversion (FWI), an inverse problem commonly used in geophysical exploration. This…

Compression of inverted lists with methods that support fast intersection operations is an active research topic. Most compression schemes rely on encoding differences between consecutive positions with techniques that favor small numbers.…

Information Retrieval · Computer Science 2009-11-18 Francisco Claude , Antonio Farina , Gonzalo Navarro

Dynamic optimization is currently limited by sensitivity computations that require information from full forward and adjoint wave fields. Since the forward and adjoint solutions are computed in opposing time directions, the forward solution…

Computational Engineering, Finance, and Science · Computer Science 2025-09-22 Leon Herrmann , Tim Bürchner , László Kudela , Stefan Kollmannsberger

New directions in computing and algorithms has lead to some new applications that have tolerance to imprecision. Although, These applications are creating large volumes of data which exceeds the capability of today's computing systems.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-16 Navid Mirnouri

This paper is dedicated to an efficient compression of weights and optimizer states (called checkpoints) obtained at different stages during a neural network training process. First, we propose a prediction-based compression approach, where…

Machine Learning · Computer Science 2025-06-16 Yuriy Kim , Evgeny Belyaev

Sensitivity analysis plays an important role in searching for constitutive parameters (e.g. permeability) subsurface flow simulations. The mathematics behind is to solve a dynamic constrained optimization problem. Traditional methods like…

Computational Physics · Physics 2019-06-05 Shu Wang , Satish Karra , Daniel O'Malley

Systematic checkpointing of the machine state makes restart of execution from a safe state possible upon detection of an error. The time and energy overhead of checkpointing, however, grows with the frequency of checkpointing. Amortizing…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-11-30 Ismail Akturk , Ulya R. Karpuzcu

We consider the problem of 3D seismic inversion from pre-stack data using a very small number of seismic sources. The proposed solution is based on a combination of compressed-sensing and machine learning frameworks, known as…

Geophysics · Physics 2023-11-02 Maayan Gelboim , Amir Adler , Yen Sun , Mauricio Araya-Polo

4D seismic inversion is the leading method to quantitatively monitor fluid flow dynamics in the subsurface, with applications ranging from enhanced oil recovery to subsurface CO2 storage. The process of inverting seismic data for reservoir…

Geophysics · Physics 2023-10-25 Juan Romero , Nick Luiken , Matteo Ravasi

Structural seismic interpretation and quantitative characterization are historically intertwined processes. The latter provides estimates of properties of the subsurface which can be used to aid structural interpretation alongside the…

Geophysics · Physics 2021-10-13 Matteo Ravasi , Claire Emma Birnie

Seismic imaging is the numerical process of creating a volumetric representation of the subsurface geological structures from elastic waves recorded at the surface of the Earth. As such, it is widely utilized in the energy and construction…

Geophysics · Physics 2024-11-05 Juan Romero , Wolfgang Heidrich , Nick Luiken , Matteo Ravasi

Imaging Earth structure or seismic sources from seismic data involves minimizing a target misfit function, and is commonly solved through gradient-based optimization. The adjoint-state method has been developed to compute the gradient…

Computational Physics · Physics 2021-04-28 Weiqiang Zhu , Kailai Xu , Eric Darve , Gregory C. Beroza

User data confidentiality protection is becoming a rising challenge in the present deep learning research. Without access to data, conventional data-driven model compression faces a higher risk of performance degradation. Recently, some…

Machine Learning · Computer Science 2022-01-28 Yuhang Li , Feng Zhu , Ruihao Gong , Mingzhu Shen , Xin Dong , Fengwei Yu , Shaoqing Lu , Shi Gu

A critical decision process in data acquisition for mineral and energy resource exploration is how to efficiently combine a variety of sensor types and to minimize total cost. We propose a probabilistic framework for multi-objective…

Geophysics · Physics 2020-10-13 Sebastian Haan , Fabio Ramos , Dietmar Müller

Modern scientific simulations, observations, and large-scale experiments generate data at volumes that often exceed the limits of storage, processing, and analysis. This challenge drives the development of data reduction methods that…

Machine Learning · Computer Science 2025-11-18 Minh Vu , Andrey Lokhov

We consider checkpointing strategies that minimize the number of recomputations needed when performing discrete adjoint computations using multistage time-stepping schemes, which requires computing several substeps within one complete time…

Mathematical Software · Computer Science 2022-04-29 Hong Zhang , Emil Constantinescu

Today, with the growing demands of information storage and data transfer, data compression is becoming increasingly important. Data Compression is a technique which is used to decrease the size of data. This is very useful when some huge…

Information Theory · Computer Science 2025-06-13 Mohammad Hosseini

This paper presents a new functionality of the Automatic Differentiation (AD) tool Tapenade. Tapenade generates adjoint codes which are widely used for optimization or inverse problems. Unfortunately, for large applications the adjoint code…

Data Structures and Algorithms · Computer Science 2007-05-23 Laurent Hascoet , Mauricio Araya-Polo
‹ Prev 1 2 3 10 Next ›