Related papers: Inspired by machine learning optimization: can gra…

Spatially 3-dimensional seismic full waveform inversion (3D FWI) is a highly nonlinear and computationally demanding inverse problem that constructs 3D subsurface seismic velocity structures using seismic waveform data. To characterise…

The nonlinear and ill-posed nature of full waveform inversion (FWI) requires us to use sophisticated regularization techniques to solve it. In most applications, the model parameters may be described by physical properties (e.g., wave…

Full Wave Inversion (FWI) imaging scheme has many applications in engineering, geoscience and medical sciences. In this paper, a surrogate deep learning FWI approach is presented to quantify properties of materials using stress waves. Such…

Full waveform inversion (FWI) can produce accurate subsurface velocity models. However, the lack of sufficiently low-frequency content in field data often causes cycle skipping and traps the inversion in local minima. The Hilbert-transform…

To obtain high-resolution images of subsurface structures from seismic data, seismic imaging techniques such as Full Waveform Inversion (FWI) serve as crucial tools. However, FWI involves solving a nonlinear and often non-unique inverse…

Recently, flat-minima optimizers, which seek to find parameters in low-loss neighborhoods, have been shown to improve a neural network's generalization performance over stochastic and adaptive gradient-based optimizers. Two methods have…

I demonstrate that the conventional seismic full-waveform inversion algorithm can be constructed as a recurrent neural network and so implemented using deep learning software such as TensorFlow. Applying another deep learning concept, the…

Recent developments in application of deep learning models to acoustic Full Waveform Inversion (FWI) are marked by the use of diffusion models as prior distributions for Bayesian-like inference procedures. The advantage of these methods is…

Efficient frequency-domain Full Waveform Inversion (FWI) of long-offset node data can be designed with a few discrete frequencies hence allowing for compact volume of data to be managed. Moreover, attenuation effects can be…

Sharpness-aware minimization (SAM) aims to improve the generalisation of gradient-based learning by seeking out flat minima. In this work, we establish connections between SAM and Mean-Field Variational Inference (MFVI) of neural network…

We propose a general method for optimizing periodic input waveforms for global entrainment of weakly forced limit-cycle oscillators based on phase reduction and nonlinear programming. We derive averaged phase dynamics from the mathematical…

Full waveform inversion (FWI) is a large-scale nonlinear ill-posed problem for which computationally expensive Newton-type methods can become trapped in undesirable local minima, particularly when the initial model lacks a low-wavenumber…

We present Lift and Relax for Waveform Inversion (LRWI), an approach that mitigates the local minima issue in seismic full waveform inversion (FWI) via a combination of two convexification techniques. The first technique (Lift) extends the…

The loss landscape of Variational Quantum Neural Networks (VQNNs) is characterized by local minima that grow exponentially with increasing qubits. Because of this, it is more challenging to recover information from model gradients during…

Full-waveform inversion (FWI) with extended sources first computes wavefields with data-driven source extensions, such that the simulated data in inaccurate velocity models match the observed counterpart well enough to prevent cycle…

Complex salt geometries and strong velocity contrasts pose significant challenges for velocity model building and subsalt imaging. Although full waveform inversion (FWI) provides high-resolution velocity models, its performance strongly…

We propose and test the Direct Waveform Inversion (DWI) scheme to simultaneously invert for layered velocity and density profiles, using reflection seismic waveforms recorded on the surface. The recorded data include primary reflections and…

Optimization and generalization are two essential aspects of statistical machine learning. In this paper, we propose a framework to connect optimization with generalization by analyzing the generalization error based on the optimization…

Full Waveform Inversion (FWI) is a promising technique for achieving high-resolution imaging in medical ultrasound. However, conventional FWI methods suffer from issues related to computational efficiency, dependence on initial models, and…

Regularization is necessary for solving nonlinear ill-posed inverse problems arising in different fields of geosciences. The base of a suitable regularization is the prior expressed by the regularizer, which can be non-adaptive or adaptive…