English
Related papers

Related papers: Optimizing a Transformer-based network for a deep …

200 papers

Seismic data often face challenges in their utilization due to noise contamination, incomplete acquisition, and limited low-frequency information, which hinder accurate subsurface imaging and interpretation. Traditional processing methods…

Geophysics · Physics 2025-02-04 Shijun Cheng , Randy Harsuko , Tariq Alkhalifah

This paper introduces a new stochastic optimization method based on the regularized Fisher information matrix (FIM), named SOFIM, which can efficiently utilize the FIM to approximate the Hessian matrix for finding Newton's gradient update…

Machine Learning · Computer Science 2024-05-02 Mrinmay Sen , A. K. Qin , Gayathri C , Raghu Kishore N , Yen-Wei Chen , Balasubramanian Raman

The complexity of the real world demands robotic systems that can intelligently adapt to unseen situations. We present STEER, a robot learning framework that bridges high-level, commonsense reasoning with precise, flexible low-level…

Seismic wave generation creates labeled waveform datasets for source parameter inversion, subsurface analysis, and, notably, training artificial intelligence seismology models. Traditionally, seismic wave generation has been time-consuming,…

Geophysics · Physics 2025-09-23 Longfei Duan , Zicheng Zhang , Lianqing Zhou , Congying Han , Lei Bai , Tiande Guo , Cuiping Zhao

Diffusion magnetic resonance imaging (dMRI) is an important tool in characterizing tissue microstructure based on biophysical models, which are complex and highly non-linear. Resolving microstructures with optimization techniques is prone…

Signal Processing · Electrical Eng. & Systems 2022-05-16 Tianshu Zheng , Cong Sun , Weihao Zheng , Wen Shi , Haotian Li , Yi Sun , Yi Zhang , Guangbin Wang , Chuyang Ye , Dan Wu

Recurrent models have been dominating the field of neural machine translation (NMT) for the past few years. Transformers \citep{vaswani2017attention}, have radically changed it by proposing a novel architecture that relies on a feed-forward…

Computation and Language · Computer Science 2022-10-25 Joyce Zheng , Mehdi Rezagholizadeh , Peyman Passban

Whether it is oil and gas exploration or geological science research, it is necessary to accurately grasp the structural information of underground media. Full waveform inversion is currently the most popular seismic wave inversion method,…

Geophysics · Physics 2024-07-30 Guoxin Chen

When dealing with seismic data, diffusion models often face challenges in adequately capturing local features and expressing spatial relationships. This limitation makes it difficult for diffusion models to remove noise from complex…

Geophysics · Physics 2024-08-14 Wang Mingwei , Li Yong , Liu Yingtian , Peng Junheng , Li Huating

Spatial Transformer Networks (STNs) estimate image transformations that can improve downstream tasks by `zooming in' on relevant regions in an image. However, STNs are hard to train and sensitive to mis-predictions of transformations. To…

Machine Learning · Computer Science 2022-06-16 Pola Schwöbel , Frederik Warburg , Martin Jørgensen , Kristoffer H. Madsen , Søren Hauberg

The recent success of transformer networks for neural machine translation and other NLP tasks has led to a surge in research work trying to apply it for speech recognition. Recent efforts studied key research questions around ways of…

Computation and Language · Computer Science 2020-03-04 Abdelrahman Mohamed , Dmytro Okhonko , Luke Zettlemoyer

Assessing the safety and environmental impacts of subsurface resource exploitation and management is critical and requires robust geomechanical modeling. However, uncertainties stemming from model assumptions, intrinsic variability of…

Numerical Analysis · Mathematics 2025-02-19 Caterina Millevoi , Claudia Zoccarato , Massimiliano Ferronato

Seismic data processing algorithms greatly benefit from regularly sampled and reliable data. Therefore, interpolation and denoising play a fundamental role as one of the starting steps of most seismic processing workflows. We exploit…

Neural and Evolutionary Computing · Computer Science 2019-10-22 Sara Mandelli , Vincenzo Lipari , Paolo Bestagini , Stefano Tubaro

Migration-based earthquake location methods may encounter the polarity reversal issue due to the non-explosive components of seismic source, leading to an unfocused migration image. Various methods have been proposed, yet producing an…

Geophysics · Physics 2023-04-17 Wenhuan Kuang , Jie Zhang , Wei Zhang

The recent exploitation of natural resources and associated waste water injection in the subsurface have induced many small and moderate earthquakes in the tectonically quiet Central United States. This increase in seismic activity has…

Geophysics · Physics 2023-04-18 José Augusto Proença Maia Devienne

In recent years, deep neural networks have significantly impacted the seismic interpretation process. Due to the simple implementation and low interpretation costs, deep neural networks are an attractive component for the common…

Machine Learning · Computer Science 2023-03-01 Ryan Benkert , Oluwaseun Joseph Aribido , Ghassan AlRegib

Inspired by recent work on extended image volumes that lays the ground for randomized probing of extremely large seismic wavefield matrices, we present a memory frugal and computationally efficient inversion methodology that uses techniques…

Geophysics · Physics 2021-04-05 Mathias Louboutin , Felix J. Herrmann

Neural machine translation (NMT) takes deterministic sequences for source representations. However, either word-level or subword-level segmentations have multiple choices to split a source sequence with different word segmentors or…

Computation and Language · Computer Science 2019-06-05 Fengshun Xiao , Jiangtong Li , Hai Zhao , Rui Wang , Kehai Chen

Existing deep calibrated photometric stereo networks basically aggregate observations under different lights based on the pre-defined operations such as linear projection and max pooling. While they are effective with the dense capture,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Satoshi Ikehata

Incorporating prior knowledge on model unknowns of interest is essential when dealing with ill-posed inverse problems due to the nonuniqueness of the solution and data noise. Unfortunately, it is not trivial to fully describe our priors in…

Geophysics · Physics 2021-06-24 Ali Siahkoohi , Gabrio Rizzuti , Felix J. Herrmann

Spatio-Temporal predictive Learning is a self-supervised learning paradigm that enables models to identify spatial and temporal patterns by predicting future frames based on past frames. Traditional methods, which use recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Andrea Alfarano , Alberto Alfarano , Linda Friso , Andrea Bacciu , Irene Amerini , Fabrizio Silvestri