English
Related papers

Related papers: Transformer Meets Boundary Value Inverse Problems

200 papers

Graph transformers have gained popularity in various graph-based tasks by addressing challenges faced by traditional Graph Neural Networks. However, the quadratic complexity of self-attention operations and the extensive layering in graph…

Machine Learning · Computer Science 2023-09-20 Reza Shirkavand , Heng Huang

In this work, we propose a model order reduction framework to deal with inverse problems in a non-intrusive setting. Inverse problems, especially in a partial differential equation context, require a huge computational load due to the…

Numerical Analysis · Mathematics 2024-01-22 Anna Ivagnes , Nicola Demo , Gianluigi Rozza

Despite their ubiquity in core AI fields like natural language processing, the mechanics of deep attention-based neural networks like the Transformer model are not fully understood. In this article, we present a new perspective towards…

Machine Learning · Computer Science 2021-06-04 Matthew A. Wright , Joseph E. Gonzalez

Transformers have revolutionized deep learning in numerous fields, including natural language processing, computer vision, and audio processing. Their strength lies in their attention mechanism, which allows for the discovering of complex…

Machine Learning · Computer Science 2024-04-02 Uladzislau Yorsh , Martin Holeňa , Ondřej Bojar , David Herel

The magnetic inverse source problem of reconstructing the positions and currents of very long parallel conductors is considered in a two-dimensional situation, with applications to power line measurements. The input data is the magnetic…

Mathematical Physics · Physics 2013-02-27 Martin Norgren

Diffuse optical tomography (DOT) utilises near-infrared light for imaging spatially distributed optical parameters, typically the absorption and scattering coefficients. The image reconstruction problem of DOT is an ill-posed inverse…

Computational Physics · Physics 2021-12-15 Meghdoot Mozumder , Andreas Hauptmann , Ilkka Nissilä , Simon R. Arridge , Tanja Tarvainen

We present an end-to-end framework for generating solutions to combinatorial optimization problems with unknown components using transformer-based sequence-to-sequence neural networks. Our framework learns directly from past solutions and…

Optimization and Control · Mathematics 2026-02-06 Macarena Navarro , Willem-Jan van Hoeve , Karan Singh

Inverse problems exist in many domains such as phase imaging, image processing, and computer vision. These problems are often solved with application-specific algorithms, even though their nature remains the same: mapping input image(s) to…

Computational Physics · Physics 2021-10-22 Feng Wang , Alberto Eljarrat , Johannes Müller , Trond Henninen , Erni Rolf , Christoph Koch

Inverse source problems are central to many applications in acoustics, geophysics, non-destructive testing, and more. Traditional imaging methods suffer from the resolution limit, preventing distinction of sources separated by less than the…

Machine Learning · Computer Science 2022-08-11 Adar Kahana , Symeon Papadimitropoulos , Eli Turkel , Dmitry Batenkov

We tackle the problem of automatically reconstructing a complete 3D model of a scene from a single RGB image. This challenging task requires inferring the shape of both visible and occluded surfaces. Our approach utilizes viewer-centered,…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Daeyun Shin , Zhile Ren , Erik B. Sudderth , Charless C. Fowlkes

Inverse problems have many applications in science and engineering. In Computer vision, several image restoration tasks such as inpainting, deblurring, and super-resolution can be formally modeled as inverse problems. Recently, methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Sai Bharath Chandra Gutha , Ricardo Vinuesa , Hossein Azizpour

Mathematical methods of step-by-step and combined shifts are proposed for experimental data processing to reconstruct the measuring system impulse response distorted by shift-invariant blur. Proposed methods base on direct non-blind…

Signal Processing · Electrical Eng. & Systems 2019-01-24 Andrey V. Novikov-Borodin

To increase the flexibility and scalability of deep neural networks for image reconstruction, a framework is proposed based on bandpass filtering. For many applications, sensing measurements are performed indirectly. For example, in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Joseph Y. Cheng , Feiyu Chen , Marcus T. Alley , John M. Pauly , Shreyas S. Vasanawala

Geophysical inversion attempts to estimate the distribution of physical properties in the Earth's interior from observations collected at or above the surface. Inverse problems are commonly posed as least-squares optimization problems in…

Geophysics · Physics 2019-05-22 Vladimir Puzyrev

Image deblurring continues to achieve impressive performance with the development of generative models. Nonetheless, there still remains a displeasing problem if one wants to improve perceptual quality and quantitative scores of recovered…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Pengwei Liang , Junjun Jiang , Xianming Liu , Jiayi Ma

Contrastive learning methods for time series anomaly detection (TSAD) heavily depend on the quality of negative sample construction. However, existing strategies based on random perturbations or pseudo-anomaly injection often struggle to…

Machine Learning · Computer Science 2026-03-20 Xiancheng Wang , Lin Wang , Zhibo Zhang , Rui Wang , Minghang Zhao

We show how to eliminate the error caused by an incorrectly modeled boundary in electrical impedance tomography (EIT). In practical measurements, one usually lacks the exact knowledge of the boundary. Because of this the numerical…

Analysis of PDEs · Mathematics 2007-05-23 Ville Kolehmainen , Matti Lassas , Petri Ola

Transformers with powerful global relation modeling abilities have been introduced to fundamental computer vision tasks recently. As a typical example, the Vision Transformer (ViT) directly applies a pure transformer architecture on image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Xiaoyu Yue , Shuyang Sun , Zhanghui Kuang , Meng Wei , Philip Torr , Wayne Zhang , Dahua Lin

In this work we deal with parametric inverse problems, which consist in recovering a finite number of parameters describing the structure of an unknown object, from indirect measurements. State-of-the-art methods for approximating a…

Numerical Analysis · Mathematics 2021-12-22 Paolo Massa , Sara Garbarino , Federico Benvenuto

Computed tomography (CT) has become an essential part of modern science and medicine. A CT scanner consists of an X-ray source that is spun around an object of interest. On the opposite end of the X-ray source, a detector captures X-rays…

Image and Video Processing · Electrical Eng. & Systems 2023-09-14 Thomas Germer , Jan Robine , Sebastian Konietzny , Stefan Harmeling , Tobias Uelwer