English
Related papers

Related papers: Transformer Meets Boundary Value Inverse Problems

200 papers

A dramatic rise in the flow of manipulated image content on the Internet has led to an aggressive response from the media forensics research community. New efforts have incorporated increased usage of techniques from computer vision and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Aparna Bharati , Daniel Moreira , Patrick Flynn , Anderson Rocha , Kevin Bowyer , Walter Scheirer

Recently, the Transformer model that is based solely on attention mechanisms, has advanced the state-of-the-art on various machine translation tasks. However, recent studies reveal that the lack of recurrence hinders its further improvement…

Computation and Language · Computer Science 2019-04-08 Jie Hao , Xing Wang , Baosong Yang , Longyue Wang , Jinfeng Zhang , Zhaopeng Tu

We consider the inverse problem of determining the geometry of penetrable objects from scattering data generated by one incident wave at a fixed frequency. We first study an orthogonality sampling type method which is fast, simple to…

Numerical Analysis · Mathematics 2022-07-21 Thu Le , Dinh-Liem Nguyen , Vu Nguyen , Trung Truong

The high complexity of various inverse problems poses a significant challenge to model-based reconstruction schemes, which in such situations often reach their limits. At the same time, we witness an exceptional success of data-based…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 T. A. Bubba , G. Kutyniok , M. Lassas , M. März , W. Samek , S. Siltanen , V. Srinivasan

Although deep neural networks have provided impressive gains in performance, these improvements often come at the cost of increased computational complexity and expense. In many cases, such as 3D volume or video classification tasks, not…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Sharath M Shankaranarayana , Soumava Kumar Roy , Prasad Sudhakar , Chandan Aladahalli

Self-supervised learning can significantly improve the performance of downstream tasks, however, the dimensions of learned representations normally lack explicit physical meanings. In this work, we propose a novel self-supervised approach…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-19 Yifan Sun , Xihong Wu

Recent advances in depth sensing technologies allow fast electronic maneuvering of the laser beam, as opposed to fixed mechanical rotations. This will enable future sensors, in principle, to vary in real-time the sampling pattern. We…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Ilya Tcenov , Guy Gilboa

Data transformations (e.g. rotations, reflections, and cropping) play an important role in self-supervised learning. Typically, images are transformed into different views, and neural networks trained on tasks involving these views produce…

Machine Learning · Computer Science 2022-02-04 Chen Qiu , Timo Pfrommer , Marius Kloft , Stephan Mandt , Maja Rudolph

In Electrical Impedance Tomography (EIT) one wants to image the conductivity distribution of a body from current and voltage measurements carried out on its boundary. In this paper we consider the underlying mathematical model, the inverse…

Numerical Analysis · Mathematics 2017-04-10 Andreas Hauptmann , Matteo Santacesaria , Samuli Siltanen

Reconstructed 3D ultrasound volume provides more context information compared to a sequence of 2D scanning frames, which is desirable for various clinical applications such as ultrasound-guided prostate biopsy. Nevertheless, 3D volume…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 Hengtao Guo , Sheng Xu , Bradford J. Wood , Pingkun Yan

We develop a linearized boundary control method for the inverse boundary value problem of determining the damping coefficient in the damped wave equation. The objective is to reconstruct an unknown perturbation in a known background damping…

Analysis of PDEs · Mathematics 2026-03-11 Tianyu Yang , Yang Yang

We propose a novel image sampling method for differentiable image transformation in deep neural networks. The sampling schemes currently used in deep learning, such as Spatial Transformer Networks, rely on bilinear interpolation, which…

Computer Vision and Pattern Recognition · Computer Science 2019-09-11 Wei Jiang , Weiwei Sun , Andrea Tagliasacchi , Eduard Trulls , Kwang Moo Yi

The majority of model-based learned image reconstruction methods in medical imaging have been limited to uniform domains, such as pixelated images. If the underlying model is solved on nonuniform meshes, arising from a finite element method…

Image and Video Processing · Electrical Eng. & Systems 2021-07-12 William Herzberg , Daniel B. Rowe , Andreas Hauptmann , Sarah J. Hamilton

Transformer-based models have been achieving state-of-the-art results in several fields of Natural Language Processing. However, its direct application to speech tasks is not trivial. The nature of this sequences carries problems such as…

Computation and Language · Computer Science 2022-05-17 Gerard Sant , Gerard I. Gállego , Belen Alastruey , Marta R. Costa-Jussà

The real-time crash likelihood prediction model is an essential component of the proactive traffic safety management system. Over the years, numerous studies have attempted to construct a crash likelihood prediction model in order to…

Machine Learning · Computer Science 2023-08-30 B M Tazbiul Hassan Anik , Zubayer Islam , Mohamed Abdel-Aty

The Transformer is a highly successful deep learning model that has revolutionised the world of artificial neural networks, first in natural language processing and later in computer vision. This model is based on the attention mechanism…

Machine Learning · Computer Science 2023-05-09 Riccardo Ughi , Eugenio Lomurno , Matteo Matteucci

This paper proposes a direct sampling method for the inverse problem of magnetic induction tomography (MIT). Our approach defines a class of point spread functions with explicit expressions, which are computed via inner products, leading to…

Numerical Analysis · Mathematics 2026-01-29 Junqing Chen , Chengzhe Jiang

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

Inline holographic imaging presents an ill-posed inverse problem of reconstructing objects' complex amplitude from recorded diffraction patterns. Although recent deep learning approaches have shown promise over classical phase retrieval…

Optics · Physics 2025-07-02 Chanseok Lee , Fakhriyya Mammadova , Jiseong Barg , Mooseok Jang

Deep learning is emerging as a new paradigm for solving inverse imaging problems. However, the deep learning methods often lack the assurance of traditional physics-based methods due to the lack of physical information considerations in…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 Dongdong Chen , Mike E. Davies