English
Related papers

Related papers: Transformer Meets Boundary Value Inverse Problems

200 papers

With the improvement of the pattern recognition and feature extraction of Deep Neural Networks (DPNNs), image-based design and optimization have been widely used in multidisciplinary researches. Recently, a Reconstructive Neural Network…

Other Computer Science · Computer Science 2019-06-04 Yu Li , Hu Wang , Wenquan Shuai , Honghao Zhang , Yong Peng

Transformers are deep neural network architectures that underpin the recent successes of large language models. Unlike more classical architectures that can be viewed as point-to-point maps, a Transformer acts as a measure-to-measure map…

Optimization and Control · Mathematics 2026-02-16 Borjan Geshkovski , Philippe Rigollet , Domènec Ruiz-Balet

The quality of patient care associated with diagnostic radiology is proportionate to a physician workload. Segmentation is a fundamental limiting precursor to both diagnostic and therapeutic procedures. Advances in machine learning (ML) aim…

Image and Video Processing · Electrical Eng. & Systems 2022-08-30 Ahmed Ghorbel , Ahmed Aldahdooh , Shadi Albarqouni , Wassim Hamidouche

Recent advances in AI-powered image editing tools have significantly lowered the barrier to image modification, raising pressing security concerns those related to spreading misinformation and disinformation on social platforms. Image…

Image and Video Processing · Electrical Eng. & Systems 2024-08-27 Keyang Zhang , Chenqi Kong , Shiqi Wang , Anderson Rocha , Haoliang Li

Tomographic imaging is in general an ill-posed inverse problem. Typically, a single regularized image estimate of the sought-after object is obtained from tomographic measurements. However, there may be multiple objects that are all…

Image and Video Processing · Electrical Eng. & Systems 2022-07-28 Sayantan Bhadra , Umberto Villa , Mark A. Anastasio

Applying convolutional neural networks to large images is computationally expensive because the amount of computation scales linearly with the number of image pixels. We present a novel recurrent neural network model that is capable of…

Machine Learning · Computer Science 2014-06-25 Volodymyr Mnih , Nicolas Heess , Alex Graves , Koray Kavukcuoglu

Variational method and deep learning method are two mainstream powerful approaches to solve inverse problems in computer vision. To take advantages of advanced optimization algorithms and powerful representation ability of deep neural…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Qingchao Zhang , Yunmei Chen

Deep learning-based methods have revolutionized the field of imaging inverse problems, yielding state-of-the-art performance across various imaging domains. The best performing networks incorporate the imaging operator within the network…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Romain Vo , Julián Tachella

Recent advancements in attention mechanisms have replaced recurrent neural networks and its variants for machine translation tasks. Transformer using attention mechanism solely achieved state-of-the-art results in sequence modeling. Neural…

Computation and Language · Computer Science 2020-04-02 Prakhar Thapak , Prodip Hore

This paper is concerned with the inverse problem of reconstructing an inhomogeneous medium from the acoustic far-field data at a fixed frequency in two dimensions. This inverse problem is severely ill-posed (and also strongly nonlinear),…

Numerical Analysis · Mathematics 2023-09-21 Kai Li , Bo Zhang , Haiwen Zhang

Boundary representation (B-rep) is the industry standard for computer-aided design (CAD). While deep learning shows promise in processing B-rep models, existing methods suffer from a representation gap: continuous approaches offer…

Machine Learning · Computer Science 2026-02-10 Yuanxu Sun , Yuezhou Ma , Haixu Wu , Guanyang Zeng , Muye Chen , Jianmin Wang , Mingsheng Long

We introduce Diffusion Active Learning, a novel approach that combines generative diffusion modeling with data-driven sequential experimental design to adaptively acquire data for inverse problems. Although broadly applicable, we focus on…

Machine Learning · Computer Science 2025-04-07 Luis Barba , Johannes Kirschner , Tomas Aidukas , Manuel Guizar-Sicairos , Benjamín Béjar

Transformers have recently gained attention in the computer vision domain due to their ability to model long-range dependencies. However, the self-attention mechanism, which is the core part of the Transformer model, usually suffers from…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Reza Azad , René Arimond , Ehsan Khodapanah Aghdam , Amirhossein Kazerouni , Dorit Merhof

The direct parametrisation method for invariant manifold is a model-order reduction technique that can be applied to nonlinear systems described by PDEs and discretised e.g. with a finite element procedure in order to derive efficient…

Numerical Analysis · Mathematics 2024-03-19 Alessandra Vizzaccaro , Giorgio Gobat , Attilio Frangi , Cyril Touzé

In the past few years, deep learning-based methods have demonstrated enormous success for solving inverse problems in medical imaging. In this work, we address the following question:\textit{Given a set of measurements obtained from real…

Image and Video Processing · Electrical Eng. & Systems 2019-05-24 Ortal Senouf , Sanketh Vedula , Tomer Weiss , Alex Bronstein , Oleg Michailovich , Michael Zibulevsky

Inverse source localization from Helmholtz boundary data collected over a narrow aperture is highly ill-posed and severely undersampled, undermining classical solvers (e.g., the Direct Sampling Method). We present a modular framework that…

Numerical Analysis · Mathematics 2025-10-31 Guanyu Pan , Jianing Zhou , Xiaotong Liu , Yunqing Huang , Nianyu Yi

Traffic forecasting is an indispensable part of Intelligent transportation systems (ITS), and long-term network-wide accurate traffic speed forecasting is one of the most challenging tasks. Recently, deep learning methods have become…

Artificial Intelligence · Computer Science 2021-04-13 Haoyang Yan , Xiaolei Ma

Recent advances in meta-optics have enabled diverse functionalities in compact optical devices; however, conventional forward design approaches become inadequate as device complexity and scale grow. Inverse design offers a powerful…

In numerous practical applications, especially in medical image reconstruction, it is often infeasible to obtain a large ensemble of ground-truth/measurement pairs for supervised learning. Therefore, it is imperative to develop unsupervised…

Image and Video Processing · Electrical Eng. & Systems 2021-03-31 Subhadip Mukherjee , Ozan Öktem , Carola-Bibiane Schönlieb

Anomaly detection in computer vision is the task of identifying images which deviate from a set of normal images. A common approach is to train deep convolutional autoencoders to inpaint covered parts of an image and compare the output with…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Jonathan Pirnay , Keng Chai