English
Related papers

Related papers: Deep Learning-Enabled Modality Transfer Between In…

200 papers

Magnetic resonance imaging (MRI) is a widely used non-invasive imaging modality. However, a persistent challenge lies in balancing image quality with imaging speed. This trade-off is primarily constrained by k-space measurements, which…

Image and Video Processing · Electrical Eng. & Systems 2025-11-19 Guanxiong Luo , Shoujin Huang , Martin Uecker

Accurate segmentation of laryngo-pharyngeal tumors is crucial for precise diagnosis and effective treatment planning. However, traditional single-modality imaging methods often fall short of capturing the complex anatomical and pathological…

Image and Video Processing · Electrical Eng. & Systems 2025-08-26 Junhao Wu , Yun Li , Junhao Li , Jingliang Bian , Xiaomao Fan , Wenbin Lei , Ruxin Wang

Multi-modal image registration is a crucial pre-processing step in many medical applications. However, it is a challenging task due to the complex intensity relationships between different imaging modalities, which can result in large…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Vasiliki Sideri-Lampretsa , Veronika A. Zimmer , Huaqi Qiu , Georgios Kaissis , Daniel Rueckert

Deep learning-based image processing is capable of creating highly appealing results. However, it is still widely considered as a "blackbox" transformation. In medical imaging, this lack of comprehensibility of the results is a sensitive…

Image and Video Processing · Electrical Eng. & Systems 2020-05-29 Bernhard Stimpel , Christopher Syben , Franziska Schirrmacher , Philipp Hoelter , Arnd Dörfler , Andreas Maier

Magnetic resonance imaging (MRI) is a crucial medical imaging modality. However, long acquisition times remain a significant challenge, leading to increased costs, and reduced patient comfort. Recent studies have shown the potential of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Amirmohammad Shamaei , Alexander Stebner , Salome , Bosshart , Johanna Ospel , Gouri Ginde , Mariana Bento , Roberto Souza

We report resolution enhancement in scanning electron microscopy (SEM) images using a generative adversarial network. We demonstrate the veracity of this deep learning-based super-resolution technique by inferring unresolved features in…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Kevin de Haan , Zachary S. Ballard , Yair Rivenson , Yichen Wu , Aydogan Ozcan

When multimode optical fibers are perturbed, the data that is transmitted through them is scrambled. This presents a major difficulty for many possible applications, such as multimode fiber-based telecommunication and endoscopy. To overcome…

Image and Video Processing · Electrical Eng. & Systems 2022-02-17 Shachar Resisi , Sebastien M. Popoff , Yaron Bromberg

Image restoration aims to enhance low quality images, producing high quality images that exhibit natural visual characteristics and fine semantic attributes. Recently, the diffusion model has emerged as a powerful technique for image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiangtong Tan , Feng Zhao

In portable, 3-D, or ultra-fast ultrasound (US) imaging systems, there is an increasing demand to reconstruct high quality images from limited number of data. However, the existing solutions require either hardware changes or…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Yeo Hun Yoon , Jong Chul Ye

High spatial and temporal resolution across the whole brain is essential to accurately resolve neural activities in fMRI. Therefore, accelerated imaging techniques target improved coverage with high spatio-temporal resolution. Simultaneous…

Image and Video Processing · Electrical Eng. & Systems 2021-05-13 Omer Burak Demirel , Burhaneddin Yaman , Logan Dowdle , Steen Moeller , Luca Vizioli , Essa Yacoub , John Strupp , Cheryl A. Olman , Kâmil Uğurbil , Mehmet Akçakaya

Unified multimodal models aim to integrate understanding (text output) and generation (pixel output), but aligning these different modalities within a single architecture often demands complex training recipes and careful data balancing. We…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Xichen Pan , Satya Narayan Shukla , Aashu Singh , Zhuokai Zhao , Shlok Kumar Mishra , Jialiang Wang , Zhiyang Xu , Jiuhai Chen , Kunpeng Li , Felix Juefei-Xu , Ji Hou , Saining Xie

Deep learning methods have impacted almost every research field, demonstrating notable successes in medical imaging tasks such as denoising and super-resolution. However, the prerequisite for deep learning is data at scale, but data sharing…

Medical Physics · Physics 2024-02-16 Yongyi Shi , Wenjun Xia , Chuang Niu , Christopher Wiedeman , Ge Wang

A diversified dataset is crucial for training a well-generalized supervised computer vision algorithm. However, in the field of microbiology, generation and annotation of a diverse dataset including field-taken images are time consuming,…

Image and Video Processing · Electrical Eng. & Systems 2023-06-13 Saber Mirzaee Bafti , Chee Siang Ang , Gianluca Marcelli , Md. Moinul Hossain , Sadiya Maxamhud , Anastasios D. Tsaousis

Empowered by deep learning, recent methods for material capture can estimate a spatially-varying reflectance from a single photograph. Such lightweight capture is in stark contrast with the tens or hundreds of pictures required by…

Graphics · Computer Science 2019-06-28 Valentin Deschaintre , Miika Aittala , Fredo Durand , George Drettakis , Adrien Bousseau

This paper presents DeepFLASH, a novel network with efficient training and inference for learning-based medical image registration. In contrast to existing approaches that learn spatial transformations from training data in the high…

Image and Video Processing · Electrical Eng. & Systems 2020-04-07 Jian Wang , Miaomiao Zhang

We combine generative adversarial network (GAN) with light microscopy to achieve deep learning super-resolution under a large field of view (FOV). By appropriately adopting prior microscopy data in an adversarial training, the neural…

Image and Video Processing · Electrical Eng. & Systems 2018-10-04 Hao Zhang , Xinlin Xie , Chunyu Fang , Yicong Yang , Di Jin , Peng Fei

Microscopy image analysis is fundamental for different applications, from diagnosis to synthetic engineering and environmental monitoring. Modern acquisition systems have granted the possibility to acquire an escalating amount of images,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Jacopo Dapueto , Vito Paolo Pastore , Nicoletta Noceti , Francesca Odone

Self-supervised methods have recently proved to be nearly as effective as supervised ones in various imaging inverse problems, paving the way for learning-based approaches in scientific and medical imaging applications where ground truth…

Image and Video Processing · Electrical Eng. & Systems 2026-01-30 Jérémy Scanvic , Mike Davies , Patrice Abry , Julián Tachella

High annotation costs are a substantial bottleneck in applying modern deep learning architectures to clinically relevant medical use cases, substantiating the need for novel algorithms to learn from unlabeled data. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Aiham Taleb , Matthias Kirchler , Remo Monti , Christoph Lippert

We propose a novel deep-learning framework for super-resolution ultrasound images and videos in terms of spatial resolution and line reconstruction. We up-sample the acquired low-resolution image through a vision-based interpolation method;…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Simone Cammarasana , Paolo Nicolardi , Giuseppe Patanè