English
Related papers

Related papers: SSPFormer: Self-Supervised Pretrained Transformer …

200 papers

Long scan duration remains a challenge for high-resolution MRI. Deep learning has emerged as a powerful means for accelerated MRI reconstruction by providing data-driven regularizers that are directly learned from data. These data-driven…

Image and Video Processing · Electrical Eng. & Systems 2020-09-09 Seyed Amir Hossein Hosseini , Burhaneddin Yaman , Steen Moeller , Mehmet Akçakaya

We propose a self-supervised feature learning assisted reconstruction (SSFL-Recon) framework for MRI reconstruction to address the limitation of existing supervised learning methods. Although recent deep learning-based methods have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-05-30 Siying Xu , Marcel Früh , Kerstin Hammernik , Andreas Lingg , Jens Kübler , Patrick Krumm , Daniel Rueckert , Sergios Gatidis , Thomas Küstner

Medical image segmentation is important for computer-aided diagnosis. Good segmentation demands the model to see the big picture and fine details simultaneously, i.e., to learn image features that incorporate large context while keep high…

Image and Video Processing · Electrical Eng. & Systems 2021-06-03 Shaohua Li , Xiuchao Sui , Xiangde Luo , Xinxing Xu , Yong Liu , Rick Goh

Recent advancements in large-scale Vision Transformers have made significant strides in improving pre-trained models for medical image segmentation. However, these methods face a notable challenge in acquiring a substantial amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yiqing Wang , Zihan Li , Jieru Mei , Zihao Wei , Li Liu , Chen Wang , Shengtian Sang , Alan Yuille , Cihang Xie , Yuyin Zhou

Magnetic Resonance Imaging (MRI), including diffusion MRI (dMRI), serves as a ``microscope'' for anatomical structures and routinely mitigates the influence of low signal-to-noise ratio scans by compromising temporal or spatial resolution.…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Chenxu Wu , Qingpeng Kong , Zihang Jiang , S. Kevin Zhou

Unsupervised pre-training has emerged as a transformative paradigm, displaying remarkable advancements in various domains. However, the susceptibility to domain shift, where pre-training data distribution differs from fine-tuning, poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Abhiroop Talasila , Maitreya Maity , U. Deva Priyakumar

Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Pierre Chambon , Christian Bluethgen , Curtis P. Langlotz , Akshay Chaudhari

Learning meaningful and interpretable representations from high-dimensional volumetric magnetic resonance (MR) images is essential for advancing personalized medicine. While Vision Transformers (ViTs) have shown promise in handling image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Qingqiao Hu , Daoan Zhang , Jiebo Luo , Zhenyu Gong , Benedikt Wiestler , Jianguo Zhang , Hongwei Bran Li

In the field of medical images, although various works find Swin Transformer has promising effectiveness on pixelwise dense prediction, whether pre-training these models without using extra dataset can further boost the performance for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xinrong Hu , Dewen Zeng , Yawen Wu , Xueyang Li , Yiyu Shi

Self-supervised learning has demonstrated considerable potential in hyperspectral representation, yet its application in cross-domain transfer scenarios remains under-explored. Existing methods, however, still rely on source domain…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jianshu Chao , Tianhua Lv , Qiqiong Ma , Yunfei Qiu , Li Fang , Huifang Shen , Wei Yao

Blind face restoration is a challenging task due to the unknown and complex degradation. Although face prior-based methods and reference-based methods have recently demonstrated high-quality results, the restored images tend to contain…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Guojing Ge , Qi Song , Guibo Zhu , Yuting Zhang , Jinglu Chen , Miao Xin , Ming Tang , Jinqiao Wang

Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep learning by emulating the event-driven processing manner of the brain. Incorporating Transformers with SNNs has shown promise for accuracy. However,…

Neural and Evolutionary Computing · Computer Science 2024-09-05 Yuetong Fang , Ziqing Wang , Lingfeng Zhang , Jiahang Cao , Honglei Chen , Renjing Xu

Hyperspectral images (HSIs) contain rich spectral and spatial information. Motivated by the success of transformers in the field of natural language processing and computer vision where they have shown the ability to learn long range…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Shaheer Mohamed , Maryam Haghighat , Tharindu Fernando , Sridha Sridharan , Clinton Fookes , Peyman Moghadam

Harnessing the power of pre-training on large-scale datasets like ImageNet forms a fundamental building block for the progress of representation learning-driven solutions in computer vision. Medical images are inherently different from…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Jeya Maria Jose Valanarasu , Yucheng Tang , Dong Yang , Ziyue Xu , Can Zhao , Wenqi Li , Vishal M. Patel , Bennett Landman , Daguang Xu , Yufan He , Vishwesh Nath

The accelerated MRI reconstruction process presents a challenging ill-posed inverse problem due to the extensive under-sampling in k-space. Recently, Vision Transformers (ViTs) have become the mainstream for this task, demonstrating…

Image and Video Processing · Electrical Eng. & Systems 2024-12-17 Yucong Meng , Zhiwei Yang , Yonghong Shi , Zhijian Song

Deformable medical image registration plays an important role in clinical diagnosis and treatment. Recently, the deep learning (DL) based image registration methods have been widely investigated and showed excellent performance in…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Yibo Wang , Wen Qian , Xuming Zhang

Convolutional neural networks (CNNs) have been the consensus for medical image segmentation tasks. However, they suffer from the limitation in modeling long-range dependencies and spatial correlations due to the nature of convolution…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Moein Heidari , Amirhossein Kazerouni , Milad Soltany , Reza Azad , Ehsan Khodapanah Aghdam , Julien Cohen-Adad , Dorit Merhof

Transformers have made remarkable progress towards modeling long-range dependencies within the medical image analysis domain. However, current transformer-based models suffer from several disadvantages: (1) existing methods fail to capture…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Chenyu You , Ruihan Zhao , Fenglin Liu , Siyuan Dong , Sandeep Chinchali , Ufuk Topcu , Lawrence Staib , James S. Duncan

Recently, cross domain transfer has been applied for unsupervised image restoration tasks. However, directly applying existing frameworks would lead to domain-shift problems in translated images due to lack of effective supervision.…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Wenchao Du , Hu Chen , Hongyu Yang

Image demoir\'eing remains a challenging task due to the complex interplay between texture corruption and color distortions caused by moir\'e patterns. Existing methods, especially those relying on direct image-to-image restoration, often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Xiaoyang Liu , Bolin Qiu , Jiezhang Cao , Zheng Chen , Yulun Zhang , Xiaokang Yang