English
Related papers

Related papers: SSPFormer: Self-Supervised Pretrained Transformer …

200 papers

In text recognition, self-supervised pre-training emerges as a good solution to reduce dependence on expansive annotated real data. Previous studies primarily focus on local visual representation by leveraging mask image modeling or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zuan Gao , Yuxin Wang , Yadong Qu , Boqiang Zhang , Zixiao Wang , Jianjun Xu , Hongtao Xie

Transformers have dominated the field of natural language processing, and recently impacted the computer vision area. In the field of medical image analysis, Transformers have also been successfully applied to full-stack clinical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Kelei He , Chen Gan , Zhuoyuan Li , Islem Rekik , Zihao Yin , Wen Ji , Yang Gao , Qian Wang , Junfeng Zhang , Dinggang Shen

The computer-assisted radiologic informative report is currently emerging in dental practice to facilitate dental care and reduce time consumption in manual panoramic radiographic interpretation. However, the amount of dental radiographs…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Amani Almalki , Longin Jan Latecki

Imaging below the diffraction limit is always a public interest because of the restricted resolution of conventional imaging systems. To beat the limit, evanescent harmonics decaying in space must participate in the imaging process. Here,…

Optics · Physics 2019-10-02 Tie-Jun Huang , Li-Zheng Yin , Ya Shuang , Jiang-Yu Liu , Yunhua Tan , Pu-Kun Liu

Denoising diffusion models offer a promising approach to accelerating magnetic resonance imaging (MRI) and producing diagnostic-level images in an unsupervised manner. However, our study demonstrates that even tiny worst-case potential…

Image and Video Processing · Electrical Eng. & Systems 2024-06-26 Tianyu Han , Sven Nebelung , Firas Khader , Jakob Nikolas Kather , Daniel Truhn

High-resolution magnetic resonance imaging (MRI) is essential in clinical diagnosis. However, its long acquisition time remains a critical issue. Parallel imaging (PI) is a common approach to reduce acquisition time by periodically skipping…

Image and Video Processing · Electrical Eng. & Systems 2025-06-10 Hao Li , Yusheng Zhou , Jianan Liu , Xiling Liu , Tao Huang , Zhihan Lyu , Weidong Cai , Wei Chen

Despite the successes of deep neural networks on many challenging vision tasks, they often fail to generalize to new test domains that are not distributed identically to the training data. The domain adaptation becomes more challenging for…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Devavrat Tomar , Manana Lortkipanidze , Guillaume Vray , Behzad Bozorgtabar , Jean-Philippe Thiran

Supervised deep learning methods have shown promise in undersampled Magnetic Resonance Imaging (MRI) reconstruction, but their requirement for paired data limits their generalizability to the diverse MRI acquisition parameters. Recently,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Wei Jiang , Zhuang Xiong , Feng Liu , Nan Ye , Hongfu Sun

We introduce SurgFormer, a multiresolution gated transformer for data driven soft tissue simulation on volumetric meshes. High fidelity biomechanical solvers are often too costly for interactive use, so we train SurgFormer on solver…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ashkan Shahbazi , Elaheh Akbari , Kyvia Pereira , Jon S. Heiselman , Annie C. Benson , Garrison L. H. Johnston , Jie Ying Wu , Nabil Simaan , Michael I. Miga , Soheil Kolouri

Modeling spatiotemporal brain dynamics from high-dimensional data, such as functional Magnetic Resonance Imaging (fMRI), is a formidable task in neuroscience. Existing approaches for fMRI analysis utilize hand-crafted features, but the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Peter Yongho Kim , Junbeom Kwon , Sunghwan Joo , Sangyoon Bae , Donggyu Lee , Yoonho Jung , Shinjae Yoo , Jiook Cha , Taesup Moon

Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Fahad Shamshad , Salman Khan , Syed Waqas Zamir , Muhammad Haris Khan , Munawar Hayat , Fahad Shahbaz Khan , Huazhu Fu

Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

This paper presents a deep learning method for faster magnetic resonance imaging (MRI) by reducing k-space data with sub-Nyquist sampling strategies and provides a rationale for why the proposed approach works well. Uniform subsampling is…

Machine Learning · Statistics 2019-05-14 Chang Min Hyun , Hwa Pyung Kim , Sung Min Lee , Sungchul Lee , Jin Keun Seo

Imaging through scattering media is a fundamental and pervasive challenge in fields ranging from medical diagnostics to astronomy. A promising strategy to overcome this challenge is wavefront modulation, which induces measurement diversity…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Mingyang Xie , Haiyun Guo , Brandon Y. Feng , Lingbo Jin , Ashok Veeraraghavan , Christopher A. Metzler

Low-field magnetic resonance imaging (MRI) offers a cost-effective alternative for medical imaging in resource-limited settings. However, its widespread adoption is hindered by two key challenges: prolonged scan times and reduced image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Daniel Tweneboah Anyimadu , Mohammed Abdalla , Mohammed M. Abdelsamea , Ahmed Karam Eldaly

Compressed sensing MRI is a classic inverse problem in the field of computational imaging, accelerating the MR imaging by measuring less k-space data. The deep neural network models provide the stronger representation ability and faster…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Zhiwen Fan , Liyan Sun , Xinghao Ding , Yue Huang , Congbo Cai , John Paisley

Masked Image Modeling (MIM) has garnered significant attention in self-supervised learning, thanks to its impressive capacity to learn scalable visual representations tailored for downstream tasks. However, images inherently contain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Wenzhao Xiang , Chang Liu , Hongyang Yu , Xilin Chen

In the past, optimization-based registration models have used spatially-varying regularization to account for deformation variations in different image regions. However, deep learning-based registration models have mostly relied on…

Image and Video Processing · Electrical Eng. & Systems 2023-03-14 Junyu Chen , Yihao Liu , Yufan He , Yong Du

Deep Learning (DL) based methods for magnetic resonance (MR) image reconstruction have been shown to produce superior performance in recent years. However, these methods either only leverage under-sampled data or require a paired…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Pengfei Guo , Vishal M. Patel

Hyperspectral imagery provides rich spectral detail but poses unique challenges because of its high dimensionality in both spatial and spectral domains. We propose \textit{HyperspectralMAE}, a Transformer-based foundation model for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Wooyoung Jeong , Hyun Jae Park , Seonghun Jeong , Jong Wook Jang , Tae Hoon Lim , Dae Seoung Kim