English
Related papers

Related papers: EfficientMorph: Parameter-Efficient Transformer-Ba…

200 papers

We present KeyMorph, a deep learning-based image registration framework that relies on automatically detecting corresponding keypoints. State-of-the-art deep learning methods for registration often are not robust to large misalignments, are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Alan Q. Wang , Evan M. Yu , Adrian V. Dalca , Mert R. Sabuncu

Equivariant Transformers such as Equiformer have demonstrated the efficacy of applying Transformers to the domain of 3D atomistic systems. However, they are limited to small degrees of equivariant representations due to their computational…

Machine Learning · Computer Science 2024-03-08 Yi-Lun Liao , Brandon Wood , Abhishek Das , Tess Smidt

Video-based behavior recognition is essential in fields such as public safety, intelligent surveillance, and human-computer interaction. Traditional 3D Convolutional Neural Network (3D CNN) effectively capture local spatiotemporal features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Xiuliang Zhang , Tadiwa Elisha Nyamasvisva , Chuntao Liu

Autoregressive transformers have revolutionized high-fidelity image generation. One crucial ingredient lies in the tokenizer, which compresses high-resolution image patches into manageable discrete tokens with a scanning or hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Jinzhi Zhang , Feng Xiong , Mu Xu

Current crowd-counting models often rely on single-modal inputs, such as visual images or wireless signal data, which can result in significant information loss and suboptimal recognition performance. To address these shortcomings, we…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Zhe Cui , Yuli Li , Le-Nam Tran

Temporal Graph Neural Networks have garnered substantial attention for their capacity to model evolving structural and temporal patterns while exhibiting impressive performance. However, it is known that these architectures are encumbered…

Machine Learning · Computer Science 2024-02-12 Mahdi Biparva , Raika Karimi , Faezeh Faez , Yingxue Zhang

Graph Transformers (GTs) have emerged as a powerful paradigm for graph representation learning due to their ability to model diverse node interactions. However, existing GTs often rely on intricate architectural designs tailored to specific…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yujie Xing , Xiao Wang , Bin Wu , Hai Huang , Chuan Shi

The accurate segmentation of medical images is crucial for diagnosing and treating diseases. Recent studies demonstrate that vision transformer-based methods have significantly improved performance in medical image segmentation, primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Wentao Wang , Xi Xiao , Mingjie Liu , Qing Tian , Xuanyao Huang , Qizhen Lan , Swalpa Kumar Roy , Tianyang Wang

Until now, it has been difficult for volumetric super-resolution to utilize the recent advances in transformer-based models seen in 2D super-resolution. The memory required for self-attention in 3D volumes limits the receptive field.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 August Leander Høeg , Sophia W. Bardenfleth , Hans Martin Kjer , Tim B. Dyrby , Vedrana Andersen Dahl , Anders Dahl

This paper presents DeepFLASH, a novel network with efficient training and inference for learning-based medical image registration. In contrast to existing approaches that learn spatial transformations from training data in the high…

Image and Video Processing · Electrical Eng. & Systems 2020-04-07 Jian Wang , Miaomiao Zhang

Deformable image registration plays an essential role in various medical image tasks. Existing deep learning-based deformable registration frameworks primarily utilize convolutional neural networks (CNNs) or Transformers to learn features…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jiong Wu , Kuang Gong

Transformers have achieved success in both language and vision domains. However, it is prohibitively expensive to scale them to long sequences such as long documents or high-resolution images, because self-attention mechanism has quadratic…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Chen Zhu , Wei Ping , Chaowei Xiao , Mohammad Shoeybi , Tom Goldstein , Anima Anandkumar , Bryan Catanzaro

Affine image registration is a cornerstone of medical image analysis. While classical algorithms can achieve excellent accuracy, they solve a time-consuming optimization for every image pair. Deep-learning (DL) methods learn a function that…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Malte Hoffmann , Andrew Hoopes , Douglas N. Greve , Bruce Fischl , Adrian V. Dalca

Unpaired medical image synthesis aims to provide complementary information for an accurate clinical diagnostics, and address challenges in obtaining aligned multi-modal medical scans. Transformer-based models excel in imaging translation…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Vu Minh Hieu Phan , Yutong Xie , Bowen Zhang , Yuankai Qi , Zhibin Liao , Antonios Perperidis , Son Lam Phung , Johan W. Verjans , Minh-Son To

The past several years have seen both an explosion in the use of Convolutional Neural Networks (CNNs) and the design of accelerators to make CNN inference practical. In the architecture community, the lion share of effort has targeted CNN…

Machine Learning · Computer Science 2018-10-17 Kartik Hegde , Rohit Agrawal , Yulun Yao , Christopher W. Fletcher

Entropy modeling is a key component for high-performance image compression algorithms. Recent developments in autoregressive context modeling helped learning-based methods to surpass their classical counterparts. However, the performance of…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 A. Burakhan Koyuncu , Han Gao , Atanas Boev , Georgii Gaikov , Elena Alshina , Eckehard Steinbach

Due to their extreme long-range modeling capability, vision transformer-based networks have become increasingly popular in deformable image registration. We believe, however, that the receptive field of a 5-layer convolutional U-Net is…

Image and Video Processing · Electrical Eng. & Systems 2022-08-16 Xi Jia , Joseph Bartlett , Tianyang Zhang , Wenqi Lu , Zhaowen Qiu , Jinming Duan

Transfer learning has gained attention in medical image analysis due to limited annotated 3D medical datasets for training data-driven deep learning models in the real world. Existing 3D-based methods have transferred the pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Eunji Jun , Seungwoo Jeong , Da-Woon Heo , Heung-Il Suk

We demonstrate an object tracking method for 3D images with fixed computational cost and state-of-the-art performance. Previous methods predicted transformation parameters from convolutional layers. We instead propose an architecture that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Daniel Moyer , Esra Abaci Turk , P Ellen Grant , William M. Wells , Polina Golland

With the advancement in the digital camera technology, the use of high resolution images and videos has been widespread in the modern society. In particular, image and video frame registration is frequently applied in computer graphics and…

Graphics · Computer Science 2020-04-24 Chun Pang Yung , Gary P. T. Choi , Ke Chen , Lok Ming Lui