English
Related papers

Related papers: Swin3D: A Pretrained Transformer Backbone for 3D I…

200 papers

Infrared small target detection based on deep learning offers unique advantages in separating small targets from complex and dynamic backgrounds. However, the features of infrared small targets gradually weaken as the depth of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Chun Bao , Jie Cao , Yaqian Ning , Tianhua Zhao , Zhijun Li , Zechen Wang , Li Zhang , Qun Hao

Self-Supervised Learning (SSL) models rely on a pretext task to learn representations. Because this pretext task differs from the downstream tasks used to evaluate the performance of these models, there is an inherent misalignment or…

Machine Learning · Computer Science 2023-04-12 Florian Bordes , Samuel Lavoie , Randall Balestriero , Nicolas Ballas , Pascal Vincent

Ultrasound imaging is crucial for evaluating organ morphology and function, yet depth adjustment can degrade image quality and field-of-view, presenting a depth-dependent dilemma. Traditional interpolation-based zoom-in techniques often…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Jintong Hu , Hui Che , Zishuo Li , Wenming Yang

We aim to obtain an interpretable, expressive, and disentangled scene representation that contains comprehensive structural and textural information for each object. Previous scene representations learned by neural networks are often…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Shunyu Yao , Tzu Ming Harry Hsu , Jun-Yan Zhu , Jiajun Wu , Antonio Torralba , William T. Freeman , Joshua B. Tenenbaum

As a basic component of SE(3)-equivariant deep feature learning, steerable convolution has recently demonstrated its advantages for 3D semantic analysis. The advantages are, however, brought by expensive computations on dense, volumetric…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Jiehong Lin , Hongyang Li , Ke Chen , Jiangbo Lu , Kui Jia

Despite the tantalizing success in a broad of vision tasks, transformers have not yet demonstrated on-par ability as ConvNets in high-resolution image generative modeling. In this paper, we seek to explore using pure transformers to build a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Bowen Zhang , Shuyang Gu , Bo Zhang , Jianmin Bao , Dong Chen , Fang Wen , Yong Wang , Baining Guo

Distortions caused by low-light conditions are not only visually unpleasant but also degrade the performance of computer vision tasks. The restoration and enhancement have proven to be highly beneficial. However, there are only a limited…

Image and Video Processing · Electrical Eng. & Systems 2024-07-15 Ruirui Lin , Nantheera Anantrasirichai , Alexandra Malyugina , David Bull

In recent years, analysis of remote sensing data has benefited immensely from borrowing techniques from the broader field of computer vision, such as the use of shared models pre-trained on large and diverse datasets. However, satellite…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Kartik Jindgar , Grace W. Lindsay

Medical image segmentation is critical for accurate diagnostics and treatment planning, but remains challenging due to complex anatomical structures and limited annotated training data. CNN-based segmentation methods excel at local feature…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Nishchal Sapkota , Haoyan Shi , Yejia Zhang , Xianshi Ma , Bofang Zheng , Fabian Vazquez , Pengfei Gu , Danny Z. Chen

In this work, we address the challenge of Scene Change Detection (SCD), where the goal is to identify variations between two images of the same location captured at different times. Existing SCD models often overlook the varying importance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Jiae Yoon , Ue-Hwan Kim

This paper introduces an approach to enhance seismic fault recognition through self-supervised pretraining. Seismic fault interpretation holds great significance in the fields of geophysics and geology. However, conventional methods for…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Zeren Zhang , Ran Chen , Jinwen Ma

Recently, SpineNet has demonstrated promising results on object detection and image classification over ResNet model. However, it is unclear if the improvement adds up when combining scale-permuted backbone with advanced efficient…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Xianzhi Du , Tsung-Yi Lin , Pengchong Jin , Yin Cui , Mingxing Tan , Quoc Le , Xiaodan Song

The vision community is witnessing a modeling shift from CNNs to Transformers, where pure Transformer architectures have attained top accuracy on the major video recognition benchmarks. These video models are all built on Transformer layers…

Computer Vision and Pattern Recognition · Computer Science 2021-06-25 Ze Liu , Jia Ning , Yue Cao , Yixuan Wei , Zheng Zhang , Stephen Lin , Han Hu

We present a scalable framework for learning deterministic and probabilistic neural surrogates for high-resolution 3D physics simulations. We introduce a hybrid CNN-Transformer backbone architecture targeted for 3D physics simulations,…

Machine Learning · Computer Science 2025-10-09 Benjamin Holzschuh , Georg Kohl , Florian Redinger , Nils Thuerey

Recently, deep learning has been successfully applied to the single-image super-resolution (SISR) with remarkable performance. However, most existing methods focus on building a more complex network with a large number of layers, which can…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Wenbin Zou , Tian Ye , Weixin Zheng , Yunchen Zhang , Liang Chen , Yi Wu

The conversion from 2D X-ray to 3D shape holds significant potential for improving diagnostic efficiency and safety. However, existing reconstruction methods often rely on hand-crafted features, manual intervention, and prior knowledge,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Kuan Liu , Zongyuan Ying , Jie Jin , Dongyan Li , Ping Huang , Wenjian Wu , Zhe Chen , Jin Qi , Yong Lu , Lianfu Deng , Bo Chen

Deep neural network models have achieved remarkable progress in 3D scene understanding while trained in the closed-set setting and with full labels. However, the major bottleneck is that these models do not have the capacity to recognize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kangcheng Liu , Yong-Jin Liu , Baoquan Chen

The deployment of transformers for visual object tracking has shown state-of-the-art results on several benchmarks. However, the transformer-based models are under-utilized for Siamese lightweight tracking due to the computational…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Goutam Yelluru Gopal , Maria A. Amer

Motivated by the advances in 3D sensing technology and the spreading of low-cost robotic platforms, 3D object reconstruction has become a common task in many areas. Nevertheless, the selection of the optimal sensor pose that maximizes the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-27 Miguel Mendoza , J. Irving Vasquez-Gomez , Hind Taud , Luis Enrique Sucar , Carolina Reta

We introduce a novel superpoint-based transformer architecture for efficient semantic segmentation of large-scale 3D scenes. Our method incorporates a fast algorithm to partition point clouds into a hierarchical superpoint structure, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Damien Robert , Hugo Raguet , Loic Landrieu