English
Related papers

Related papers: General-Purpose Multimodal Transformer meets Remot…

200 papers

Recent advances in transformer-based models have drawn attention to exploring these techniques in medical image segmentation, especially in conjunction with the U-Net model (or its variants), which has shown great success in medical image…

Image and Video Processing · Electrical Eng. & Systems 2021-10-22 Xiangyi Yan , Hao Tang , Shanlin Sun , Haoyu Ma , Deying Kong , Xiaohui Xie

Recently, deep-learning-based approaches have been widely studied for deformable image registration task. However, most efforts directly map the composite image representation to spatial transformation through the convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-07-08 Jiashun Chen , Donghuan Lu , Yu Zhang , Dong Wei , Munan Ning , Xinyu Shi , Zhe Xu , Yefeng Zheng

Transformers have proved to be very effective for visual recognition tasks. In particular, vision transformers construct compressed global representations through self-attention and learnable class tokens. Multi-resolution transformers have…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Loic Themyr , Clement Rambour , Nicolas Thome , Toby Collins , Alexandre Hostettler

Convolutional Neural Networks (CNNs) have achieved promising results in medical image segmentation. However, CNNs require lots of training data and are incapable of handling pose and deformation of objects. Furthermore, their pooling layers…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Minh Tran , Viet-Khoa Vo-Ho , Ngan T. H. Le

Recently proposed fine-grained 3D visual grounding is an essential and challenging task, whose goal is to identify the 3D object referred by a natural language sentence from other distractive objects of the same category. Existing works…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Dailan He , Yusheng Zhao , Junyu Luo , Tianrui Hui , Shaofei Huang , Aixi Zhang , Si Liu

Moving object segmentation (MOS) is a task to distinguish moving objects, e.g., moving vehicles and pedestrians, from the surrounding static environment. The segmentation accuracy of MOS can have an influence on odometry, map construction,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Shuo Gu , Suling Yao , Jian Yang , Hui Kong

Accurate segmentation of organs or lesions from medical images is crucial for reliable diagnosis of diseases and organ morphometry. In recent years, convolutional encoder-decoder solutions have achieved substantial progress in the field of…

Image and Video Processing · Electrical Eng. & Systems 2022-07-12 Bingzhi Chen , Yishu Liu , Zheng Zhang , Guangming Lu , Adams Wai Kin Kong

Visual segmentation seeks to partition images, video frames, or point clouds into multiple segments or groups. This technique has numerous real-world applications, such as autonomous driving, image editing, robot sensing, and medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Xiangtai Li , Henghui Ding , Haobo Yuan , Wenwei Zhang , Jiangmiao Pang , Guangliang Cheng , Kai Chen , Ziwei Liu , Chen Change Loy

Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements: combining different modalities and capturing temporal information. During the last years, several works have been proposed in the…

Computation and Language · Computer Science 2022-01-10 Panagiotis Koromilas , Theodoros Giannakopoulos

Vision Transformers (ViT) have recently brought a new wave of research in the field of computer vision. These models have performed particularly well in image classification and segmentation. Research on semantic and instance segmentation…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Ashim Dahal , Saydul Akbar Murad , Nick Rahimi

LiDAR semantic segmentation models are typically trained from random initialization as universal pre-training is hindered by the lack of large, diverse datasets. Moreover, most point cloud segmentation architectures incorporate custom…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Julia Hindel , Rohit Mohan , Jelena Bratulic , Daniele Cattaneo , Thomas Brox , Abhinav Valada

Domain generalization person re-identification (DG-ReID) aims to train a model on source domains and generalize well on unseen domains. Vision Transformer usually yields better generalization ability than common CNN networks under…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Hao Ni , Yuke Li , Lianli Gao , Heng Tao Shen , Jingkuan Song

Progress in self-supervised learning has brought strong general image representation learning methods. Yet so far, it has mostly focused on image-level learning. In turn, tasks such as unsupervised image segmentation have not benefited from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Adrian Ziegler , Yuki M. Asano

In this paper, we propose deformable deep convolutional neural networks for generic object detection. This new deep learning object detection framework has innovations in multiple aspects. In the proposed new deep architecture, a new…

Computer Vision and Pattern Recognition · Computer Science 2015-06-03 Wanli Ouyang , Xiaogang Wang , Xingyu Zeng , Shi Qiu , Ping Luo , Yonglong Tian , Hongsheng Li , Shuo Yang , Zhe Wang , Chen-Change Loy , Xiaoou Tang

We propose a novel convolutional neural network architecture for estimating geospatial functions such as population density, land cover, or land use. In our approach, we combine overhead and ground-level images in an end-to-end trainable…

Computer Vision and Pattern Recognition · Computer Science 2017-08-11 Scott Workman , Menghua Zhai , David J. Crandall , Nathan Jacobs

Precise segmentation of medical images is fundamental for extracting critical clinical information, which plays a pivotal role in enhancing the accuracy of diagnoses, formulating effective treatment plans, and improving patient outcomes.…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Jintong Hu , Siyan Chen , Zhiyi Pan , Sen Zeng , Wenming Yang

Scene understanding enables intelligent agents to interpret and comprehend their environment. While existing large vision-language models (LVLMs) for scene understanding have primarily focused on indoor household tasks, they face two…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Penglei Sun , Yaoxian Song , Xiangru Zhu , Xiang Liu , Qiang Wang , Yue Liu , Changqun Xia , Tiefeng Li , Yang Yang , Xiaowen Chu

Change detection plays a fundamental role in Earth observation for analyzing temporal iterations over time. However, recent studies have largely neglected the utilization of multimodal data that presents significant practical and technical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Biyuan Liu , Huaixin Chen , Kun Li , Michael Ying Yang

Inferring high-dimensional physical states from sparse, ad-hoc sensor arrays is a fundamental challenge across AI for Science and industrial IoT. Standard machine learning architectures struggle in these domains due to irregular,…

Machine Learning · Computer Science 2026-05-08 Zhe Jia , Xiaotian Zhang , Junpeng Li

U-Net and its extensions have achieved great success in medical image segmentation. However, due to the inherent local characteristics of ordinary convolution operations, U-Net encoder cannot effectively extract global context information.…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Fenghe Tang , Lingtao Wang , Chunping Ning , Min Xian , Jianrui Ding