English
Related papers

Related papers: Hyper-Transformer for Amodal Completion

200 papers

Accurate beam prediction is essential for maintaining reliable links and high spectral efficiency in dynamic low-altitude wireless networks. However, existing approaches often fail to capture the deep correlations across heterogeneous…

Signal Processing · Electrical Eng. & Systems 2025-12-03 Xiaotong Zhao , Yuanhao Cui , Weijie Yuan , Ziye Jia , Heng Liu , Chengwen Xing

The superior performance of Deformable Convolutional Networks arises from its ability to adapt to the geometric variations of objects. Through an examination of its adaptive behavior, we observe that while the spatial support for its neural…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Xizhou Zhu , Han Hu , Stephen Lin , Jifeng Dai

Pansharpening aims to fuse a registered high-resolution panchromatic image (PAN) with a low-resolution hyperspectral image (LR-HSI) to generate an enhanced HSI with high spectral and spatial resolution. Existing pansharpening approaches…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Wele Gedara Chaminda Bandara , Vishal M. Patel

The crucial role of convolutional models, both as standalone vision models and backbones in foundation models, necessitates effective acceleration techniques. This paper proposes a novel method to learn semi-structured sparsity patterns for…

Machine Learning · Computer Science 2024-11-04 David A. Danhofer

We develop a novel deep contour detection algorithm with a top-down fully convolutional encoder-decoder network. Our proposed method, named TD-CEDN, solves two important issues in this low-level vision problem: (1) learning multi-scale and…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Yahui Liu , Jian Yao , Li Li , Xiaohu Lu , Jing Han

Video amodal segmentation is a particularly challenging task in computer vision, which requires to deduce the full shape of an object from the visible parts of it. Recently, some studies have achieved promising performance by using motion…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ke Fan , Jingshi Lei , Xuelin Qian , Miaopeng Yu , Tianjun Xiao , Tong He , Zheng Zhang , Yanwei Fu

Handling occlusion remains a significant challenge for video instance-level tasks like Multiple Object Tracking (MOT) and Video Instance Segmentation (VIS). In this paper, we propose a novel framework, Amodal-Aware Video Instance…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Minh Tran , Thang Pham , Winston Bounsavy , Tri Nguyen , Ngan Le

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Multimodal remote sensing data, including spectral and lidar or photogrammetry, is crucial for achieving satisfactory land-use / land-cover classification results in urban scenes. So far, most studies have been conducted in a 2D context.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Aldino Rizaldy , Richard Gloaguen , Fabian Ewald Fassnacht , Pedram Ghamisi

Amodal Instance Segmentation (AIS) aims to segment the region of both visible and possible occluded parts of an object instance. While Mask R-CNN-based AIS approaches have shown promising results, they are unable to model high-level…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Minh Tran , Khoa Vo , Kashu Yamazaki , Arthur Fernandes , Michael Kidd , Ngan Le

Place recognition is an important capability for autonomously navigating vehicles operating in complex environments and under changing conditions. It is a key component for tasks such as loop closing in SLAM or global localization. In this…

Robotics · Computer Science 2023-04-21 Junyi Ma , Jun Zhang , Jintao Xu , Rui Ai , Weihao Gu , Xieyuanli Chen

Human fashion understanding is one crucial computer vision task since it has comprehensive information for real-world applications. This focus on joint human fashion segmentation and attribute recognition. Contrary to the previous works…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Shilin Xu , Xiangtai Li , Jingbo Wang , Guangliang Cheng , Yunhai Tong , Dacheng Tao

Amodal panoptic segmentation aims to connect the perception of the world to its cognitive understanding. It entails simultaneously predicting the semantic labels of visible scene regions and the entire shape of traffic participant…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Rohit Mohan , Abhinav Valada

Image inpainting is an ill-posed problem to recover missing or damaged image content based on incomplete images with masks. Previous works usually predict the auxiliary structures (e.g., edges, segmentation and contours) to help fill…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Yongsheng Yu , Dawei Du , Libo Zhang , Tiejian Luo

Applications in fields ranging from home care to warehouse fulfillment to surgical assistance require robots to reliably manipulate the shape of 3D deformable objects. Analytic models of elastic, 3D deformable objects require numerous…

Robotics · Computer Science 2024-02-20 Bao Thach , Brian Y. Cho , Shing-Hei Ho , Tucker Hermans , Alan Kuntz

While the Self-Attention mechanism in the Transformer model has proven to be effective in many domains, we observe that it is less effective in more diverse settings (e.g. multimodality) due to the varying granularity of each token and the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Wayner Barrios , SouYoung Jin

Bridging global context interactions correctly is important for high-fidelity image completion with large masks. Previous methods attempting this via deep or large receptive field (RF) convolutions cannot escape from the dominance of nearby…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Chuanxia Zheng , Tat-Jen Cham , Jianfei Cai , Dinh Phung

Existing computer vision systems can compete with humans in understanding the visible parts of objects, but still fall far short of humans when it comes to depicting the invisible parts of partially occluded objects. Image amodal completion…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Jiayang Ao , Qiuhong Ke , Krista A. Ehinger

Most 3D shape completion approaches rely heavily on partial-complete shape pairs and learn in a fully supervised manner. Despite their impressive performances on in-domain data, when generalizing to partial shapes in other forms or…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Junzhe Zhang , Xinyi Chen , Zhongang Cai , Liang Pan , Haiyu Zhao , Shuai Yi , Chai Kiat Yeo , Bo Dai , Chen Change Loy

Transformer is a promising neural network learner, and has achieved great success in various machine learning tasks. Thanks to the recent prevalence of multimodal applications and big data, Transformer-based multimodal learning has become a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Peng Xu , Xiatian Zhu , David A. Clifton