English
Related papers

Related papers: Interacting Attention Graph for Single Image Two-H…

200 papers

Infrared and visible image fusion aims to extract complementary features to synthesize a single fused image. Many methods employ convolutional neural networks (CNNs) to extract local features due to its translation invariance and locality.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Jing Li , Lu Bai , Bin Yang , Chang Li , Lingfei Ma , Edwin R. Hancock

Local features at neighboring spatial positions in feature maps have high correlation since their receptive fields are often overlapped. Self-attention usually uses the weighted sum (or other functions) with internal elements of each local…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Yang Du , Chunfeng Yuan , Bing Li , Lili Zhao , Yangxi Li , Weiming Hu

Graph Convolutional Networks (GCNs) are state-of-the-art graph based representation learning models by iteratively stacking multiple layers of convolution aggregation operations and non-linear activation operations. Recently, in…

Information Retrieval · Computer Science 2020-01-29 Lei Chen , Le Wu , Richang Hong , Kun Zhang , Meng Wang

The success of motion prediction for autonomous driving relies on integration of information from the HD maps. As maps are naturally graph-structured, investigation on graph neural networks (GNNs) for encoding HD maps is burgeoning in…

Artificial Intelligence · Computer Science 2022-09-07 Fang Da , Yu Zhang

In skeleton-based action recognition, graph convolutional networks (GCNs), which model the human body skeletons as spatiotemporal graphs, have achieved remarkable performance. However, in existing GCN-based methods, the topology of the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Lei Shi , Yifan Zhang , Jian Cheng , Hanqing Lu

Point cloud completion is essential for robotic perception, object reconstruction and supporting downstream tasks like grasp planning, obstacle avoidance, and manipulation. However, incomplete geometry caused by self-occlusion and sensor…

Robotics · Computer Science 2025-09-18 Yadan Zeng , Jiadong Zhou , Xiaohan Li , I-Ming Chen

Geometric deep learning provides a principled and versatile manner for the integration of imaging and non-imaging modalities in the medical domain. Graph Convolutional Networks (GCNs) in particular have been explored on a wide variety of…

Benefiting from powerful convolutional neural networks (CNNs), learning-based image inpainting methods have made significant breakthroughs over the years. However, some nature of CNNs (e.g. local prior, spatially shared parameters) limit…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Ye Deng , Siqi Hui , Sanping Zhou , Deyu Meng , Jinjun Wang

Graph Convolutional Network (GCN) has achieved extraordinary success in learning effective task-specific representations of nodes in graphs. However, regarding Heterogeneous Information Network (HIN), existing HIN-oriented GCN methods still…

Machine Learning · Computer Science 2021-09-09 Yaming Yang , Ziyu Guan , Jianxin Li , Wei Zhao , Jiangtao Cui , Quan Wang

Recent deep learning based image inpainting methods which utilize contextual information and two-stage architecture have exhibited remarkable performance. However, the two-stage architecture is time-consuming, the contextual information…

Computer Vision and Pattern Recognition · Computer Science 2019-12-19 Hongyu Liu , Bin Jiang , Wei Huang , Chao Yang

3D interacting hand pose estimation from a single RGB image is a challenging task, due to serious self-occlusion and inter-occlusion towards hands, confusing similar appearance patterns between 2 hands, ill-posed joint position mapping from…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Changlong Jiang , Yang Xiao , Cunlin Wu , Mingyang Zhang , Jinghong Zheng , Zhiguo Cao , Joey Tianyi Zhou

Aiming at the problems that the convolutional neural networks neglect to capture the inherent attributes of natural images and extract features only in a single scale in the field of image super-resolution reconstruction, a network…

Image and Video Processing · Electrical Eng. & Systems 2020-04-09 Jiawen Lyn , Sen Yan

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

Graph neural networks are powerful architectures for structured datasets. However, current methods struggle to represent long-range dependencies. Scaling the depth or width of GNNs is insufficient to broaden receptive fields as larger GNNs…

Machine Learning · Computer Science 2022-01-24 Zhanghao Wu , Paras Jain , Matthew A. Wright , Azalia Mirhoseini , Joseph E. Gonzalez , Ion Stoica

Accurately matching local features between a pair of images is a challenging computer vision task. Previous studies typically use attention based graph neural networks (GNNs) with fully-connected graphs over keypoints within/across images…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Zizhuo Li , Jiayi Ma

We propose an extension to the transformer neural network architecture for general-purpose graph learning by adding a dedicated pathway for pairwise structural information, called edge channels. The resultant framework - which we call…

Machine Learning · Computer Science 2022-06-06 Md Shamim Hussain , Mohammed J. Zaki , Dharmashankar Subramanian

In this paper, we consider the challenging task of simultaneously locating and recovering multiple hands from a single 2D image. Previous studies either focus on single hand reconstruction or solve this problem in a multi-stage way.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Jinwei Ren , Jianke Zhu , Jialiang Zhang

Deep neural networks need to make robust inference in the presence of occlusion, background clutter, pose and viewpoint variations -- to name a few -- when the task of person re-identification is considered. Attention mechanisms have…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Jieming Zhou , Soumava Kumar Roy , Pengfei Fang , Mehrtash Harandi , Lars Petersson

Human action recognition is one of the challenging tasks in computer vision. The current action recognition methods use computationally expensive models for learning spatio-temporal dependencies of the action. Models utilizing RGB channels…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Labina Shrestha , Shikha Dubey , Farrukh Olimov , Muhammad Aasim Rafique , Moongu Jeon

We introduce Attention Graphs, a new tool for mechanistic interpretability of Graph Neural Networks (GNNs) and Graph Transformers based on the mathematical equivalence between message passing in GNNs and the self-attention mechanism in…

Machine Learning · Computer Science 2025-02-26 Batu El , Deepro Choudhury , Pietro Liò , Chaitanya K. Joshi