English
Related papers

Related papers: ACIT: Attention-Guided Cross-Modal Interaction Tra…

200 papers

Gaze following aims to interpret human-scene interactions by predicting the person's focal point of gaze. Prevailing approaches often adopt a two-stage framework, whereby multi-modality information is extracted in the initial stage for gaze…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yuehao Song , Xinggang Wang , Jingfeng Yao , Wenyu Liu , Jinglin Zhang , Xiangmin Xu

Learning to predict multiple attributes of a pedestrian is a multi-task learning problem. To share feature representation between two individual task networks, conventional methods like Cross-Stitch and Sluice network learn a linear…

Computer Vision and Pattern Recognition · Computer Science 2020-04-08 Haitian Zeng , Haizhou Ai , Zijie Zhuang , Long Chen

Person Re-Identification (Re-Id) in occlusion scenarios is a challenging problem because a pedestrian can be partially occluded. The use of local information for feature extraction and matching is still necessary. Therefore, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Zhongxing Ma , Yifan Zhao , Jia Li

The task of action-driven human motion prediction aims to forecast future human motion based on the observed sequence while respecting the given action label. It requires modeling not only the stochasticity within human motion but the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Chunzhi Gu , Chao Zhang , Shigeru Kuriyama

The prediction of road users' future motion is a critical task in supporting advanced driver-assistance systems (ADAS). It plays an even more crucial role for autonomous driving (AD) in enabling the planning and execution of safe driving…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Maximilian Schäfer , Kun Zhao , Anton Kummert

A thorough understanding of the interaction between the target agent and surrounding agents is a prerequisite for accurate trajectory prediction. Although many methods have been explored, they assign correlation coefficients to surrounding…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Shiji Huang , Lei Ye , Min Chen , Wenhai Luo , Dihong Wang , Chenqi Xu , Deyuan Liang

Transformer-based methods have shown impressive performance in low-level vision tasks, such as image super-resolution. However, we find that these networks can only utilize a limited spatial range of input information through attribution…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Xiangyu Chen , Xintao Wang , Jiantao Zhou , Yu Qiao , Chao Dong

Although gait recognition has drawn increasing research attention recently, since the silhouette differences are quite subtle in spatial domain, temporal feature representation is crucial for gait recognition. Inspired by the observation…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Duowang Zhu , Xiaohu Huang , Xinggang Wang , Bo Yang , Botao He , Wenyu Liu , Bin Feng

Most models of visual attention aim at predicting either top-down or bottom-up control, as studied using different visual search and free-viewing tasks. In this paper we propose the Human Attention Transformer (HAT), a single model that…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Zhibo Yang , Sounak Mondal , Seoyoung Ahn , Ruoyu Xue , Gregory Zelinsky , Minh Hoai , Dimitris Samaras

Autonomous vehicles navigate in dynamically changing environments under a wide variety of conditions, being continuously influenced by surrounding objects. Modelling interactions among agents is essential for accurately forecasting other…

Machine Learning · Computer Science 2021-06-01 Sandra Carrasco , David Fernández Llorca , Miguel Ángel Sotelo

We propose iMoT, an innovative Transformer-based inertial odometry method that retrieves cross-modal information from motion and rotation modalities for accurate positional estimation. Unlike prior work, during the encoding of the motion…

Machine Learning · Computer Science 2025-01-14 Son Minh Nguyen , Linh Duy Tran , Duc Viet Le , Paul J. M Havinga

Attention-based models, exemplified by the Transformer, can effectively model long range dependency, but suffer from the quadratic complexity of self-attention operation, making them difficult to be adopted for high-resolution image…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Long Zhao , Zizhao Zhang , Ting Chen , Dimitris N. Metaxas , Han Zhang

Safe navigation of autonomous agents in human centric environments requires the ability to understand and predict motion of neighboring pedestrians. However, predicting pedestrian intent is a complex problem. Pedestrian motion is governed…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Jasmine Sekhon , Cody Fleming

Pedestrian trajectory prediction plays a pivotal role in ensuring the safety and efficiency of various applications, including autonomous vehicles and traffic management systems. This paper proposes a novel method for pedestrian trajectory…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Xiuen Wu , Tao Wang , Yuanzheng Cai , Lingyu Liang , George Papageorgiou

Vision Transformers (ViTs) have demonstrated strong performance across a range of computer vision tasks by modeling long-range spatial interactions via self-attention. However, channel-wise mixing in ViTs remains static, relying on fixed…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Aon Safdar , Mohamed Saadeldin

Online 3D multi-object tracking (MOT) has witnessed significant research interest in recent years, largely driven by demand from the autonomous systems community. However, 3D offline MOT is relatively less explored. Labeling 3D trajectory…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Martin Buchner , Abhinav Valada

Gait recognition is a crucial biometric identification technique. Camera-based gait recognition has been widely applied in both research and industrial fields. LiDAR-based gait recognition has also begun to evolve most recently, due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Wenxuan Guo , Yingping Liang , Zhiyu Pan , Ziheng Xi , Jianjiang Feng , Jie Zhou

It is a challenging task to identify a person based on her/his gait patterns. State-of-the-art approaches rely on the analysis of temporal or spatial characteristics of gait, and gait recognition is usually performed on single modality data…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Aite Zhao , Junyu Dong , Jianbo Li , Lin Qi , Huiyu Zhou

Existing top-performance autonomous driving systems typically rely on the multi-modal fusion strategy for reliable scene understanding. This design is however fundamentally restricted due to overlooking the modality-specific strengths and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Zeyu Yang , Nan Song , Wei Li , Xiatian Zhu , Li Zhang , Philip H. S. Torr

Vision Transformers (ViTs) have revolutionized computer vision by leveraging self-attention to model long-range dependencies. However, ViTs face challenges such as high computational costs due to the quadratic scaling of self-attention and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Zhoujie Qian