English
Related papers

Related papers: ACIT: Attention-Guided Cross-Modal Interaction Tra…

200 papers

Minimizing traffic accidents between vehicles and pedestrians is one of the primary research goals in intelligent transportation systems. To achieve the goal, pedestrian orientation recognition and prediction of pedestrian's crossing or…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Ue-Hwan Kim , Dongho Ka , Hwasoo Yeo , Jong-Hwan Kim

The Vision Transformer (ViT) excels in global modeling but faces deployment challenges on resource-constrained devices due to the quadratic computational complexity of its attention mechanism. To address this, we propose the Semantic-Aware…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Youbing Hu , Yun Cheng , Anqi Lu , Dawei Wei , Zhijun Li

Predicting the collective motion of a group of pedestrians (a crowd) under the vehicle influence is essential for the development of autonomous vehicles to deal with mixed urban scenarios where interpersonal interaction and vehicle-crowd…

Computer Vision and Pattern Recognition · Computer Science 2019-04-23 Dongfang Yang , Linhui Li , Keith Redmill , Ümit Özgüner

Vision Transformers (ViT) have advanced computer vision, yet their efficacy in complex tasks like driving remains less explored. This study enhances ViT by integrating human eye gaze, captured via eye-tracking, to increase prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Sharath Koorathota , Nikolas Papadopoulos , Jia Li Ma , Shruti Kumar , Xiaoxiao Sun , Arunesh Mittal , Patrick Adelman , Paul Sajda

Motion ability is one of the most important human properties, including gait as a basis of human transitional movement. Gait, as a biometric for recognizing human identities, can be non-intrusively captured signals using wearable or…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Vahid Alizadeh

With the rapid growth of AI-generated content (AIGC) across domains such as music, video, and literature, the demand for emotionally aware recommendation systems has become increasingly important. Traditional recommender systems primarily…

Information Retrieval · Computer Science 2025-12-15 Zheqi Hu , Xuanjing Chen , Jinlin Hu

Effectively utilizing multi-sensory data is important for robots to generalize across diverse tasks. However, the heterogeneous nature of these modalities makes fusion challenging. Existing methods propose strategies to obtain…

Robotics · Computer Science 2025-07-22 Jinzhou Li , Tianhao Wu , Jiyao Zhang , Zeyuan Chen , Haotian Jin , Mingdong Wu , Yujun Shen , Yaodong Yang , Hao Dong

Predicting the trajectories of vehicles is crucial for the development of autonomous driving (AD) systems, particularly in complex and dynamic traffic environments. In this study, we introduce HiT (Human-like Trajectory Prediction), a novel…

Robotics · Computer Science 2025-05-29 Haicheng Liao , Zhenning Li , Guohui Zhang , Keqiang Li , Chengzhong Xu

Assistive teleoperation enhances efficiency via shared control, yet inter-operator variability, stemming from diverse habits and expertise, induces highly heterogeneous trajectory distributions that undermine intent recognition stability.…

Robotics · Computer Science 2026-04-13 Yu Liu , Yihang Yin , Tianlv Huang , Fei Yan , Yuan Xu , Weinan Hong , Wei Han , Yue Cao , Xiangyu Chen , Zipei Fan , Xuan Song

As mobile robots increasingly operate in environments shared with humans, proactively anticipating human motion rather than responding reactively is critical for preempting collisions during close-proximity navigation, while maintaining…

Human-Computer Interaction · Computer Science 2025-11-24 Xiaoshan Zhou , Carol C. Menassa , Vineet R. Kamat

Vehicular platooning promises transformative improvements in transportation efficiency and safety through the coordination of multi-vehicle formations enabled by Vehicle-to-Everything (V2X) communication. However, the distributed nature of…

Cryptography and Security · Computer Science 2025-12-24 Konstantinos Kalogiannis , Ahmed Mohamed Hussain , Hexu Li , Panos Papadimitratos

One of the major challenges for autonomous vehicles in urban environments is to understand and predict other road users' actions, in particular, pedestrians at the point of crossing. The common approach to solving this problem is to use the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Amir Rasouli , Iuliia Kotseruba , John K. Tsotsos

We propose a novel solution for predicting future trajectories of pedestrians. Our method uses a multimodal encoder-decoder transformer architecture, which takes as input both pedestrian locations and ego-vehicle speeds. Notably, our…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Haleh Damirchi , Michael Greenspan , Ali Etemad

Recent advancements in predicting pedestrian crossing intentions for Autonomous Vehicles using Computer Vision and Deep Neural Networks are promising. However, the black-box nature of DNNs poses challenges in understanding how the model…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Mohsen Azarmi , Mahdi Rezaei , He Wang , Ali Arabian

Multispectral pedestrian detection is a technology designed to detect and locate pedestrians in Color and Thermal images, which has been widely used in automatic driving, video surveillance, etc. So far most available multispectral…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yang Yang , Kaixiong Xu , Kaizheng Wang

In the driving scene, the road agents usually conduct frequent interactions and intention understanding of the surroundings. Ego-agent (each road agent itself) predicts what behavior will be engaged by other road users all the time and…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Jianwu Fang , Fan Wang , Jianru Xue , Tat-seng Chua

Traffic predictions play a crucial role in intelligent transportation systems. The rapid development of IoT devices allows us to collect different kinds of data with high correlations to traffic predictions, fostering the development of…

Machine Learning · Computer Science 2024-05-09 Huy Quang Ung , Hao Niu , Minh-Son Dao , Shinya Wada , Atsunori Minamikawa

This paper presents a novel context-based approach for pedestrian motion prediction in crowded, urban intersections, with the additional flexibility of prediction in similar, but new, environments. Previously, Chen et. al. combined…

Machine Learning · Computer Science 2018-06-26 Golnaz Habibi , Nikita Jaipuria , Jonathan P. How

Multimodal emotion recognition has recently gained much attention since it can leverage diverse and complementary relationships over multiple modalities (e.g., audio, visual, biosignals, etc.), and can provide some robustness to noisy…

Analyzing individual emotions during group conversation is crucial in developing intelligent agents capable of natural human-machine interaction. While reliable emotion recognition techniques depend on different modalities (text, audio,…