English
Related papers

Related papers: Multi-View Fusion Transformer for Sensor-Based Hum…

200 papers

Human Activity Recognition (HAR) on mobile devices has been demonstrated to be possible using neural models trained on data collected from the device's inertial measurement units. These models have used Convolutional Neural Networks (CNNs),…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Sannara EK , François Portet , Philippe Lalanda

Visual object tracking, which is primarily based on visible light image sequences, encounters numerous challenges in complicated scenarios, such as low light conditions, high dynamic ranges, and background clutter. To address these…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Hongze Sun , Rui Liu , Wuque Cai , Jun Wang , Yue Wang , Huajin Tang , Yan Cui , Dezhong Yao , Daqing Guo

Vision-language models have been key to the development of open-vocabulary 2D semantic segmentation. Lifting these models from 2D images to 3D scenes, however, remains a challenging problem. Existing approaches typically back-project and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Tomas Berriel Martins , Martin R. Oswald , Javier Civera

One of the crucial challenges taken in document analysis is mathematical expression recognition. Unlike text recognition which only focuses on one-dimensional structure images, mathematical expression recognition is a much more complicated…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Anh Duy Le , Van Linh Pham , Vinh Loi Ly , Nam Quan Nguyen , Huu Thang Nguyen , Tuan Anh Tran

MEx: Multi-modal Exercises Dataset is a multi-sensor, multi-modal dataset, implemented to benchmark Human Activity Recognition(HAR) and Multi-modal Fusion algorithms. Collection of this dataset was inspired by the need for recognising and…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Anjana Wijekoon , Nirmalie Wiratunga , Kay Cooper

Many adaptations of transformers have emerged to address the single-modal vision tasks, where self-attention modules are stacked to handle input sources like images. Intuitively, feeding multiple modalities of data to vision transformers…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Yikai Wang , Xinghao Chen , Lele Cao , Wenbing Huang , Fuchun Sun , Yunhe Wang

Human activity recognition (HAR) in ubiquitous computing is beginning to adopt deep learning to substitute for well-established analysis techniques that rely on hand-crafted feature extraction and classification techniques. From these…

Machine Learning · Computer Science 2016-05-02 Nils Y. Hammerla , Shane Halloran , Thomas Ploetz

Image super-resolution (SR) has significantly advanced through the adoption of Transformer architectures. However, conventional techniques aimed at enlarging the self-attention window to capture broader contexts come with inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Chengxing Xie , Xiaoming Zhang , Linze Li , Yuqian Fu , Biao Gong , Tianrui Li , Kai Zhang

Human Action Recognition (HAR) is an interesting research area in human-computer interaction used to monitor the activities of elderly and disabled individuals affected by physical and mental health. In the recent era, skeleton-based HAR…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Faisal Mehmood , Enqing Chen , Touqeer Abbas , Samah M. Alzanin

Fitness movement recognition, a focused subdomain of human activity recognition (HAR), plays a vital role in health monitoring, rehabilitation, and personalized fitness training by enabling automated exercise classification from video data.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Shanjid Hasan Nishat , Srabonti Deb , Mohiuddin Ahmed

Sensor-based human activity recognition (HAR), i.e., the ability to discover human daily activity patterns from wearable or embedded sensors, is a key enabler for many real-world applications in smart homes, personal healthcare, and urban…

Signal Processing · Electrical Eng. & Systems 2021-04-20 Saurav Jha , Martin Schiemer , Franco Zambonelli , Juan Ye

Human activity recognition (HAR) from on-body sensors is a core functionality in many AI applications: from personal health, through sports and wellness to Industry 4.0. A key problem holding up progress in wearable sensor-based HAR,…

Signal Processing · Electrical Eng. & Systems 2024-05-21 Si Zuo , Vitor Fortes Rey , Sungho Suh , Stephan Sigg , Paul Lukowicz

In the domain of intelligent transportation systems (ITS), collaborative perception has emerged as a promising approach to overcome the limitations of individual perception by enabling multiple agents to exchange information, thus enhancing…

Multiagent Systems · Computer Science 2023-05-04 Ahmed N. Ahmed , Siegfried Mercelis , Ali Anwar

Gesture recognition is a much studied research area which has myriad real-world applications including robotics and human-machine interaction. Current gesture recognition methods have focused on recognising isolated gestures, and existing…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Harshala Gammulle , Simon Denman , Sridha Sridharan , Clinton Fookes

Multi-view sequential learning is a fundamental problem in machine learning dealing with multi-view sequences. In a multi-view sequence, there exists two forms of interactions between different views: view-specific interactions and…

Machine Learning · Computer Science 2018-02-06 Amir Zadeh , Paul Pu Liang , Navonil Mazumder , Soujanya Poria , Erik Cambria , Louis-Philippe Morency

Event-based cameras are neuromorphic sensors capable of efficiently encoding visual information in the form of sparse sequences of events. Being biologically inspired, they are commonly used to exploit some of the computational and power…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Marco Cannici , Marco Ciccone , Andrea Romanoni , Matteo Matteucci

In robotics, Vision-Language-Action (VLA) models that integrate diverse multimodal signals from multi-view inputs have emerged as an effective approach. However, most prior work adopts static fusion that processes all visual inputs…

Robotics · Computer Science 2026-02-18 Young-Chae Son , Jung-Woo Lee , Yoon-Ji Choi , Dae-Kwan Ko , Soo-Chul Lim

Cross-Domain Sequential Recommendation (CDSR) predicts user behavior by leveraging historical interactions across multiple domains, focusing on modeling cross-domain preferences through intra- and inter-sequence item relationships. Inspired…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Wangyu Wu , Zhenhong Chen , Siqi Song , Xianglin Qiu , Xiaowei Huang , Fei Ma , Jimin Xiao

Complex human activity recognition (CHAR) remains a pivotal challenge within ubiquitous computing, especially in the context of smart environments. Existing studies typically require meticulous labeling of both atomic and complex…

Artificial Intelligence · Computer Science 2024-08-07 Yuan Sun , Navid Salami Pargoo , Taqiya Ehsan , Zhao Zhang , Jorge Ortiz

Driver Action Recognition (DAR) is crucial in vehicle cabin monitoring systems. In real-world applications, it is common for vehicle cabins to be equipped with cameras featuring different modalities. However, multi-modality fusion…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Dan Lin , Philip Hann Yung Lee , Yiming Li , Ruoyu Wang , Kim-Hui Yap , Bingbing Li , You Shing Ngim