English
Related papers

Related papers: Virtual Fusion with Contrastive Learning for Singl…

200 papers

Detecting human actions is a crucial task for autonomous robots and vehicles, often requiring the integration of various data modalities for improved accuracy. In this study, we introduce a novel approach to Human Action Recognition (HAR)…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Mohammad Mahdavian , Mohammad Loni , Ted Samuelsson , Mo Chen

Although autonomous vehicles (AVs) are expected to revolutionize transportation, robust perception across a wide range of driving contexts remains a significant challenge. Techniques to fuse sensor data from camera, radar, and lidar sensors…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Arnav Vaibhav Malawade , Trier Mortlock , Mohammad Abdullah Al Faruque

Wearable Human Activity Recognition (WHAR) is a prominent research area within ubiquitous computing. Multi-sensor synchronous measurement has proven to be more effective for WHAR than using a single sensor. However, existing WHAR methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Haoyu Xie , Haoxuan Li , Chunyuan Zheng , Haonan Yuan , Guorui Liao , Jun Liao , Li Liu

We address the well-known wearable activity recognition problem of having to work with sensors that are non-optimal in terms of information they provide but have to be used due to wearability/usability concerns (e.g. the need to work with…

Machine Learning · Computer Science 2022-10-05 Vitor Fortes Rey , Sungho Suh , Paul Lukowicz

Cross-modal contrastive pre-training between natural language and other modalities, e.g., vision and audio, has demonstrated astonishing performance and effectiveness across a diverse variety of tasks and domains. In this paper, we…

Machine Learning · Computer Science 2024-08-23 Harish Haresamudram , Apoorva Beedu , Mashfiqui Rabbi , Sankalita Saha , Irfan Essa , Thomas Ploetz

Human Activity Recognition (HAR) is an ongoing research topic. It has applications in medical support, sports, fitness, social networking, human-computer interfaces, senior care, entertainment, surveillance, and the list goes on.…

Human-Computer Interaction · Computer Science 2021-11-11 Hamza Ali Imran , Saad Wazir , Usman Iftikhar , Usama Latif

Contrastive learning has been applied to Human Activity Recognition (HAR) based on sensor data owing to its ability to achieve performance comparable to supervised learning with a large amount of unlabeled data and a small amount of labeled…

Computer Vision and Pattern Recognition · Computer Science 2022-03-24 Jinqiang Wang , Tao Zhu , Liming Chen , Huansheng Ning , Yaping Wan

Tactile information plays a crucial role in human manipulation tasks and has recently garnered increasing attention in robotic manipulation. However, existing approaches mostly focus on the alignment of visual and tactile features and the…

Human Action Recognition (HAR) aims to understand human behavior and assign a label to each action. It has a wide range of applications, and therefore has been attracting increasing attention in the field of computer vision. Human actions…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zehua Sun , Qiuhong Ke , Hossein Rahmani , Mohammed Bennamoun , Gang Wang , Jun Liu

Human activity recognition (HAR) based on mobile sensors plays an important role in ubiquitous computing. However, the rise of data regulatory constraints precludes collecting private and labeled signal data from personal devices at scale.…

Signal Processing · Electrical Eng. & Systems 2021-06-02 Chenglin Li , Di Niu , Bei Jiang , Xiao Zuo , Jianming Yang

Action recognition from multi-modal and multi-view observations holds significant potential for applications in surveillance, robotics, and smart environments. However, existing methods often fall short of addressing real-world challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Trung Thanh Nguyen , Yasutomo Kawanishi , Vijay John , Takahiro Komamizu , Ichiro Ide

A major bottleneck in training robust Human-Activity Recognition models (HAR) is the need for large-scale labeled sensor datasets. Because labeling large amounts of sensor data is an expensive task, unsupervised and semi-supervised learning…

Machine Learning · Computer Science 2022-02-03 Yash Jain , Chi Ian Tang , Chulhong Min , Fahim Kawsar , Akhil Mathur

Sensor-based Human Activity Recognition (HAR) is crucial in ubiquitous computing, analysing behaviours through multi-dimensional observations. Despite research progress, HAR confronts challenges, particularly in data distribution…

Signal Processing · Electrical Eng. & Systems 2025-03-05 Xiaozhou Ye , Kouichi Sakurai , Nirmal Nair , Kevin I-Kai Wang

Transformers have excelled in natural language processing and computer vision, paving their way to sensor-based Human Activity Recognition (HAR). Previous studies show that transformers outperform their counterparts exclusively when they…

Machine Learning · Computer Science 2024-10-18 Clayton Souza Leite , Henry Mauranen , Aziza Zhanabatyrova , Yu Xiao

Feature extraction is crucial for human activity recognition (HAR) using body-worn movement sensors. Recently, learned representations have been used successfully, offering promising alternatives to manually engineered features. Our work…

Machine Learning · Computer Science 2020-12-11 Harish Haresamudram , Irfan Essa , Thomas Ploetz

A significant challenge in object detection is accurate identification of an object's position in image space, whereas one algorithm with one set of parameters is usually not enough, and the fusion of multiple algorithms and/or parameters…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Pan Wei , John E. Ball , Derek T. Anderson

Being able to assess the confidence of individual predictions in machine learning models is crucial for decision making scenarios. Specially, in critical applications such as medical diagnosis, security, and unmanned vehicles, to name a…

Machine Learning · Computer Science 2024-02-20 Enrique Garcia-Ceja

Wearable-based Human Activity Recognition (HAR) is a key task in human-centric machine learning due to its fundamental understanding of human behaviours. Due to the dynamic nature of human behaviours, continual learning promises HAR systems…

Machine Learning · Computer Science 2024-01-05 Chi Ian Tang , Lorena Qendro , Dimitris Spathis , Fahim Kawsar , Akhil Mathur , Cecilia Mascolo

In this study, we propose a method for single sensor-based activity recognition, trained with data from multiple sensors. There is no doubt that the performance of complex activity recognition systems increases when we use enough sensors…

Human-Computer Interaction · Computer Science 2020-02-27 Paula Lago , Moe Matsuki , Sozo Inoue

Inference of three-dimensional motion from the fusion of inertial and visual sensory data has to contend with the preponderance of outliers in the latter. Robust filtering deals with the joint inference and classification task of selecting…

Robotics · Computer Science 2014-12-17 Konstantine Tsotsos , Alessandro Chiuso , Stefano Soatto