English
Related papers

Related papers: Multimodal Data Fusion to Capture Dynamic Interact…

200 papers

Characterizing the dynamic interactive patterns of complex systems helps gain in-depth understanding of how components interrelate with each other while performing certain functions as a whole. In this study, we present a novel multimodal…

Machine Learning · Computer Science 2019-01-07 Miaolin Fan , Chun-An Chou , Sheng-Che Yen , Yingzi Lin

Today's densely instrumented world offers tremendous opportunities for continuous acquisition and analysis of multimodal sensor data providing temporal characterization of an individual's behaviors. Is it possible to efficiently couple such…

Machine Learning · Computer Science 2018-09-03 Homa Hosseinmardi , Amir Ghasemian , Shrikanth Narayanan , Kristina Lerman , Emilio Ferrara

Transportation planning plays a critical role in shaping urban development, economic mobility, and infrastructure sustainability. However, traditional planning methods often struggle to accurately predict long-term urban growth and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Eugene Denteh , Andrews Danyo , Joshua Kofi Asamoah , Blessing Agyei Kyem , Twitchell Addai , Armstrong Aboah

Navigating dense and dynamic environments poses a significant challenge for autonomous driving systems, owing to the intricate nature of multimodal interaction, wherein the actions of various traffic participants and the autonomous vehicle…

Robotics · Computer Science 2024-08-29 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

This paper presents a novel multimodal perception system for a real open environment. The proposed system includes an embedded computation platform, cameras, ultrasonic sensors, GPS, and IMU devices. Unlike the traditional frameworks, our…

Robotics · Computer Science 2024-12-03 Yuyang Sha

Forecasting urban phenomena such as housing prices and public health indicators requires the effective integration of various geospatial data. Current methods primarily utilize task-specific models, while recent foundation models for…

Machine Learning · Computer Science 2025-10-16 Dominik J. Mühlematter , Lin Che , Ye Hong , Martin Raubal , Nina Wiedemann

Human-machine interaction has been around for several decades now, with new applications emerging every day. One of the major goals that remain to be achieved is designing an interaction similar to how a human interacts with another human.…

Human-Computer Interaction · Computer Science 2022-12-27 Tauheed Khan Mohd , Nicole Nguyen , Ahmad Y Javaid

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

Biometrics plays a significant role in vision-based surveillance applications. Soft biometrics such as gait is widely used with face in surveillance tasks like person recognition and re-identification. Nevertheless, in practical scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Ashwin Prakash , Thejaswin S , Athira Nambiar , Alexandre Bernardino

One of the major challenges for autonomous vehicles in urban environments is to understand and predict other road users' actions, in particular, pedestrians at the point of crossing. The common approach to solving this problem is to use the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-15 Amir Rasouli , Iuliia Kotseruba , John K. Tsotsos

Traditional urban planning methodologies often fail to capture the complexity of contemporary urbanization and environmental sustainability challenges. This study investigates the integration of Generative Design, Virtual Reality (VR), and…

Human-Computer Interaction · Computer Science 2025-04-22 Viet Hung Pham , Malte Wagenfeld , Regina Bernhaupt

We present results from a set of experiments in this pilot study to investigate the causal influence of user activity on various environmental parameters monitored by occupant carried multi-purpose sensors. Hypotheses with respect to each…

Human-Computer Interaction · Computer Science 2016-11-17 Ming Jin , Han Zou , Kevin Weekly , Ruoxi Jia , Alexandre M. Bayen , Costas J. Spanos

Personal space, also known as peripersonal space, is crucial in human social interaction, influencing comfort, communication, and social stress. Estimating and respecting personal space is essential for enhancing human-computer interaction…

Human-Computer Interaction · Computer Science 2025-06-10 Ko Watanabe , Nico Förster , Shoya Ishimaru

The last decade's market has been characterized by wearable devices, mainly smartwatches, edge, and cloud computing. A possible application of these technologies is to improve the safety of dangerous activities, especially driving motor…

Emerging Technologies · Computer Science 2023-09-22 Jacopo Sini , Luigi Pugliese , Sara Groppo , Michele Guagnano , Massimo Violante

Multimodal sensor fusion has demonstrated remarkable performance improvements over unimodal approaches in 3D object detection for autonomous vehicles. Typically, existing methods transform multimodal data from independent sensors, such as…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Markus Essl , Marta Moscati , Mubashir Noman , Muhammad Zaigham Zaheer , Usman Naseem , Shah Nawaz , Markus Schedl

Recommendation systems have lately been popularized globally, with primary use cases in online interaction systems, with significant focus on e-commerce platforms. We have developed a machine learning-based recommendation platform, which…

One of the most crucial yet challenging tasks for autonomous vehicles in urban environments is predicting the future behaviour of nearby pedestrians, especially at points of crossing. Predicting behaviour depends on many social and…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Tiffany Yau , Saber Malekmohammadi , Amir Rasouli , Peter Lakner , Mohsen Rohani , Jun Luo

The natural interaction and control performance of lower limb rehabilitation robots are closely linked to biomechanical information from various human locomotion activities. Multidimensional human motion data significantly deepen the…

This survey paper concerns Sensor Fusion for Predictive Control of Human-Prosthesis-Environment Dynamics in Assistive Walking. The powered lower limb prosthesis can imitate the human limb motion and help amputees to recover the walking…

Robotics · Computer Science 2019-03-25 Kuangen Zhang , Clarence W. de Silva , Chenglong Fu

Monitoring fatigue is essential for improving safety, particularly for people who work long shifts or in high-demand workplaces. The development of wearable technologies, such as fitness trackers and smartwatches, has made it possible to…

Human-Computer Interaction · Computer Science 2024-12-24 Kourosh Kakhi , Senthil Kumar Jagatheesaperumal , Abbas Khosravi , Roohallah Alizadehsani , U Rajendra Acharya