English
Related papers

Related papers: Self-Supervised Learning-Based Multimodal Predicti…

200 papers

In the era of intelligent transportation, driver behavior profiling has become a beneficial technology as it provides knowledge regarding the driver's aggressiveness. Previous approaches achieved promising driver behavior profiling…

Machine Learning · Computer Science 2021-08-12 Young Ah Choi , Kyung Ho Park , Eunji Park , Huy Kang Kim

Large-scale self-supervised models have recently revolutionized our ability to perform a variety of tasks within the vision and language domains. However, using such models for autonomous systems is challenging because of safety…

Robotics · Computer Science 2023-03-09 Yue Meng , Sai Vemprala , Rogerio Bonatti , Chuchu Fan , Ashish Kapoor

For autonomous agents to successfully operate in real world, the ability to anticipate future motions of surrounding entities in the scene can greatly enhance their safety levels since potentially dangerous situations could be avoided in…

Machine Learning · Computer Science 2019-06-04 Yeping Hu , Wei Zhan , Liting Sun , Masayoshi Tomizuka

Mental health conditions remain underdiagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications for the…

Mental health conditions remain under-diagnosed even in countries with common access to advanced medical care. The ability to accurately and efficiently predict mood from easily collectible data has several important implications towards…

Autonomous mobile robots require accurate human motion predictions to safely and efficiently navigate among pedestrians, whose behavior may adapt to environmental changes. This paper introduces a self-supervised continual learning framework…

Robotics · Computer Science 2022-02-16 Luzia Knoedler , Chadi Salmi , Hai Zhu , Bruno Brito , Javier Alonso-Mora

In the context of mobile sensing environments, various sensors on mobile devices continually generate a vast amount of data. Analyzing this ever-increasing data presents several challenges, including limited access to annotated data and a…

Machine Learning · Computer Science 2023-05-02 Jason Liu , Shohreh Deldari , Hao Xue , Van Nguyen , Flora D. Salim

This work presents a methodology for modeling and predicting human behavior in settings with N humans interacting in highly multimodal scenarios (i.e. where there are many possible highly-distinct futures). A motivating example includes…

Robotics · Computer Science 2018-07-27 Boris Ivanovic , Edward Schmerling , Karen Leung , Marco Pavone

Accurate human trajectory prediction is crucial for applications such as autonomous vehicles, robotics, and surveillance systems. Yet, existing models often fail to fully leverage the non-verbal social cues human subconsciously communicate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Saeed Saadatnejad , Yang Gao , Kaouther Messaoud , Alexandre Alahi

Machine learning approaches have become popular for molecular modeling tasks, including molecular force fields and properties prediction. Traditional supervised learning methods suffer from scarcity of labeled data for particular tasks,…

Chemical Physics · Physics 2022-11-29 Xiang Gao , Weihao Gao , Wenzhi Xiao , Zhirui Wang , Chong Wang , Liang Xiang

With the growing popularity of wearable devices, the ability to utilize physiological data collected from these devices to predict the wearer's mental state such as mood and stress suggests great clinical applications, yet such a task is…

Machine Learning · Computer Science 2019-06-28 Abhinav Shaw , Natcha Simsiri , Iman Deznaby , Madalina Fiterau , Tauhidur Rahaman

Emotion recognition models using audio input data can enable the development of interactive systems with applications in mental healthcare, marketing, gaming, and social media analysis. While the field of affective computing using audio…

Sound · Computer Science 2023-07-25 Peranut Nimitsurachat , Peter Washington

Context plays a significant role in the generation of motion for dynamic agents in interactive environments. This work proposes a modular method that utilises a learned model of the environment for motion prediction. This modularity…

Machine Learning · Computer Science 2021-01-05 Todor Davchev , Michael Burke , Subramanian Ramamoorthy

Distinguishing if an action is performed as intended or if an intended action fails is an important skill that not only humans have, but that is also important for intelligent systems that operate in human environments. Recognizing if an…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Olga Zatsarynna , Yazan Abu Farha , Juergen Gall

Developing agents that can execute multiple skills by learning from pre-collected datasets is an important problem in robotics, where online interaction with the environment is extremely time-consuming. Moreover, manually designing reward…

Individual-level human mobility prediction has emerged as a significant topic of research with applications in infectious disease monitoring, child, and elderly care. Existing studies predominantly focus on the microscopic aspects of human…

Machine Learning · Computer Science 2025-08-20 Yueyang Liu , Lance Kennedy , Ruochen Kong , Joon-Seok Kim , Andreas Züfle

Self-supervised learning has attracted plenty of recent research interest. However, most works for self-supervision in speech are typically unimodal and there has been limited work that studies the interaction between audio and visual…

Audio and Speech Processing · Electrical Eng. & Systems 2021-03-19 Abhinav Shukla , Stavros Petridis , Maja Pantic

Predicting the behaviour (i.e., manoeuvre/trajectory) of other road users, including vehicles, is critical for the safe and efficient operation of autonomous vehicles (AVs), a.k.a., automated driving systems (ADSs). Due to the uncertain…

Machine Learning · Computer Science 2023-07-27 Sajjad Mozaffari , Mreza Alipour Sormoli , Konstantinos Koufos , Mehrdad Dianati

Autonomous cars have to navigate in dynamic environment which can be full of uncertainties. The uncertainties can come either from sensor limitations such as occlusions and limited sensor range, or from probabilistic prediction of other…

Robotics · Computer Science 2019-05-06 Liting Sun , Wei Zhan , Ching-Yao Chan , Masayoshi Tomizuka

The scarcity of labeled action data poses a considerable challenge for developing machine learning algorithms for robotic object manipulation. It is expensive and often infeasible for a robot to interact with many objects. Conversely,…

Robotics · Computer Science 2024-12-03 Emily Liu , Michael Noseworthy , Nicholas Roy