English
Related papers

Related papers: Video-Based Performance Evaluation for ECR Drills …

200 papers

Reinforcement learning (RL) and Deep Reinforcement Learning (DRL), in particular, have the potential to disrupt and are already changing the way we interact with the world. One of the key indicators of their applicability is their ability…

Machine Learning · Computer Science 2024-08-20 Nikolai Rozanov

Real-time Stereo Matching is a cornerstone algorithm for many Extended Reality (XR) applications, such as indoor 3D understanding, video pass-through, and mixed-reality games. Despite significant advancements in deep stereo methods,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Ziang Cheng , Jiayu Yang , Hongdong Li

Although cognitive engagement (CE) is crucial for motor learning, it remains underutilized in rehabilitation robots, partly because its assessment currently relies on subjective and gross measurements taken intermittently. Here, we propose…

Robotics · Computer Science 2020-02-20 Neelesh Kumar , Konstantinos P. Michmizos

Human understanding of video dynamics relies on forming structured representations of entities, actions, and temporal relations before engaging in abstract reasoning. In contrast, existing Video-LLMs apply unstructured chain-of-thought…

Computation and Language · Computer Science 2026-05-08 Zinuo Li , Yongxin Guo , Jun Liu , Jiawei Zhan , Xi Jiang , Chengjie Wang , Mohammed Bennamoun , Farid Boussaid , Feng Zheng , Qiuhong Ke

Despite advances in reinforcement learning (RL)-based video reasoning with large language models (LLMs), data collection and fine-tuning remain significant challenges. These methods often rely on large-scale supervised fine-tuning (SFT)…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Ziyang Wang , Jaehong Yoon , Shoubin Yu , Md Mohaiminul Islam , Gedas Bertasius , Mohit Bansal

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

Machine Learning · Computer Science 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

In the training process of Deep Reinforcement Learning (DRL), agents require repetitive interactions with the environment. With an increase in training volume and model complexity, it is still a challenging problem to enhance data…

Machine Learning · Computer Science 2024-05-15 Jingwen Wang , Dehui Du , Yida Li , Yiyang Li , Yikang Chen

Video generative models can be regarded as world simulators due to their ability to capture dynamic, continuous changes inherent in real-world environments. These models integrate high-dimensional information across visual, temporal,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Hengyuan Cao , Yutong Feng , Biao Gong , Yijing Tian , Yunhong Lu , Chuang Liu , Bin Wang

In recent years, \emph{Reinforcement Learning} (RL) has made remarkable progress, achieving superhuman performance in a wide range of simulated environments. As research moves toward deploying RL in real-world applications, the field faces…

ECG is an attractive option to assess stress in serious Virtual Reality (VR) applications due to its non-invasive nature. However, the existing Machine Learning (ML) models perform poorly. Moreover, existing studies only perform a binary…

Machine Learning · Computer Science 2021-07-12 Zeeshan Ahmad , Suha Rabbani , Muhammad Rehman Zafar , Syem Ishaque , Sridhar Krishnan , Naimul Khan

Key challenges for the deployment of reinforcement learning (RL) agents in the real world are the discovery, representation and reuse of skills in the absence of a reward function. To this end, we propose a novel approach to learn a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Oier Mees , Markus Merklinger , Gabriel Kalweit , Wolfram Burgard

Equipping drones with target search capabilities is highly desirable for applications in disaster rescue and smart warehouse delivery systems. Multiple intelligent drones that can collaborate with each other and maneuver among obstacles…

Robotics · Computer Science 2023-11-28 Jiaping Xiao , Phumrapee Pisutsin , Mir Feroskhan

Understanding the content of events occurring in the video and their inherent temporal logic is crucial for video-text retrieval. However, web-crawled pre-training datasets often lack sufficient event information, and the widely adopted…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Zongyang Ma , Ziqi Zhang , Yuxin Chen , Zhongang Qi , Chunfeng Yuan , Bing Li , Yingmin Luo , Xu Li , Xiaojuan Qi , Ying Shan , Weiming Hu

This paper explores the potential of event cameras to enable continuous time reinforcement learning. We formalise this problem where a continuous stream of unsynchronised observations is used to produce a corresponding stream of output…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Celyn Walters , Simon Hadfield

Ergonomic risk assessment is now, due to an increased awareness, carried out more often than in the past. The conventional risk assessment evaluation, based on expert-assisted observation of the workplaces and manually filling in score…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Manlio Massiris Fernández , Sanjin Radoš , Krešimir Matković , M. Eduard Gröller , Claudio Delrieux

Video action detection (spatio-temporal action localization) is usually the starting point for human-centric intelligent analysis of videos nowadays. It has high practical impacts for many applications across robotics, security, healthcare,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Xin Hu , Zhenyu Wu , Hao-Yu Miao , Siqi Fan , Taiyu Long , Zhenyu Hu , Pengcheng Pi , Yi Wu , Zhou Ren , Zhangyang Wang , Gang Hua

Reinforcement learning (RL) is a machine learning approach that trains agents to maximize cumulative rewards through interactions with environments. The integration of RL with deep learning has recently resulted in impressive achievements…

Neural and Evolutionary Computing · Computer Science 2023-08-31 Hui Bai , Ran Cheng , Yaochu Jin

Video understanding tasks take many forms, from action detection to visual query localization and spatio-temporal grounding of sentences. These tasks differ in the type of inputs (only video, or video-query pair where query is an image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Raghav Goyal , Effrosyni Mavroudi , Xitong Yang , Sainbayar Sukhbaatar , Leonid Sigal , Matt Feiszli , Lorenzo Torresani , Du Tran

This work explores techniques to scale up image-based end-to-end learning for dexterous grasping with an arm + hand system. Unlike state-based RL, vision-based RL is much more memory inefficient, resulting in relatively low batch sizes,…

Robotics · Computer Science 2025-09-23 Ritvik Singh , Karl Van Wyk , Pieter Abbeel , Jitendra Malik , Nathan Ratliff , Ankur Handa

Recent advances in video analytics address real-time data drift by continuously retraining specialized, lightweight DNN models for individual cameras. However, the current practice of retraining a separate model for each camera suffers from…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-15 Yuze He , Ferdi Kossmann , Srinivasan Seshan , Peter Steenkiste