English
Related papers

Related papers: ProSkill: Segment-Level Skill Assessment in Proced…

200 papers

This paper aims to present a novel pipeline for automated surgical skill assessment using video data and to showcase the effectiveness of the proposed approach in evaluating surgeon proficiency, its potential for targeted training…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Arefeh Rezaei , Mohammad Javad Ahmadi , Amir Molaei , Hamid. D. Taghirad

To date, machine learning for human action recognition in video has been widely implemented in sports activities. Although some studies have been successful in the past, precision is still the most significant concern. In this study, we…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Cheng Yan , Xin Li , Guoqiang Li

Reusable skills have become a core substrate for improving agent capabilities, yet most existing skill packages encode reusable behavior primarily as textual prompts, executable code, or learned routines. For visual agents, however,…

Artificial Intelligence · Computer Science 2026-05-15 Kangning Zhang , Shuai Shao , Qingyao Li , Jianghao Lin , Lingyue Fu , Shijian Wang , Wenxiang Jiao , Yuan Lu , Weiwen Liu , Weinan Zhang , Yong Yu

Mastering the technical skills required to perform surgery is an extremely challenging task. Video-based assessment allows surgeons to receive feedback on their technical skills to facilitate learning and development. Currently, this…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Mona Fathollahi , Mohammad Hasan Sarhan , Ramon Pena , Lela DiMonte , Anshu Gupta , Aishani Ataliwala , Jocelyn Barker

Assessing and comparing player skill in online multiplayer gaming environments is essential for fair matchmaking and player engagement. Traditional ranking models like Elo and Glicko-2, designed for two-player games, are insufficient for…

Human-Computer Interaction · Computer Science 2024-01-12 Vivek Joshy

Data valuation and subset selection have emerged as valuable tools for application-specific selection of important training data. However, the efficiency-accuracy tradeoffs of state-of-the-art methods hinder their widespread application to…

Machine Learning · Computer Science 2022-03-15 Soumi Das , Manasvi Sagarkar , Suparna Bhattacharya , Sourangshu Bhattacharya

Goal-oriented planning, or anticipating a series of actions that transition an agent from its current state to a predefined objective, is crucial for developing intelligent assistants aiding users in daily procedural tasks. The problem…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Md Mohaiminul Islam , Tushar Nagarajan , Huiyu Wang , Fu-Jen Chu , Kris Kitani , Gedas Bertasius , Xitong Yang

Agent skills can remarkably improve task success rates by using human-written procedural documents, but their quality is difficult to assess without environment-grounded verification. Existing skill generation methods heavily rely on…

Artificial Intelligence · Computer Science 2026-05-12 Yang Zhou , Zihan Dong , Zhenting Wang , Can Jin , Shiyu Zhao , Bangwei Guo , Difei Gu , Linjun Zhang , Mu Zhou , Dimitris N. Metaxas

Prescriptive Process Monitoring (PresPM) recommends interventions during business processes to optimize key performance indicators (KPIs). In realistic settings, interventions are rarely isolated: organizations need to align sequences of…

Machine Learning · Computer Science 2026-01-12 Jakob De Moor , Hans Weytjens , Johannes De Smedt , Jochen De Weerdt

Procedural activities, ranging from routine cooking to complex surgical operations, are highly structured sequences of actions performed in a specific temporal order. Despite the success of current self-supervised learning (SSL) methods on…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Chengan Che , Chao Wang , Xinyue Chen , Sophia Tsoka , Luis C. Garcia-Peraza-Herrera

In this paper, we propose Skip-Plan, a condensed action space learning method for procedure planning in instructional videos. Current procedure planning methods all stick to the state-action pair prediction at every timestep and generate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Zhiheng Li , Wenjia Geng , Muheng Li , Lei Chen , Yansong Tang , Jiwen Lu , Jie Zhou

Learning from (procedural) videos has increasingly served as a pathway for embodied agents to acquire skills from human demonstrations. To do this, video understanding models must be able to obtain structured understandings, such as the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zitian Tang , Rohan Myer Krishnan , Zhiqiu Yu , Chen Sun

Recent advances in large language models (LLMs) have improved reasoning in text and image domains, yet achieving robust video reasoning remains a significant challenge. Existing video benchmarks mainly assess shallow understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Xuchen Li , Xuzhao Li , Shiyu Hu , Kaiqi Huang , Wentao Zhang

Human action recognition and analysis have great demand and important application significance in video surveillance, video retrieval, and human-computer interaction. The task of human action quality evaluation requires the intelligent…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Shunli Wang , Dingkang Yang , Peng Zhai , Qing Yu , Tao Suo , Zhan Sun , Ka Li , Lihua Zhang

Matchmaking systems are vital for creating fair matches in online multiplayer games, which directly affects players' satisfactions and game experience. Most of the matchmaking systems largely rely on precise estimation of players' game…

Machine Learning · Computer Science 2022-08-17 Chaoyun Zhang , Kai Wang , Hao Chen , Ge Fan , Yingjie Li , Lifang Wu , Bingchao Zheng

Progress in speech processing has been facilitated by shared datasets and benchmarks. Historically these have focused on automatic speech recognition (ASR), speaker identification, or other lower-level tasks. Interest has been growing in…

Computation and Language · Computer Science 2022-08-01 Suwon Shon , Ankita Pasad , Felix Wu , Pablo Brusco , Yoav Artzi , Karen Livescu , Kyu J. Han

Active learning (AL) is a subfield of machine learning (ML) in which a learning algorithm could achieve good accuracy with less training samples by interactively querying a user/oracle to label new data points. Pool-based AL is…

Machine Learning · Computer Science 2020-10-19 Xueying Zhan , Antoni Bert Chan

Agent Skills have become a practical way to extend LLM agents by packaging metadata, natural-language instructions, and executable resources into reusable capability bundles. However, this growing Skill ecosystem introduces a new compliance…

Cryptography and Security · Computer Science 2026-05-08 Jiangrong Wu , Yuhong Nan , Yixi Lin , Huaijin Wang , Yuming Xiao , Shuai Wang , Zibin Zheng

Skills have become a practical packaging mechanism for agent instructions, workflows, scripts, and reference materials. In enterprise settings, however, a skill often needs to express more than task guidance: goals, input boundaries,…

Software Engineering · Computer Science 2026-05-26 Ting Liu

Visual parsing of images and videos is critical for a wide range of real-world applications. However, progress in this field is constrained by limitations of existing datasets: (1) insufficient annotation granularity, which impedes…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Minghao Zou , Qingtian Zeng , Yongping Miao , Shangkun Liu , Zilong Wang , Hantao Liu , Wei Zhou