English
Related papers

Related papers: Friends Across Time: Multi-Scale Action Segmentati…

200 papers

Recent deep multi-view stereo (MVS) methods have widely incorporated transformers into cascade network for high-resolution depth estimation, achieving impressive results. However, existing transformer-based methods are constrained by their…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Sicheng Wang , Hao Jiang , Lei Xiang

Objective: To enable context-aware computer assistance in the operating room of the future, cognitive systems need to understand automatically which surgical phase is being performed by the medical team. The primary source of information…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Isabel Funke , Dominik Rivoir , Stefanie Krell , Stefanie Speidel

This study aims to advance surgical phase recognition in arthroscopic procedures, specifically Anterior Cruciate Ligament (ACL) reconstruction, by introducing the first arthroscopy dataset and developing a novel transformer-based model. We…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Ali Bahari Malayeri , Matthias Seibold , Nicola Cavalcanti , Jonas Hein , Sascha Jecklin , Lazaros Vlachopoulos , Sandro Fucentese , Sandro Hodel , Philipp Furnstahl

Feature shifts have been shown to be useful for action recognition with CNN-based models since Temporal Shift Module (TSM) was proposed. It is based on frame-wise feature extraction with late fusion, and layer features are shifted along the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Ryota Hashiguchi , Toru Tamaki

Surgical context inference has recently garnered significant attention in robot-assisted surgery as it can facilitate workflow analysis, skill assessment, and error detection. However, runtime context inference is challenging since it…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Zongyu Li , Ian Reyes , Homa Alemzadeh

Online continuous action recognition has emerged as a critical research area due to its practical implications in real-world applications, such as human-computer interaction, healthcare, and robotics. Among various modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Rim Slama , Wael Rabah , Hazem Wannous

Trauma is the worldwide leading cause of death and disability in those younger than 45 years, and pelvic fractures are a major source of morbidity and mortality. Automated segmentation of multiple foci of arterial bleeding from…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Yuyin Zhou , David Dreizin , Yingwei Li , Zhishuai Zhang , Yan Wang , Alan Yuille

Automatic surgical phase recognition plays a vital role in robot-assisted surgeries. Existing methods ignored a pivotal problem that surgical phases should be classified by learning segment-level semantics instead of solely relying on…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Xinpeng Ding , Xiaomeng Li

MRI tumor segmentation remains a critical challenge in medical imaging, where volumetric analysis faces unique computational demands due to the complexity of 3D data. The spatially sequential arrangement of adjacent MRI slices provides…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jiacheng Lu , Hui Ding , Shiyu Zhang , Guoping Huo

The point clouds collected by the Airborne Laser Scanning (ALS) system provide accurate 3D information of urban land covers. By utilizing multi-temporal ALS point clouds, semantic changes in urban area can be captured, demonstrating…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Luqi Zhang , Haiping Wang , Chong Liu , Zhen Dong , Bisheng Yang

We study the problem of human action recognition using motion capture (MoCap) sequences. Unlike existing techniques that take multiple manual steps to derive standardized skeleton representations as model input, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Xiaoyu Zhu , Po-Yao Huang , Junwei Liang , Celso M. de Melo , Alexander Hauptmann

Medical image segmentation, a crucial task in computer vision, facilitates the automated delineation of anatomical structures and pathologies, supporting clinicians in diagnosis, treatment planning, and disease monitoring. Notably,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Fuchen Zheng , Xinyi Chen , Xuhang Chen , Haolun Li , Xiaojiao Guo , Weihuang Liu , Chi-Man Pun , Shoujun Zhou

Optical sensing technologies are emerging technologies used in cancer surgeries to ensure the complete removal of cancerous tissue. While point-wise assessment has many potential applications, incorporating automated large area scanning…

Robotics · Computer Science 2024-11-07 Bochen Yang , Kaizhong Deng , Christopher J Peters , George Mylonas , Daniel S. Elson

Deep neural networks, especially transformer-based architectures, have achieved remarkable success in semantic segmentation for environmental perception. However, existing models process video frames independently, thus failing to leverage…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Serin Varghese , Kevin Ross , Fabian Hueger , Kira Maag

Weakly supervised video object segmentation (WSVOS) enables the identification of segmentation maps without requiring an extensive training dataset of object masks, relying instead on coarse video labels indicating object presence. Current…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Guiqiu Liao , Matjaz Jogan , Sai Koushik , Eric Eaton , Daniel A. Hashimoto

Efficiently capturing multi-scale information and building long-range dependencies among pixels are essential for medical image segmentation because of the various sizes and shapes of the lesion regions or organs. In this paper, we present…

Image and Video Processing · Electrical Eng. & Systems 2025-04-18 Hao Shao , Quansheng Zeng , Qibin Hou , Jufeng Yang

Existing state-of-the-art methods for surgical phase recognition either rely on the extraction of spatial-temporal features at a short-range temporal resolution or adopt the sequential extraction of the spatial and temporal features across…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Shu Yang , Luyang Luo , Qiong Wang , Hao Chen

Surgical phase recognition is crucial to providing surgery understanding in smart operating rooms. Despite great progress in automatic surgical phase recognition, most existing methods are still restricted by two problems. First, these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Xingjian Luo , You Pang , Zhen Chen , Jinlin Wu , Zongmin Zhang , Zhen Lei , Hongbin Liu

Multi-Camera Multi-Object Tracking (MC-MOT) utilizes information from multiple views to better handle problems with occlusion and crowded scenes. Recently, the use of graph-based approaches to solve tracking problems has become very…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Cheng-Che Cheng , Min-Xuan Qiu , Chen-Kuo Chiang , Shang-Hong Lai

For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Qianying Liu , Chaitanya Kaul , Jun Wang , Christos Anagnostopoulos , Roderick Murray-Smith , Fani Deligianni