English
Related papers

Related papers: VISAGE: Video Synthesis using Action Graphs for Su…

200 papers

This paper tackles the challenge of automatically performing realistic surgical simulations from readily available surgical videos. Recent efforts have successfully integrated physically grounded dynamics within 3D Gaussians to perform…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Kailing Wang , Chen Yang , Keyang Zhao , Xiaokang Yang , Wei Shen

Understanding and anticipating intraoperative events and actions is critical for intraoperative assistance and decision-making during minimally invasive surgery. Automated prediction of events, actions, and the following consequences is…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Lianhao Yin , Yutong Ban , Jennifer Eckhoff , Ozanan Meireles , Daniela Rus , Guy Rosman

Articulated hand pose tracking is an under-explored problem that carries the potential for use in an extensive number of applications, especially in the medical domain. With a robust and accurate tracking system on surgical videos, the…

Computer Vision and Pattern Recognition · Computer Science 2025-02-10 Nathan Louis , Luowei Zhou , Steven J. Yule , Roger D. Dias , Milisa Manojlovich , Francis D. Pagani , Donald S. Likosky , Jason J. Corso

The field of medical image segmentation is challenged by domain generalization (DG) due to domain shifts in clinical datasets. The DG challenge is exacerbated by the scarcity of medical data and privacy concerns. Traditional single-source…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Qiang Qiao , Wenyu Wang , Meixia Qu , Kun Su , Bin Jiang , Qiang Guo

Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic…

Graph-based holistic scene representations facilitate surgical workflow understanding and have recently demonstrated significant success. However, this task is often hindered by the limited availability of densely annotated surgical scene…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Çağhan Köksal , Ghazal Ghazaei , Felix Holm , Azade Farshad , Nassir Navab

This paper introduces an innovative methodology for producing high-quality 3D lung CT images guided by textual information. While diffusion-based generative models are increasingly used in medical imaging, current state-of-the-art…

Image and Video Processing · Electrical Eng. & Systems 2024-10-16 Yanwu Xu , Li Sun , Wei Peng , Shuyue Jia , Katelyn Morrison , Adam Perer , Afrooz Zandifar , Shyam Visweswaran , Motahhare Eslami , Kayhan Batmanghelich

Surgical phase recognition from video is a technology that automatically classifies the progress of a surgical procedure and has a wide range of potential applications, including real-time surgical support, optimization of medical…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Satoshi Kondo

Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Shan Lin , Albert J. Miao , Jingpei Lu , Shunkai Yu , Zih-Yun Chiu , Florian Richter , Michael C. Yip

Multi-view video reconstruction plays a vital role in computer vision, enabling applications in film production, virtual reality, and motion analysis. While recent advances such as 4D Gaussian Splatting (4DGS) have demonstrated impressive…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhixin Xu , Hengyu Zhou , Yuan Liu , Wenhan Xue , Hao Pan , Wenping Wang , Bin Wang

The recent successes in applying deep learning techniques to solve standard computer vision problems has aspired researchers to propose new computer vision problems in different domains. As previously established in the field, training data…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Mehran Khodabandeh , Hamid Reza Vaezi Joze , Ilya Zharkov , Vivek Pradeep

Surgical procedures are inherently complex and dynamic, with intricate dependencies and various execution paths. Accurate identification of the intentions behind critical actions, referred to as Primary Intentions (PIs), is crucial to…

Robotics · Computer Science 2025-02-03 Jie Zhang , Song Zhou , Yiwei Wang , Chidan Wan , Huan Zhao , Xiong Cai , Han Ding

The biomedical imaging world is notorious for working with small amounts of data, frustrating state-of-the-art efforts in the computer vision and deep learning worlds. With large datasets, it is easier to make progress we have seen from the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Manuel Serna-Aguilera , Khoa Luu , Nathaniel Harris , Min Zou

The automatic summarization of surgical videos is essential for enhancing procedural documentation, supporting surgical training, and facilitating post-operative analysis. This paper presents a novel method at the intersection of artificial…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Hugo Georgenthum , Cristian Cosentino , Fabrizio Marozzo , Pietro Liò

Denoising Diffusion Probabilistic Models (DDPMs) have demonstrated significant achievements in various image and video generation tasks, including the domain of medical imaging. However, generating echocardiography videos based on semantic…

Image and Video Processing · Electrical Eng. & Systems 2023-10-12 Phi Nguyen Van , Duc Tran Minh , Hieu Pham Huy , Long Tran Quoc

For an autonomous robotic system, monitoring surgeon actions and assisting the main surgeon during a procedure can be very challenging. The challenges come from the peculiar structure of the surgical scene, the greater similarity in…

Amateurs working on mini-films and short-form videos usually spend lots of time and effort on the multi-round complicated process of setting and adjusting scenes, plots, and cameras to deliver satisfying video shots. We present Virtual…

Graphics · Computer Science 2023-07-25 Anyi Rao , Xuekun Jiang , Yuwei Guo , Linning Xu , Lei Yang , Libiao Jin , Dahua Lin , Bo Dai

Automatic recognition of surgical activities in the operating room (OR) is a key technology for creating next generation intelligent surgical devices and workflow monitoring/support systems. Such systems can potentially enhance efficiency…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Aidean Sharghi , Helene Haugerud , Daniel Oh , Omid Mohareri

Endoscopic surgery relies on intraoperative video, making image quality a decisive factor for surgical safety and efficacy. Yet, endoscopic videos are often degraded by uneven illumination, tissue scattering, occlusions, and motion blur,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Handing Xu , Zhenguo Nie , Tairan Peng , Huimin Pan , Xin-Jun Liu

3D medical image generation is essential for data augmentation and patient privacy, calling for reliable and efficient models suited for clinical practice. However, current methods suffer from limited anatomical fidelity, restricted axial…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Minye Shao , Xingyu Miao , Haoran Duan , Zeyu Wang , Jingkun Chen , Yawen Huang , Xian Wu , Jingjing Deng , Yang Long , Yefeng Zheng