English
Related papers

Related papers: Seeing Through Smoke: Surgical Desmoking for Impro…

200 papers

Accurate and robust tracking and reconstruction of the surgical scene is a critical enabling technology toward autonomous robotic surgery. Existing algorithms for 3D perception in surgery mainly rely on geometric information, while we…

Image and Video Processing · Electrical Eng. & Systems 2023-02-21 Shan Lin , Albert J. Miao , Jingpei Lu , Shunkai Yu , Zih-Yun Chiu , Florian Richter , Michael C. Yip

This paper presents a comprehensive workflow for generating and validating a synthetic dataset designed for robotic surgery instrument segmentation. A 3D reconstruction of the Da Vinci robotic arms was refined and animated in Autodesk Maya…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Giorgio Chiesa , Rossella Borra , Vittorio Lauro , Sabrina De Cillis , Daniele Amparore , Cristian Fiori , Riccardo Renzulli , Marco Grangetto

We develop an optimization-based method to model smocking, a surface embroidery technique that provides decorative geometric texturing while maintaining stretch properties of the fabric. During smocking, multiple pairs of points on the…

Graphics · Computer Science 2023-09-15 Jing Ren , Aviv Segall , Olga Sorkine-Hornung

Robotic automation in surgery requires precise tracking of surgical tools and mapping of deformable tissue. Previous works on surgical perception frameworks require significant effort in developing features for surgical tool and tissue…

Robotics · Computer Science 2021-03-26 Jingpei Lu , Ambareesh Jayakumari , Florian Richter , Yang Li , Michael C. Yip

High-resolution imaging is crucial for enhancing visual clarity and enabling precise computer-assisted guidance in minimally invasive surgery (MIS). Despite the increasing adoption of 4K endoscopic systems, there remains a significant gap…

Robotic surgery has been proven to offer clear advantages during surgical procedures, however, one of the major limitations is obtaining haptic feedback. Since it is often challenging to devise a hardware solution with accurate force…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Cong Gao , Xingtong Liu , Michael Peven , Mathias Unberath , Austin Reiter

Traditional control and task automation have been successfully demonstrated in a variety of structured, controlled environments through the use of highly specialized modeled robotic systems in conjunction with multiple sensors. However, the…

Robotics · Computer Science 2020-02-20 Yang Li , Florian Richter , Jingpei Lu , Emily K. Funk , Ryan K. Orosco , Jianke Zhu , Michael C. Yip

Endoluminal surgery offers a minimally invasive option for early-stage gastrointestinal and urinary tract cancers but is limited by surgical tools and a steep learning curve. Robotic systems, particularly continuum robots, provide flexible…

Inspired by the recent success of fully convolutional networks (FCN) in semantic segmentation, we propose a deep smoke segmentation network to infer high quality segmentation masks from blurry smoke images. To overcome large variations in…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Feiniu Yuan , Lin Zhang , Xue Xia , Boyang Wan , Qinghua Huang , Xuelong Li

Real-world imaging systems acquire measurements that are degraded by noise, optical aberrations, and other imperfections that make image processing for human viewing and higher-level perception tasks challenging. Conventional cameras…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Steven Diamond , Vincent Sitzmann , Frank Julca-Aguilar , Stephen Boyd , Gordon Wetzstein , Felix Heide

Most existing robotic surgery systems adopt a human-in-the-loop paradigm, often with the surgeon directly teleoperating the robotic system. Adding intelligence to these robots would enable higher-level control, such as supervised autonomy…

Surgical smoke severely degrades intraoperative video quality, obscuring anatomical structures and limiting surgical perception. Existing learning-based desmoking approaches rely on scarce paired supervision and deterministic restoration…

Artificial Intelligence · Computer Science 2026-05-06 Zining Fang , Cheng Xue , Chunhui Liu , Bin Xu , Ming Chen , Xiaowei Hu

Hyperspectral imaging holds promises in surgical imaging by offering biological tissue differentiation capabilities with detailed information that is invisible to the naked eye. For intra-operative guidance, real-time spectral data capture…

Image and Video Processing · Electrical Eng. & Systems 2025-05-02 Peichao Li , Oscar MacCormac , Jonathan Shapey , Tom Vercauteren

Hyperspectral imaging is one of the most promising techniques for intraoperative tissue characterisation. Snapshot mosaic cameras, which can capture hyperspectral data in a single exposure, have the potential to make a real-time…

Image and Video Processing · Electrical Eng. & Systems 2021-12-02 Peichao Li , Michael Ebner , Philip Noonan , Conor Horgan , Anisha Bahl , Sebastien Ourselin , Jonathan Shapey , Tom Vercauteren

Endoscopy is the most widely used medical technique for cancer and polyp detection inside hollow organs. However, images acquired by an endoscope are frequently affected by illumination artefacts due to the enlightenment source orientation.…

Image and Video Processing · Electrical Eng. & Systems 2022-07-07 Axel Garcia-Vega , Ricardo Espinosa , Gilberto Ochoa-Ruiz , Thomas Bazin , Luis Eduardo Falcon-Morales , Dominique Lamarque , Christian Daul

Surgical tool segmentation in endoscopic images is the first step towards pose estimation and (sub-)task automation in challenging minimally invasive surgical operations. While many approaches in the literature have shown great results…

Robotics · Computer Science 2019-02-14 Cristian da Costa Rocha , Nicolas Padoy , Benoit Rosa

Motion estimation for highly dynamic phenomena such as smoke is an open challenge for Computer Vision. Traditional dense motion estimation algorithms have difficulties with non-rigid and large motions, both of which are frequently observed…

Computer Vision and Pattern Recognition · Computer Science 2016-09-09 Da Chen , Wenbin Li , Peter Hall

Automated endoscopy video analysis is a challenging task in medical computer vision, with the primary objective of assisting surgeons during procedures. The difficulty arises from the complexity of surgical scenes and the lack of a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Dominik Batić , Felix Holm , Ege Özsoy , Tobias Czempiel , Nassir Navab

Improved surgical skill is generally associated with improved patient outcomes, although assessment is subjective; labour-intensive; and requires domain specific expertise. Automated data driven metrics can alleviate these difficulties, as…

As sensing technology proliferates and becomes affordable to the general public, there is a growing trend in citizen science where scientists and volunteers form a strong partnership in conducting scientific research including problem…

Computer Vision and Pattern Recognition · Computer Science 2018-09-18 Yen-Chia Hsu , Paul Dille , Randy Sargent , Illah Nourbakhsh