English
Related papers

Related papers: Weakly Supervised Convolutional LSTM Approach for …

200 papers

A challenge in speech production research is to predict future tongue movements based on a short period of past tongue movements. This study tackles speaker-dependent tongue motion prediction problem in unlabeled ultrasound videos with…

Computer Vision and Pattern Recognition · Computer Science 2019-02-20 Chaojie Zhao , Peng Zhang , Jian Zhu , Chengrui Wu , Huaimin Wang , Kele Xu

Robot-assisted catheterization has garnered a good attention for its potentials in treating cardiovascular diseases. However, advancing surgeon-robot collaboration still requires further research, particularly on task-specific automation.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Olatunji Mumini Omisore , Toluwanimi Akinyemi , Anh Nguyen , Lei Wang

This paper presents a sparse Change-Based Convolutional Long Short-Term Memory (CB-ConvLSTM) model for event-based eye tracking, key for next-generation wearable healthcare technology such as AR/VR headsets. We leverage the benefits of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Qinyu Chen , Zuowen Wang , Shih-Chii Liu , Chang Gao

This paper presents a novel method to involve both spatial and temporal features for semantic video segmentation. Current work on convolutional neural networks(CNNs) has shown that CNNs provide advanced spatial features supporting a very…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Mohsen Fayyaz , Mohammad Hajizadeh Saffar , Mohammad Sabokrou , Mahmood Fathy , Reinhard Klette , Fay Huang

Region of Interest (ROI) crowd counting can be formulated as a regression problem of learning a mapping from an image or a video frame to a crowd density map. Recently, convolutional neural network (CNN) models have achieved promising…

Computer Vision and Pattern Recognition · Computer Science 2017-07-26 Feng Xiong , Xingjian Shi , Dit-Yan Yeung

Purpose: In this paper, we present a novel approach for online object tracking in laparoscopic cholecystectomy (LC) surgical videos, targeting localisation and tracking of critical anatomical structures and instruments. Our method addresses…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Subhadeep Koley , Abdolrahim Kadkhodamohammadi , Santiago Barbarisi , Danail Stoyanov , Imanol Luengo

Surgical tool presence detection and surgical phase recognition are two fundamental yet challenging tasks in surgical video analysis and also very essential components in various applications in modern operating rooms. While these two…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Yueming Jin , Huaxia Li , Qi Dou , Hao Chen , Jing Qin , Chi-Wing Fu , Pheng-Ann Heng

Accurate tool tracking is essential for the success of computer-assisted intervention. Previous efforts often modeled tool trajectories rigidly, overlooking the dynamic nature of surgical procedures, especially tracking scenarios like…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Chinedu Innocent Nwoye , Nicolas Padoy

Providing force feedback as relevant information in current Robot-Assisted Minimally Invasive Surgery systems constitutes a technological challenge due to the constraints imposed by the surgical environment. In this context, Sensorless…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Arturo Marban , Vignesh Srinivasan , Wojciech Samek , Josep Fernández , Alicia Casals

Semantic Segmentation is an important module for autonomous robots such as self-driving cars. The advantage of video segmentation approaches compared to single image segmentation is that temporal image information is considered, and their…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Andreas Pfeuffer , Klaus Dietmayer

High level understanding of sequential visual input is important for safe and stable autonomy, especially in localization and object detection. While traditional object classification and tracking approaches are specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Mo Shan , Nikolay Atanasov

In this paper, we propose a novel method for video anomaly detection motivated by an existing architecture for sequence-to-sequence prediction and reconstruction using a spatio-temporal convolutional Long Short-Term Memory (convLSTM). As in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Hanh Thi Minh Tran , David Hogg

A key element of computer-assisted surgery systems is phase recognition of surgical videos. Existing phase recognition algorithms require frame-wise annotation of a large number of videos, which is time and money consuming. In this work we…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Roy Hirsch , Regev Cohen , Mathilde Caron , Tomer Golany , Daniel Freedman , Ehud Rivlin

Surgical video understanding is crucial for facilitating Computer-Assisted Surgery (CAS) systems. Despite significant progress in existing studies, two major limitations persist, including inadequate visual content perception and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zhen Chen , Xingjian Luo , Kun Yuan , Jinlin Wu , Danny T. M. Chan , Nassir Navab , Hongbin Liu , Zhen Lei , Jiebo Luo

Automatically describing videos with natural language is a fundamental challenge for computer vision and natural language processing. Recently, progress in this problem has been achieved through two steps: 1) employing 2-D and/or 3-D…

Computer Vision and Pattern Recognition · Computer Science 2022-02-23 Yuyu Guo , Jingqiu Zhang , Lianli Gao

For robotic surgical videos, instrument presence annotations are typically recorded with video streams, which offering the potential to reduce the manually annotated costs for segmentation. However, weakly supervised surgical instrument…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Qiyuan Wang , Yanzhe Liu , Shang Zhao , Rong Liu , S. Kevin Zhou

We propose a novel model for temporal detection and localization which allows the training of deep neural networks using only counts of event occurrences as training labels. This powerful weakly-supervised framework alleviates the burden of…

Machine Learning · Computer Science 2019-05-20 Julien Schroeter , Kirill Sidorov , David Marshall

The task of parsing subcutaneous vessels in clinical images is often hindered by the high cost and limited availability of ground truth data, as well as the challenge of low contrast and noisy vessel appearances across different patients…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Ayaan Nooruddin Siddiqui , Mahnoor Zaidi , Ayesha Nazneen Shahbaz , Priyadarshini Chatterjee , Krishnan Menon Iyer

Minimally invasive surgery can benefit significantly from automated surgical tool detection, enabling advanced analysis and assistance. However, the limited availability of annotated data in surgical settings poses a challenge for training…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Ana Davila , Jacinto Colan , Yasuhisa Hasegawa

By converting low-frame-rate, low-resolution videos into high-frame-rate, high-resolution ones, space-time video super-resolution techniques can enhance visual experiences and facilitate more efficient information dissemination. We propose…

Image and Video Processing · Electrical Eng. & Systems 2024-07-12 Congrui Fu , Hui Yuan , Shiqi Jiang , Guanghui Zhang , Liquan Shen , Raouf Hamzaoui