English
Related papers

Related papers: ReSW-VL: Representation Learning for Surgical Work…

200 papers

Knowledge Management is crucial for capturing and transferring expertise within universities, especially in high staff turnover contexts where expertise loss disrupts teaching. Documenting teachers' workflows is time-intensive and diverts…

Human-Computer Interaction · Computer Science 2025-08-07 Gloria Fernández-Nieto , Vanessa Echeverria , Yuheng Li , Yi-Shan Tsai , Lele Sha , Guanliang Chen , Dragan Gasevic , Zachari Swiecki

Accurate surgical phase recognition is essential for analyzing procedural workflows, supporting intraoperative decision-making, and enabling data-driven improvements in surgical education and performance evaluation. In this work, we present…

The recent success in deep learning has lead to various effective representation learning methods for videos. However, the current approaches for video representation require large amount of human labeled datasets for effective learning. We…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Shruti Vyas , Yogesh S Rawat , Mubarak Shah

Deep learning has proven very promising for interpreting MRI in brain tumor diagnosis. However, deep learning models suffer from a scarcity of brain MRI datasets for effective training. Self-supervised learning (SSL) models provide…

Image and Video Processing · Electrical Eng. & Systems 2024-11-21 Meryem Altin Karagoz , O. Ufuk Nalbantoglu , Geoffrey C. Fox

The deployment of vision-language models (VLMs) in dermatology is hindered by the trilemma of high computational costs, extreme data scarcity, and the black-box nature of deep learning. To address these challenges, we present SkinCLIP-VL, a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Zhixiang Lu , Shijie Xu , Kaicheng Yan , Xuyue Cai , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Jionglong Su

Deep neural networks require collecting and annotating large amounts of data to train successfully. In order to alleviate the annotation bottleneck, we propose a novel self-supervised representation learning approach for spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Alaaeldin El-Nouby , Shuangfei Zhai , Graham W. Taylor , Joshua M. Susskind

One impressive advantage of convolutional neural networks (CNNs) is their ability to automatically learn feature representation from raw pixels, eliminating the need for hand-designed procedures. However, recent methods for single image…

Computer Vision and Pattern Recognition · Computer Science 2016-07-27 Yifan Wang , Lijun Wang , Hongyu Wang , Peihua Li

The Visual Language Model, known for its robust cross-modal capabilities, has been extensively applied in various computer vision tasks. In this paper, we explore the use of CLIP (Contrastive Language-Image Pretraining), a vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Huazhong Zhao , Lei Qi , Xin Geng

Medical images are often more difficult to acquire than natural images due to the specialism of the equipment and technology, which leads to less medical image datasets. So it is hard to train a strong pretrained medical vision model. How…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Haijiang Tian , Jingkun Yue , Xiaohong Liu , Guoxing Yang , Zeyu Jiang , Guangyu Wang

We propose a visual SLAM method by predicting and updating line flows that represent sequential 2D projections of 3D line segments. While feature-based SLAM methods have achieved excellent results, they still face problems in challenging…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Qiuyuan Wang , Zike Yan , Junqiu Wang , Fei Xue , Wei Ma , Hongbin Zha

Person Re-identification is a research area with significant real world applications. Despite recent progress, existing methods face challenges in robust re-identification in the wild, e.g., by focusing only on a particular modality and on…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Siyuan Huang , Ram Prabhakar , Yuxiang Guo , Rama Chellappa , Cheng Peng

We introduce the concept of "dynamic image", a novel compact representation of videos useful for video analysis, particularly in combination with convolutional neural networks (CNNs). A dynamic image encodes temporal data such as RGB or…

Computer Vision and Pattern Recognition · Computer Science 2017-08-22 Hakan Bilen , Basura Fernando , Efstratios Gavves , Andrea Vedaldi

We introduce a novel self-supervised learning approach to learn representations of videos that are responsive to changes in the motion dynamics. Our representations can be learned from data without human annotation and provide a substantial…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Simon Jenni , Givi Meishvili , Paolo Favaro

Many tasks in video analysis and understanding boil down to the need for frame-based feature learning, aiming to encapsulate the relevant visual content so as to enable simpler and easier subsequent processing. While supervised strategies…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Guy Bar-Shalom , George Leifman , Michael Elad , Ehud Rivlin

In recent years, advances in Artificial Intelligence have significantly impacted computer science, particularly in the field of computer vision, enabling solutions to complex problems such as video frame prediction. Video frame prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jose M. Sánchez Velázquez , Mingbo Cai , Andrew Coney , Álvaro J. García- Tejedor , Alberto Nogales

Accurate surgical phase recognition is crucial for computer-assisted interventions and surgical video analysis. Annotating long surgical videos is labor-intensive, driving research toward leveraging unlabeled data for strong performance…

Surgical workflow recognition is vital for automating tasks, supporting decision-making, and training novice surgeons, ultimately improving patient safety and standardizing procedures. However, data corruption can lead to performance…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Long Bai , Boyi Ma , Ruohan Wang , Guankun Wang , Beilei Cui , Zhongliang Jiang , Mobarakol Islam , Zhe Min , Jiewen Lai , Nassir Navab , Hongliang Ren

Foundation models have revolutionized computer vision by achieving vastly superior performance across diverse tasks through large-scale pretraining on extensive datasets. However, their application in surgical computer vision has been…

The lack of large and diverse training data on Computer-Aided Diagnosis (CAD) in breast cancer detection has been one of the concerns that impedes the adoption of the system. Recently, pre-training with large-scale image text datasets via…

Image and Video Processing · Electrical Eng. & Systems 2024-05-24 Shantanu Ghosh , Clare B. Poynton , Shyam Visweswaran , Kayhan Batmanghelich

With the explosive growth of video data in real-world applications, a comprehensive representation of videos becomes increasingly important. In this paper, we address the problem of video scene recognition, whose goal is to learn a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xuzheng Yu , Chen Jiang , Wei Zhang , Tian Gan , Linlin Chao , Jianan Zhao , Yuan Cheng , Qingpei Guo , Wei Chu