English
Related papers

Related papers: Visualization Framework for Colonoscopy Videos

200 papers

The ability to quickly annotate medical imaging data plays a critical role in training deep learning frameworks for segmentation. Doing so for image volumes or video sequences is even more pressing as annotating these is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Laurent Lejeune , Raphael Sznitman

This work presents VTok, a unified video tokenization framework that can be used for both generation and understanding tasks. Unlike the leading vision-language systems that tokenize videos through a naive frame-sampling strategy, we…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Feng Wang , Yichun Shi , Ceyuan Yang , Qiushan Guo , Jingxiang Sun , Alan Yuille , Peng Wang

Watching instructional videos are often used to learn about procedures. Video captioning is one way of automatically collecting such knowledge. However, it provides only an indirect, overall evaluation of multimodal models with no…

Computation and Language · Computer Science 2020-10-12 Frank F. Xu , Lei Ji , Botian Shi , Junyi Du , Graham Neubig , Yonatan Bisk , Nan Duan

Video is an increasingly prominent and information-dense medium, yet it poses substantial challenges for language models. A typical video consists of a sequence of shorter segments, or shots, that collectively form a coherent narrative.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Richard Luo , Austin Peng , Adithya Vasudev , Rishabh Jain

Indexing endoscopic surgical videos is vital in surgical data science, forming the basis for systematic retrospective analysis and clinical performance evaluation. Despite its significance, current video analytics rely on manual indexing, a…

Colonoscopy video generation delivers dynamic, information-rich data critical for diagnosing intestinal diseases, particularly in data-scarce scenarios. High-quality video generation demands temporal consistency and precise control over…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Junhu Fu , Shuyu Liang , Wutong Li , Chen Ma , Peng Huang , Kehao Wang , Ke Chen , Shengli Lin , Pinghong Zhou , Zeju Li , Yuanyuan Wang , Yi Guo

While advanced image captioning systems are increasingly describing images coherently and exactly, recent progress in continual learning allows deep learning models to avoid catastrophic forgetting. However, the domain where image…

Computer Vision and Pattern Recognition · Computer Science 2020-04-22 Giang Nguyen , Tae Joon Jun , Trung Tran , Tolcha Yalew , Daeyoung Kim

Colorectal cancer screening critically depends on colonoscopy, yet existing platforms offer limited support for systematically studying the coupled dynamics of operator control, instrument motion, and visual feedback. This gap restricts…

Automatically describing a video with natural language is regarded as a fundamental challenge in computer vision. The problem nevertheless is not trivial especially when a video contains multiple events to be worthy of mention, which often…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Yehao Li , Ting Yao , Yingwei Pan , Hongyang Chao , Tao Mei

Although we have seen a proliferation of algorithms for recommending visualizations, these algorithms are rarely compared with one another, making it difficult to ascertain which algorithm is best for a given visual analysis scenario.…

Human-Computer Interaction · Computer Science 2021-09-08 Zehua Zeng , Phoebe Moh , Fan Du , Jane Hoffswell , Tak Yeon Lee , Sana Malik , Eunyee Koh , Leilani Battle

Endometriosis is a common women's condition exhibiting a manifold visual appearance in various body-internal locations. Having such properties makes its identification very difficult and error-prone, at least for laymen and non-specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Andreas Leibetseder , Klaus Schoeffmann , Jörg Keckstein , Simon Keckstein

Echocardiography records ultrasound videos of the heart, enabling clinicians to assess cardiac function. Recent advances in large-scale vision-language models (VLMs) have spurred interest in automating echocardiographic interpretation.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ryo Takizawa , Satoshi Kodera , Tempei Kabayama , Ryo Matsuoka , Yuta Ando , Yuto Nakamura , Haruki Settai , Norihiko Takeda

A wealth of Open Educational Resources is now available, and beyond the first and evident problem of finding them, the issue of articulating a set of resources is arising. When using audiovisual resources, among different possibilities,…

Computers and Society · Computer Science 2014-12-05 Olivier Aubert , Joscha Jaeger

Vision Language Models (VLMs) are poised to revolutionize the digital transformation of pharmacyceutical industry by enabling intelligent, scalable, and automated multi-modality content processing. Traditional manual annotation of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Suyash Mishra , Qiang Li , Srikanth Patil , Anubhav Girdhar

We present a comprehensive survey on the use of annotations in information visualizations, highlighting their crucial role in improving audience understanding and engagement with visual data. Our investigation encompasses empirical studies…

Human-Computer Interaction · Computer Science 2026-04-10 Md Dilshadur Rahman , Bhavana Doppalapudi , Ghulam Jilani Quadri , Paul Rosen

Building a large-scale training dataset is an essential problem in the development of medical image recognition systems. Visual grounding techniques, which automatically associate objects in images with corresponding descriptions, can…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Akimichi Ichinose , Taro Hatsutani , Keigo Nakamura , Yoshiro Kitamura , Satoshi Iizuka , Edgar Simo-Serra , Shoji Kido , Noriyuki Tomiyama

In recent years, the use of expressive surface visualizations in the representation of vascular structures has gained significant attention. These visualizations provide a comprehensive understanding of complex anatomical structures and are…

In a world filled with data, it is expected for a nation to take decisions informed by data. However, countries need to first collect and publish such data in a way meaningful for both citizens and policy makers. A good thematic…

Human-Computer Interaction · Computer Science 2024-01-30 Pierre Raimbaud , Jaime Camilo Espitia Castillo , John Guerra-Gomez

Recently, deep learning enabled the accurate segmentation of various diseases in medical imaging. These performances, however, typically demand large amounts of manual voxel annotations. This tedious process for volumetric data becomes more…

Computer-assisted surgery research requires large, deeply annotated video datasets that capture clinical and technical variability. Existing cataract surgery resources lack the diversity and annotation depth required to train generalizable…