English
Related papers

Related papers: EndoDINO: A Foundation Model for GI Endoscopy

200 papers

Endoscopy provides a major contribution to the diagnosis of the Gastrointestinal Tract (GIT) diseases. With Colon Endoscopy having its certain limitations, Wireless Capsule Endoscopy is gradually taking over it in the terms of ease and…

Image and Video Processing · Electrical Eng. & Systems 2020-09-03 Vanshika Vats , Pooja Goel , Amodini Agarwal , Nidhi Goel

The absence of openly accessible data and specialized foundation models is a major barrier for computational research in surgery. Toward this, (i) we open-source the largest dataset of general surgery videos to-date, consisting of 680 hours…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Samuel Schmidgall , Ji Woong Kim , Jeffrey Jopling , Axel Krieger

Endoscopic depth estimation is a critical technology for improving the safety and precision of minimally invasive surgery. It has attracted considerable attention from researchers in medical imaging, computer vision, and robotics. Over the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Ke Niu , Zeyun Liu , Xue Feng , Heng Li , Qika Lin , Kaize Shi

Deploying high-performance dense prediction models on resource-constrained edge devices remains challenging due to strict limits on computation and memory. In practice, lightweight systems for object detection, instance segmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Longfei Liu , Yongjie Hou , Yang Li , Qirui Wang , Youyang Sha , Yongjun Yu , Yinzhi Wang , Peizhe Ru , Xuanlong Yu , Xi Shen

Cell nuclei instance segmentation is a crucial task in digital kidney pathology. Traditional automatic segmentation methods often lack generalizability when applied to unseen datasets. Recently, the success of foundation models (FMs) has…

Radiographic images are a cornerstone of medical diagnostics in orthopaedics, with anatomical landmark detection serving as a crucial intermediate step for information extraction. General-purpose foundational segmentation models, such as…

Image and Video Processing · Electrical Eng. & Systems 2026-02-23 Ekaterina Stansfield , Jennifer A. Mitterer , Abdulrahman Altahhan

Accurate segmentation of gastrointestinal (GI) organs in magnetic resonance enterography (MRE) is critical for diagnosing inflammatory bowel disease (IBD). However, anatomical variability, class imbalance, and low tissue contrast hinder…

Image and Video Processing · Electrical Eng. & Systems 2026-04-21 Ashiqur Rahman , Md. Abu Sayed , Md Sharjis Ibne Wadud , Md. Abu Asad Al-Hafiz , Adam Mushtak , Muhammad E. H. Chowdhury

In this paper, we present Endo-SemiS, a semi-supervised segmentation framework for providing reliable segmentation of endoscopic video frames with limited annotation. EndoSemiS uses 4 strategies to improve performance by effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Hao Li , Daiwei Lu , Xing Yao , Nicholas Kavoussi , Ipek Oguz

Patient-level diagnosis of severity in ulcerative colitis (UC) is common in real clinical settings, where the most severe score in a patient is recorded. However, previous UC classification methods (i.e., image-level estimation) mainly…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Kaito Shiku , Kazuya Nishimura , Daiki Suehiro , Kiyohito Tanaka , Ryoma Bise

The application of 3D ViTs to medical image segmentation has seen remarkable strides, somewhat overshadowing the budding advancements in Convolutional Neural Network (CNN)-based models. Large kernel depthwise convolution has emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Ho Hin Lee , Quan Liu , Qi Yang , Xin Yu , Shunxing Bao , Yuankai Huo , Bennett A. Landman

Reconstructing deformable tissues from endoscopic videos is essential in many downstream surgical applications. However, existing methods suffer from slow rendering speed, greatly limiting their practical use. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Yifan Liu , Chenxin Li , Chen Yang , Yixuan Yuan

In hematology, computational models offer significant potential to improve diagnostic accuracy, streamline workflows, and reduce the tedious work of analyzing single cells in peripheral blood or bone marrow smears. However, clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Valentin Koch , Sophia J. Wagner , Salome Kazeminia , Ece Sancar , Matthias Hehr , Julia Schnabel , Tingying Peng , Carsten Marr

The accurate classification of gastrointestinal diseases from endoscopic and histopathological imagery remains a significant challenge in medical diagnostics, mainly due to the vast data volume and subtle variation in inter-class visuals.…

Image and Video Processing · Electrical Eng. & Systems 2026-04-28 Md Assaduzzaman , Nushrat Jahan Oyshi , Eram Mahamud

Endoscopy is a routine imaging technique used for both diagnosis and minimally invasive surgical treatment. While the endoscopy video contains a wealth of information, tools to capture this information for the purpose of clinical reporting…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Sharib Ali , Jens Rittscher

Purpose: Data privacy regulations hinder the creation of generalizable foundation models (FMs) for surgery by preventing multi-institutional data aggregation. This study investigates federated learning (FL) as a privacy-preserving solution…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Max Kirchner , Alexander C. Jenke , Sebastian Bodenstedt , Fiona R. Kolbinger , Oliver L. Saldanha , Jakob N. Kather , Martin Wagner , Stefanie Speidel

Objective: Ulcerative colitis (UC), characterized by chronic inflammation with alternating remission-relapse cycles, requires precise histological healing (HH) evaluation to improve clinical outcomes. To overcome the limitations of…

Quantitative Methods · Quantitative Biology 2025-05-16 Zhengxuan Qiu , Bo Peng , Xiaoying Tang , Jiankun Wang , Qin Guo

Musculoskeletal disorders represent a leading cause of global disability, creating an urgent demand for precise interpretation of medical imaging. Current artificial intelligence (AI) approaches in orthopedics predominantly rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Kang Yu , Dingyu Wang , Zimu Yuan , Nan Zhou , Jiajun Liu , Jiaxin Liu , Shanggui Liu , Yaoyan Zheng , Huishu Yuan , Di Huang , Dong Jiang

Precise camera tracking, high-fidelity 3D tissue reconstruction, and real-time online visualization are critical for intrabody medical imaging devices such as endoscopes and capsule robots. However, existing SLAM (Simultaneous Localization…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Kailing Wang , Chen Yang , Yuehao Wang , Sikuang Li , Yan Wang , Qi Dou , Xiaokang Yang , Wei Shen

Purpose: This study evaluated the out-of-domain performance and generalization capabilities of automated medical image segmentation models, with a particular focus on adaptation to new image acquisitions and disease type. Materials:…

Image and Video Processing · Electrical Eng. & Systems 2023-07-28 Timothy L. Kline , Sumana Ramanathan , Harrison C. Gottlich , Panagiotis Korfiatis , Adriana V. Gregory

In medical imaging, efficient segmentation of colon polyps plays a pivotal role in minimally invasive solutions for colorectal cancer. This study introduces a novel approach employing two parallel encoder branches within a network for polyp…

Image and Video Processing · Electrical Eng. & Systems 2024-12-04 Malik Abdul Manan , Feng Jinchao , Shahzad Ahmed , Abdul Raheem