English
Related papers

Related papers: ACM Multimedia Grand Challenge on ENT Endoscopy An…

200 papers

The significant breakthroughs of Medical Multi-Modal Large Language Models (Med-MLLMs) renovate modern healthcare with robust information synthesis and medical decision support. However, these models are often evaluated on benchmarks that…

Computation and Language · Computer Science 2024-12-02 Jie Liu , Wenxuan Wang , Yihang Su , Jingyuan Huan , Wenting Chen , Yudi Zhang , Cheng-Yi Li , Kao-Jung Chang , Xiaohan Xin , Linlin Shen , Michael R. Lyu

Stereo Imaging technology integration into medical diagnostics and surgeries brings a great revolution in the field of medical sciences. Now, surgeons and physicians have better insight into the anatomy of patients' organs. Like other…

Image and Video Processing · Electrical Eng. & Systems 2024-09-01 Mansoor Hayat , Supavadee Armvith , Titipat Achakulvisut

This paper presents a deep learning framework for the multi-class classification of gastrointestinal abnormalities in Video Capsule Endoscopy (VCE) frames. The aim is to automate the identification of ten GI abnormality classes, including…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Aman Sagar , Preeti Mehta , Monika Shrivastva , Suchi Kumari

Medical imaging is an essential tool for diagnosing various healthcare diseases and conditions. However, analyzing medical images is a complex and time-consuming task that requires expertise and experience. This article aims to design a…

Image and Video Processing · Electrical Eng. & Systems 2023-05-15 Ayyub Alzahem , Shahid Latif , Wadii Boulila , Anis Koubaa

Capsule endoscopy is a method to capture images of the gastrointestinal tract and screen for diseases which might remain hidden if investigated with standard endoscopes. Due to the limited size of a video capsule, embedding AI models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Julia Werner , Christoph Gerum , Jorg Nick , Maxime Le Floch , Franz Brinkmann , Jochen Hampe , Oliver Bringmann

This paper discusses how ophthalmologists often rely on multimodal data to improve diagnostic accuracy. However, complete multimodal data is rare in real-world applications due to a lack of medical equipment and concerns about data privacy.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Xinkun Wang , Yifang Wang , Senwei Liang , Feilong Tang , Chengzhi Liu , Ming Hu , Chao Hu , Junjun He , Zongyuan Ge , Imran Razzak

Translation of fully automated deep learning based medical image segmentation technologies to clinical workflows face two main algorithmic challenges. The first, is the collection and archival of large quantities of manually annotated…

Image and Video Processing · Electrical Eng. & Systems 2021-01-20 Bilwaj Gaonkar , Joel Beckett , Mark Attiah , Christine Ahn , Matthew Edwards , Bayard Wilson , Azim Laiwalla , Banafsheh Salehi , Bryan Yoo , Alex Bui , Luke Macyszyn

The Segment Anything Model (SAM) has achieved remarkable successes in the realm of natural image segmentation, but its deployment in the medical imaging sphere has encountered challenges. Specifically, the model struggles with medical…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Shreyank N Gowda , David A. Clifton

Automated endoscopy video analysis is a challenging task in medical computer vision, with the primary objective of assisting surgeons during procedures. The difficulty arises from the complexity of surgical scenes and the lack of a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Dominik Batić , Felix Holm , Ege Özsoy , Tobias Czempiel , Nassir Navab

Feature matching and finding correspondences between endoscopic images is a key step in many clinical applications such as patient follow-up and generation of panoramic image from clinical sequences for fast anomalies localization.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Manel Farhat , Houda Chaabouni-Chouayakh , Achraf Ben-Hamadou

Medical imaging is an essential tool in many areas of medical applications, used for both diagnosis and treatment. However, reading medical images and making diagnosis or treatment recommendations require specially trained medical…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Wentao Zhu

Renal transplantation emerges as the most effective solution for end-stage renal disease. Occurring from complex causes, a substantial risk of transplant chronic dysfunction persists and may lead to graft loss. Medical imaging plays a…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Leo Milecki , Vicky Kalogeiton , Sylvain Bodard , Dany Anglicheau , Jean-Michel Correas , Marc-Olivier Timsit , Maria Vakalopoulou

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Visual summarization of clinical data collected on patients contained within the electronic health record (EHR) may enable precise and rapid triage at the time of patient presentation to an emergency department (ED). The triage process is…

Human-Computer Interaction · Computer Science 2019-07-26 Nathan C. Hurley , Adrian D. Haimovich , R. Andrew Taylor , Bobak J. Mortazavi

Endoscopy is the most widely used medical technique for cancer and polyp detection inside hollow organs. However, images acquired by an endoscope are frequently affected by illumination artefacts due to the enlightenment source orientation.…

Image and Video Processing · Electrical Eng. & Systems 2022-07-07 Axel Garcia-Vega , Ricardo Espinosa , Gilberto Ochoa-Ruiz , Thomas Bazin , Luis Eduardo Falcon-Morales , Dominique Lamarque , Christian Daul

Medical report interpretation plays a crucial role in healthcare, enabling both patient-facing explanations and effective information flow across clinical systems. While recent vision-language models (VLMs) and large language models (LLMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Fangxin Shang , Yuan Xia , Dalu Yang , Yahui Wang , Binglin Yang

While recent multimodal large language models (MLLMs) have advanced automated ECG interpretation, they still face two key limitations: (1) insufficient multimodal synergy between time series signals and visual ECG representations, and (2)…

Computation and Language · Computer Science 2025-10-21 Xiang Lan , Feng Wu , Kai He , Qinghao Zhao , Shenda Hong , Mengling Feng

Gastrointestinal endoscopy is a medical procedure that utilizes a flexible tube equipped with a camera and other instruments to examine the digestive tract. This minimally invasive technique allows for diagnosing and managing various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Pham Vu Hung , Nguyen Duy Manh , Nguyen Thi Oanh , Nguyen Thi Thuy , Dinh Viet Sang

Large language models (LLMs) have recently demonstrated their potential in clinical applications, providing valuable medical knowledge and advice. For example, a large dialog LLM like ChatGPT has successfully passed part of the US medical…

Computer Vision and Pattern Recognition · Computer Science 2023-02-15 Sheng Wang , Zihao Zhao , Xi Ouyang , Qian Wang , Dinggang Shen

Over the past decade, generative models have achieved significant success in enhancement fundus images.However, the evaluation of these models still presents a considerable challenge. A comprehensive evaluation benchmark for fundus image…

Image and Video Processing · Electrical Eng. & Systems 2025-02-21 Wenhui Zhu , Xuanzhao Dong , Xin Li , Yujian Xiong , Xiwen Chen , Peijie Qiu , Vamsi Krishna Vasa , Zhangsihao Yang , Yi Su , Oana Dumitrascu , Yalin Wang