English
Related papers

Related papers: From Scope to Script: An Automated Report Generati…

200 papers

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art (SOTA) methods has been a challenge due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Saurav Sengupta , Donald E. Brown

This paper attempts to provide the reader a place to begin studying the application of computer vision and machine learning to gastrointestinal (GI) endoscopy. They have been classified into 18 categories. It should be be noted by the…

Medical Physics · Physics 2019-05-01 Anant S. Vemuri

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Radiology report generation (RRG) methods often lack sufficient medical knowledge to produce clinically accurate reports. The scene graph contains rich information to describe the objects in an image. We explore enriching the medical…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Jun Wang , Lixing Zhu , Abhir Bhalerao , Yulan He

Accurate disease categorization using endoscopic images is a significant problem in Gastroenterology. This paper describes a technique for assisting medical diagnosis procedures and identifying gastrointestinal tract disorders based on the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 A. K. M. Salman Hosain , Mynul islam , Md Humaion Kabir Mehedi , Irteza Enan Kabir , Zarin Tasnim Khan

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

Radiology reports provide detailed descriptions of medical imaging integrated with patients' medical histories, while report writing is traditionally labor-intensive, increasing radiologists' workload and the risk of diagnostic errors.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Fuying Wang , Shenghui Du , Lequan Yu

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Domain Generalization is a challenging topic in computer vision, especially in Gastrointestinal Endoscopy image analysis. Due to several device limitations and ethical reasons, current open-source datasets are typically collected on a…

Image and Video Processing · Electrical Eng. & Systems 2022-05-09 Weichen Fan , Yuanbo Yang , Kunpeng Qiu , Shuo Wang , Yongxin Guo

Medical image analysis is crucial in modern radiological diagnostics, especially given the exponential growth in medical imaging data. The demand for automated report generation systems has become increasingly urgent. While prior research…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Hao Chen , Wei Zhao , Yingli Li , Tianyang Zhong , Yisong Wang , Youlan Shang , Lei Guo , Junwei Han , Tianming Liu , Jun Liu , Tuo Zhang

Ultrasound (US) report generation is a challenging task due to the variability of US images, operator dependence, and the need for standardized text. Unlike X-ray and CT, US imaging lacks consistent datasets, making automation difficult. In…

Image and Video Processing · Electrical Eng. & Systems 2025-05-20 Peixuan Ge , Tongkun Su , Faqin Lv , Baoliang Zhao , Peng Zhang , Chi Hong Wong , Liang Yao , Yu Sun , Zenan Wang , Pak Kin Wong , Ying Hu

Robotics enables a variety of unconventional actuation strategies to be used for endoscopes, resulting in reduced trauma to the GI tract. For transmission of force to distally mounted endoscopic instruments, robotically actuated tendon…

Medical Physics · Physics 2017-03-17 Tian En Timothy Seah , Thanh Nho Do , Nobuyoshi Takeshita , Khek Yu Ho , Soo Jay Phee

Automating radiology report generation can ease the reporting workload for radiologists. However, existing works focus mainly on the chest area due to the limited availability of public datasets for other regions. Besides, they often rely…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Qi Chen , Yutong Xie , Biao Wu , Xiaomin Chen , James Ang , Minh-Son To , Xiaojun Chang , Qi Wu

Medical imaging is crucial for diagnosing, monitoring, and treating medical conditions. The medical reports of radiology images are the primary medium through which medical professionals attest their findings, but their writing is time…

Computation and Language · Computer Science 2025-01-07 Iustin Sîrbu , Iulia-Renata Sîrbu , Jasmina Bogojeska , Traian Rebedea

A large number of different lesions and pathologies can affect the human digestive system, resulting in life-threatening situations. Early detection plays a relevant role in the successful treatment and the increase of current survival…

Image and Video Processing · Electrical Eng. & Systems 2021-11-18 Adrian Galdran , Gustavo Carneiro , Miguel A. González Ballester

Gastrointestinal (GI) cancers account for 1.5 million deaths worldwide. Endoscopic Submucosal Dissection (ESD) is an advanced therapeutic endoscopy technique with superior clinical outcome due to the minimally invasive and en bloc removal…

Robotics · Computer Science 2018-04-19 Timo J. C. Oude Vrielink , Ming Zhao , Ara Darzi , George P. Mylonas

In the gastrointestinal (GI) tract endoscopy field, ingestible wireless capsule endoscopy is emerging as a novel, minimally invasive diagnostic technology for inspection of the GI tract and diagnosis of a wide range of diseases and…

Computer Vision and Pattern Recognition · Computer Science 2017-05-19 Mehmet Turan , Yusuf Yigit Pilavci , Redhwan Jamiruddin , Helder Araujo , Ender Konukoglu , Metin Sitti

Automated analysis of endoscopic imagery is a critical yet underdeveloped component of ENT (ear, nose, and throat) care, hindered by variability in devices and operators, subtle and localized findings, and fine-grained distinctions such as…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Trong-Thuan Nguyen , Viet-Tham Huynh , Thao Thi Phuong Dao , Ha Nguyen Thi , Tien To Vu Thuy , Uyen Hanh Tran , Tam V. Nguyen , Thanh Dinh Le , Minh-Triet Tran

Endoscopy plays a major role in identifying any underlying abnormalities within the gastrointestinal (GI) tract. There are multiple GI tract diseases that are life-threatening, such as precancerous lesions and other intestinal cancers. In…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Harshala Gammulle , Yubo Chen , Sridha Sridharan , Travis Klein , Clinton Fookes

Medical report generation is a challenging task since it is time-consuming and requires expertise from experienced radiologists. The goal of medical report generation is to accurately capture and describe the image findings. Previous works…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Yu-Jen Chen , Wei-Hsiang Shen , Hao-Wei Chung , Ching-Hao Chiu , Da-Cheng Juan , Tsung-Ying Ho , Chi-Tung Cheng , Meng-Lin Li , Tsung-Yi Ho