中文
相关论文

相关论文: From Scope to Script: An Automated Report Generati…

200 篇论文

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art (SOTA) methods has been a challenge due to the…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Saurav Sengupta , Donald E. Brown

This paper attempts to provide the reader a place to begin studying the application of computer vision and machine learning to gastrointestinal (GI) endoscopy. They have been classified into 18 categories. It should be be noted by the…

医学物理 · 物理学 2019-05-01 Anant S. Vemuri

Automatic radiology report generation is a promising application of multimodal deep learning, aiming to reduce reporting workload and improve consistency. However, current state-of-the-art (SOTA) systems - such as Multimodal AI for…

Radiology report generation (RRG) methods often lack sufficient medical knowledge to produce clinically accurate reports. The scene graph contains rich information to describe the objects in an image. We explore enriching the medical…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Jun Wang , Lixing Zhu , Abhir Bhalerao , Yulan He

Accurate disease categorization using endoscopic images is a significant problem in Gastroenterology. This paper describes a technique for assisting medical diagnosis procedures and identifying gastrointestinal tract disorders based on the…

计算机视觉与模式识别 · 计算机科学 2022-12-09 A. K. M. Salman Hosain , Mynul islam , Md Humaion Kabir Mehedi , Irteza Enan Kabir , Zarin Tasnim Khan

Multimodal large models have shown great potential in automating pathology image analysis. However, current multimodal models for gastrointestinal pathology are constrained by both data quality and reasoning transparency: pervasive noise…

图像与视频处理 · 电气工程与系统科学 2025-07-25 Minxi Ouyang , Lianghui Zhu , Yaqing Bao , Qiang Huang , Jingli Ouyang , Tian Guan , Xitong Ling , Jiawen Li , Song Duan , Wenbin Dai , Li Zheng , Xuemei Zhang , Yonghong He

Radiology reports provide detailed descriptions of medical imaging integrated with patients' medical histories, while report writing is traditionally labor-intensive, increasing radiologists' workload and the risk of diagnostic errors.…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Fuying Wang , Shenghui Du , Lequan Yu

Generating medical reports for X-ray images presents a significant challenge, particularly in unpaired scenarios where access to paired image-report data for training is unavailable. Previous works have typically learned a joint embedding…

计算机视觉与模式识别 · 计算机科学 2024-09-25 Elad Hirsch , Gefen Dawidowicz , Ayellet Tal

Domain Generalization is a challenging topic in computer vision, especially in Gastrointestinal Endoscopy image analysis. Due to several device limitations and ethical reasons, current open-source datasets are typically collected on a…

图像与视频处理 · 电气工程与系统科学 2022-05-09 Weichen Fan , Yuanbo Yang , Kunpeng Qiu , Shuo Wang , Yongxin Guo

Medical image analysis is crucial in modern radiological diagnostics, especially given the exponential growth in medical imaging data. The demand for automated report generation systems has become increasingly urgent. While prior research…

计算机视觉与模式识别 · 计算机科学 2024-10-01 Hao Chen , Wei Zhao , Yingli Li , Tianyang Zhong , Yisong Wang , Youlan Shang , Lei Guo , Junwei Han , Tianming Liu , Jun Liu , Tuo Zhang

Ultrasound (US) report generation is a challenging task due to the variability of US images, operator dependence, and the need for standardized text. Unlike X-ray and CT, US imaging lacks consistent datasets, making automation difficult. In…

图像与视频处理 · 电气工程与系统科学 2025-05-20 Peixuan Ge , Tongkun Su , Faqin Lv , Baoliang Zhao , Peng Zhang , Chi Hong Wong , Liang Yao , Yu Sun , Zenan Wang , Pak Kin Wong , Ying Hu

Robotics enables a variety of unconventional actuation strategies to be used for endoscopes, resulting in reduced trauma to the GI tract. For transmission of force to distally mounted endoscopic instruments, robotically actuated tendon…

医学物理 · 物理学 2017-03-17 Tian En Timothy Seah , Thanh Nho Do , Nobuyoshi Takeshita , Khek Yu Ho , Soo Jay Phee

Automating radiology report generation can ease the reporting workload for radiologists. However, existing works focus mainly on the chest area due to the limited availability of public datasets for other regions. Besides, they often rely…

计算机视觉与模式识别 · 计算机科学 2024-10-11 Qi Chen , Yutong Xie , Biao Wu , Xiaomin Chen , James Ang , Minh-Son To , Xiaojun Chang , Qi Wu

Medical imaging is crucial for diagnosing, monitoring, and treating medical conditions. The medical reports of radiology images are the primary medium through which medical professionals attest their findings, but their writing is time…

计算与语言 · 计算机科学 2025-01-07 Iustin Sîrbu , Iulia-Renata Sîrbu , Jasmina Bogojeska , Traian Rebedea

A large number of different lesions and pathologies can affect the human digestive system, resulting in life-threatening situations. Early detection plays a relevant role in the successful treatment and the increase of current survival…

图像与视频处理 · 电气工程与系统科学 2021-11-18 Adrian Galdran , Gustavo Carneiro , Miguel A. González Ballester

Gastrointestinal (GI) cancers account for 1.5 million deaths worldwide. Endoscopic Submucosal Dissection (ESD) is an advanced therapeutic endoscopy technique with superior clinical outcome due to the minimally invasive and en bloc removal…

机器人学 · 计算机科学 2018-04-19 Timo J. C. Oude Vrielink , Ming Zhao , Ara Darzi , George P. Mylonas

In the gastrointestinal (GI) tract endoscopy field, ingestible wireless capsule endoscopy is emerging as a novel, minimally invasive diagnostic technology for inspection of the GI tract and diagnosis of a wide range of diseases and…

计算机视觉与模式识别 · 计算机科学 2017-05-19 Mehmet Turan , Yusuf Yigit Pilavci , Redhwan Jamiruddin , Helder Araujo , Ender Konukoglu , Metin Sitti

Automated analysis of endoscopic imagery is a critical yet underdeveloped component of ENT (ear, nose, and throat) care, hindered by variability in devices and operators, subtle and localized findings, and fine-grained distinctions such as…

Endoscopy plays a major role in identifying any underlying abnormalities within the gastrointestinal (GI) tract. There are multiple GI tract diseases that are life-threatening, such as precancerous lesions and other intestinal cancers. In…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Harshala Gammulle , Yubo Chen , Sridha Sridharan , Travis Klein , Clinton Fookes

Medical report generation is a challenging task since it is time-consuming and requires expertise from experienced radiologists. The goal of medical report generation is to accurately capture and describe the image findings. Previous works…

计算机视觉与模式识别 · 计算机科学 2023-01-10 Yu-Jen Chen , Wei-Hsiang Shen , Hao-Wei Chung , Ching-Hao Chiu , Da-Cheng Juan , Tsung-Ying Ho , Chi-Tung Cheng , Meng-Lin Li , Tsung-Yi Ho