English
Related papers

Related papers: Knowledge-Driven Vision-Language Model for Plexus …

200 papers

Malignant brain tumors have become an aggressive and dangerous disease that leads to death worldwide.Multi-modal MRI data is crucial for accurate brain tumor segmentation, but missing modalities common in clinical practice can severely…

Methodology · Statistics 2025-07-11 Guoyan Liang , Qin Zhou , Jingyuan Chen , Bingcang Huang , Kai Chen , Lin Gu , Zhe Wang , Sai Wu , Chang Yao

This paper addresses the challenges posed by the unstructured nature and high-dimensional semantic complexity of electronic health record texts. A deep learning method based on attention mechanisms is proposed to achieve unified modeling…

Computation and Language · Computer Science 2025-07-03 Ting Xu , Xiaoxiao Deng , Xiandong Meng , Haifeng Yang , Yan Wu

Medical vision-language pretraining (VLP) that leverages naturally-paired medical image-report data is crucial for medical image analysis. However, existing methods struggle to accurately characterize associations between images and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xinjie Liang , Xiangyu Li , Fanding Li , Jie Jiang , Qing Dong , Wei Wang , Kuanquan Wang , Suyu Dong , Gongning Luo , Shuo Li

Natural language could play an important role in developing generalist surgical models by providing a broad source of supervision from raw texts. This flexible form of supervision can enable the model's transferability across datasets and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Kun Yuan , Vinkle Srivastav , Nassir Navab , Nicolas Padoy

Precise and efficient automated identification of Gastrointestinal (GI) tract diseases can help doctors treat more patients and improve the rate of disease detection and identification. Currently, automatic analysis of diseases in the GI…

The ambiguity of the decision-making process has been pointed out as the main obstacle to applying the deep learning-based method in a practical way in spite of its outstanding performance. Interpretability could guarantee the confidence of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Hyebin Lee , Seong Tae Kim , Yong Man Ro

Deep learning (DL) models have achieved paradigm-changing performance in many fields with high dimensional data, such as images, audio, and text. However, the black-box nature of deep neural networks is a barrier not just to adoption in…

Machine Learning · Computer Science 2020-02-25 Parmita Mehta , Stephen Portillo , Magdalena Balazinska , Andrew Connolly

Despite remarkable advancements in pixel-level medical image perception, existing methods are either limited to specific tasks or heavily rely on accurate bounding boxes or text labels as input prompts. However, the medical knowledge…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Qinyue Tong , Ziqian Lu , Jun Liu , Yangming Zheng , Zheming Lu

Background: The rapid integration of foundation models into clinical practice and public health necessitates a rigorous evaluation of their true clinical reasoning capabilities beyond narrow examination success. Current benchmarks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dingyu Wang , Zimu Yuan , Jiajun Liu , Shanggui Liu , Nan Zhou , Tianxing Xu , Di Huang , Dong Jiang

An accurate differential diagnosis (DDx) is essential for patient care, shaping therapeutic decisions and influencing outcomes. Recently, Large Language Models (LLMs) have emerged as promising tools to support this process by generating a…

Artificial Intelligence · Computer Science 2025-10-07 Seungseop Lim , Gibaeg Kim , Hyunkyung Lee , Wooseok Han , Jean Seo , Jaehyo Yoo , Eunho Yang

Early diagnosis of interstitial lung diseases is crucial for their treatment, but even experienced physicians find it difficult, as their clinical manifestations are similar. In order to assist with the diagnosis, computer-aided diagnosis…

Computer Vision and Pattern Recognition · Computer Science 2016-12-13 Stergios Christodoulidis , Marios Anthimopoulos , Lukas Ebner , Andreas Christe , Stavroula Mougiakakou

We present HealthGPT, a powerful Medical Large Vision-Language Model (Med-LVLM) that integrates medical visual comprehension and generation capabilities within a unified autoregressive paradigm. Our bootstrapping philosophy is to…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Tianwei Lin , Wenqiao Zhang , Sijing Li , Yuqian Yuan , Binhe Yu , Haoyuan Li , Wanggui He , Hao Jiang , Mengze Li , Xiaohui Song , Siliang Tang , Jun Xiao , Hui Lin , Yueting Zhuang , Beng Chin Ooi

Evaluating AI-generated medical image segmentations for clinical acceptability poses a significant challenge, as traditional pixelagreement metrics often fail to capture true diagnostic utility. This paper introduces Hierarchical Clinical…

Image and Video Processing · Electrical Eng. & Systems 2025-06-03 Jiaxi Sheng , Leyi Yu , Haoyue Li , Yifan Gao , Xin Gao

Parkinson's disease (PD) is a degenerative and progressive neurological condition. Early diagnosis can improve treatment for patients and is performed through dopaminergic imaging techniques like the SPECT DaTscan. In this study, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Pavan Rajkumar Magesh , Richard Delwin Myloth , Rijo Jackson Tom

Deep learning has great potential for accurate detection and classification of diseases with medical imaging data, but the performance is often limited by the number of training datasets and memory requirements. In addition, many deep…

Image and Video Processing · Electrical Eng. & Systems 2021-01-14 Xiaofeng Liu , Fangxu Xing , Chao Yang , C. -C. Jay Kuo , Suma Babu , Georges El Fakhri , Thomas Jenkins , Jonghye Woo

Ewing's sarcoma (ES), characterized by a high density of small round blue cells without structural organization, presents a significant health concern, particularly among adolescents aged 10 to 19. Artificial intelligence-based systems for…

Pathology and anatomy are two essential groups of semantics in medical data. Pathology describes what the diseases are, while anatomy explains where the diseases occur. They describe diseases from different perspectives, providing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Wenrui Fan , Mohammod N. I. Suvon , Shuo Zhou , Xianyuan Liu , Samer Alabed , Venet Osmani , Andrew J. Swift , Chen Chen , Haiping Lu

Radiologists interpret mammography exams by jointly analyzing all four views, as correlations among them are crucial for accurate diagnosis. Recent methods employ dedicated fusion blocks to capture such dependencies, but these are often…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Eleonora Lopez , Eleonora Grassucci , Danilo Comminiello

The increasing global prevalence of mental disorders, such as depression and PTSD, requires objective and scalable diagnostic tools. Traditional clinical assessments often face limitations in accessibility, objectivity, and consistency.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-03 Abdelrahaman A. Hassan , Abdelrahman A. Ali , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda

Gastrointestinal endoscopy is a medical procedure that utilizes a flexible tube equipped with a camera and other instruments to examine the digestive tract. This minimally invasive technique allows for diagnosing and managing various…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Pham Vu Hung , Nguyen Duy Manh , Nguyen Thi Oanh , Nguyen Thi Thuy , Dinh Viet Sang