English
Related papers

Related papers: Application Of Vision-Language Models For Assessin…

200 papers

Medical vision-language pretraining (VLP) that leverages naturally-paired medical image-report data is crucial for medical image analysis. However, existing methods struggle to accurately characterize associations between images and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Xinjie Liang , Xiangyu Li , Fanding Li , Jie Jiang , Qing Dong , Wei Wang , Kuanquan Wang , Suyu Dong , Gongning Luo , Shuo Li

Osteoarthritis (OA) is the most common musculoskeletal disease, with knee OA (KOA) being one of the leading causes of disability and a significant economic burden. Predicting KOA progression is crucial for improving patient outcomes,…

Machine Learning · Computer Science 2025-04-09 Khanh Nguyen , Huy Hoang Nguyen , Egor Panfilov , Aleksei Tiulpin

Deep learning has shown great potential in assisting radiologists in reading chest X-ray (CXR) images, but its need for expensive annotations for improving performance prevents widespread clinical application. Visual language pre-training…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Sumin Seo , JaeWoong Shin , Jaewoo Kang , Tae Soo Kim , Thijs Kooi

Existing artificial intelligence (AI) models for diagnosing knee osteoarthritis (OA) have faced criticism for their lack of transparency and interpretability, despite achieving medical-expert-like performance. This opacity makes them…

Machine Learning · Computer Science 2023-08-21 Yun Xin Teoh , Alice Othmani , Siew Li Goh , Juliana Usman , Khin Wee Lai

Accurate disease interpretation from radiology remains challenging due to imaging heterogeneity. Achieving expert-level diagnostic decisions requires integration of subtle image features with clinical knowledge. Yet major vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Difei Gu , Yunhe Gao , Mu Zhou , Dimitris Metaxas

Foundation models are large-scale versatile systems trained on vast quantities of diverse data to learn generalizable representations. Their adaptability with minimal fine-tuning makes them particularly promising for medical imaging, where…

Image and Video Processing · Electrical Eng. & Systems 2025-03-20 Lucie Berger , Mathieu Lamard , Philippe Zhang , Laurent Borderie , Alexandre Le Guilcher , Pascale Massin , Béatrice Cochener , Gwenolé Quellec , Sarah Matta

Recent advancements in computer vision promise to automate medical image analysis. Rheumatoid arthritis is an autoimmune disease that would profit from computer-based diagnosis, as there are no direct markers known, and doctors have to rely…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Krzysztof Maziarz , Anna Krason , Zbigniew Wojna

Anatomical understanding through deep learning is critical for automatic report generation, intra-operative navigation, and organ localization in medical imaging; however, its progress is constrained by the scarcity of expert-labeled data.…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Yiwei Li , Yikang Liu , Jiaqi Guo , Lin Zhao , Zheyuan Zhang , Xiao Chen , Boris Mailhe , Ankush Mukherjee , Terrence Chen , Shanhui Sun

Knee osteoarthritis (OA) is the most common osteoarthritis and a leading cause of disability. Cartilage defects are regarded as major manifestations of knee OA, which are visible by magnetic resonance imaging (MRI). Thus early detection and…

Image and Video Processing · Electrical Eng. & Systems 2022-01-13 Zixu Zhuang , Liping Si , Sheng Wang , Kai Xuan , Xi Ouyang , Yiqiang Zhan , Zhong Xue , Lichi Zhang , Dinggang Shen , Weiwu Yao , Qian Wang

Artificial intelligence (AI) shows great potential in assisting radiologists to improve the efficiency and accuracy of medical image interpretation and diagnosis. However, a versatile AI model requires large-scale data and comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Zhongyi Shui , Jianpeng Zhang , Weiwei Cao , Sinuo Wang , Ruizhe Guo , Le Lu , Lin Yang , Xianghua Ye , Tingbo Liang , Qi Zhang , Ling Zhang

The aim of this study was to investigate the influence of MRI and patient data on the prediction of knee osteoarthritis (OA) incidence using different deep learning architectures. Knee OA incidence within 24 months was predicted using the…

Medical Physics · Physics 2022-09-05 Anastasis Alexopoulos , Jukka Hirvasniemi , Nazli Tümer

Automatic assessment of dysarthria remains a highly challenging task due to high variability in acoustic signals and the limited data. Currently, research on the automatic assessment of dysarthria primarily focuses on two approaches: one…

Audio and Speech Processing · Electrical Eng. & Systems 2024-05-08 Xiaokang Liu , Xiaoxia Du , Juan Liu , Rongfeng Su , Manwa Lawrence Ng , Yumei Zhang , Yudong Yang , Shaofeng Zhao , Lan Wang , Nan Yan

In recent years, large language models (LLMs) have demonstrated remarkable potential across various medical applications. Building on this foundation, multimodal large language models (MLLMs) integrate LLMs with visual models to process…

Computation and Language · Computer Science 2025-03-11 Xiaoyi Liang , Mouxiao Bian , Moxin Chen , Lihao Liu , Junjun He , Jie Xu , Lin Li

Existing Vision-Language Pretraining (VLP) methods have achieved remarkable improvements across a variety of vision-language tasks, confirming their effectiveness in capturing coarse-grained semantic correlations. However, their capability…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yeyuan Wang , Dehong Gao , Lei Yi , Linbo Jin , Jinxia Zhang , Libin Yang , Xiaoyan Cai

Automatic detection and severity assessment of dysarthria are crucial for delivering targeted therapeutic interventions to patients. While most existing research focuses primarily on speech modality, this study introduces a novel approach…

Artificial Intelligence · Computer Science 2025-04-29 Anuprabha M , Krishna Gurugubelli , V Kesavaraj , Anil Kumar Vuppala

Knee-Joint Osteoarthritis (KOA) is a prevalent cause of global disability and is inherently complex to diagnose due to its subtle radiographic markers and individualized progression. One promising classification avenue involves applying…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Fabi Prezja , Leevi Annala , Sampsa Kiiskinen , Suvi Lahtinen , Timo Ojala

Large annotated datasets are essential for training robust Computer-Aided Diagnosis (CAD) models for breast cancer detection or risk prediction. However, acquiring such datasets with fine-detailed annotation is both costly and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Shunjie-Fabian Zheng , Hyeonjun Lee , Thijs Kooi , Ali Diba

The evaluation of text-generative vision-language models is a challenging yet crucial endeavor. By addressing the limitations of existing Visual Question Answering (VQA) benchmarks and proposing innovative evaluation methodologies, our…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Simon Ging , María A. Bravo , Thomas Brox

Vision-language models (VLMs) have shown strong promise for medical image analysis, but most remain opaque, offering predictions without the transparent, stepwise reasoning clinicians rely on. We present a framework that brings…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Andriy Myronenko , Dong Yang , Baris Turkbey , Mariam Aboian , Sena Azamat , Esra Akcicek , Hongxu Yin , Pavlo Molchanov , Marc Edgar , Yufan He , Pengfei Guo , Yucheng Tang , Daguang Xu

Vision-language pretraining (VLP) has emerged as a powerful paradigm in medical image analysis, enabling representation learning from large-scale image-text pairs without relying on expensive manual annotations. However, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Xieji Li , Siyuan Yan , Yingsheng Liu , H. Peter Soyer , Monika Janda , Victoria Mar , Zongyuan Ge