English
Related papers

Related papers: Application Of Vision-Language Models For Assessin…

200 papers

Significant methodological strides have been made toward Chest X-ray (CXR) understanding via modern vision-language models (VLMs), demonstrating impressive Visual Question Answering (VQA) and CXR report generation abilities. However,…

Artificial Intelligence · Computer Science 2024-04-01 Seil Kang , Donghyun Kim , Junhyeok Kim , Hyo Kyung Lee , Seong Jae Hwang

As generative AI continues to evolve, Vision Language Models (VLMs) have emerged as promising tools in various healthcare applications. One area that remains relatively underexplored is their use in human activity recognition (HAR) for…

Computation and Language · Computer Science 2025-11-18 Abderrazek Abid , Thanh-Cong Ho , Fakhri Karray

This paper addresses the challenge of localization of anatomical landmarks in knee X-ray images at different stages of osteoarthritis (OA). Landmark localization can be viewed as regression problem, where the landmark position is directly…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Aleksei Tiulpin , Iaroslav Melekhov , Simo Saarakkala

Large Vision-Language Models offer a new paradigm for AI-driven image understanding, enabling models to perform tasks without task-specific training. This flexibility holds particular promise across medicine, where expert-annotated data is…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Anita Rau , Mark Endo , Josiah Aklilu , Jaewoo Heo , Khaled Saab , Alberto Paderno , Jeffrey Jopling , F. Christopher Holsinger , Serena Yeung-Levy

3D medical image analysis is pivotal in numerous clinical applications. However, the scarcity of labeled data and limited generalization capabilities hinder the advancement of AI-empowered models. Radiology reports are easily accessible and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Xuefeng Ni , Linshan Wu , Jiaxin Zhuang , Qiong Wang , Mingxiang Wu , Varut Vardhanabhuti , Lihai Zhang , Hanyu Gao , Hao Chen

Vision-language pre-training (VLP) on large-scale image-text pairs has recently witnessed rapid progress for learning cross-modal representations. Existing pre-training methods either directly concatenate image representation and text…

Computation and Language · Computer Science 2021-03-16 Chenliang Li , Ming Yan , Haiyang Xu , Fuli Luo , Wei Wang , Bin Bi , Songfang Huang

This paper presents a comprehensive survey of vision-language (VL) intelligence from the perspective of time. This survey is inspired by the remarkable progress in both computer vision and natural language processing, and recent trends…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Feng Li , Hao Zhang , Yi-Fan Zhang , Shilong Liu , Jian Guo , Lionel M. Ni , PengChuan Zhang , Lei Zhang

This paper proposes leveraging vision-language pretraining on bone X-rays paired with French reports to address downstream tasks of interest on bone radiography. A practical processing pipeline is introduced to anonymize and process French…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Alexandre Englebert , Anne-Sophie Collin , Olivier Cornu , Christophe De Vleeschouwer

Clinical decision-making relies heavily on understanding relative positions of anatomical structures and anomalies. Therefore, for Vision-Language Models (VLMs) to be applicable in clinical practice, the ability to accurately determine…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Daniel Wolf , Heiko Hillenhagen , Billurvan Taskin , Alex Bäuerle , Meinrad Beer , Michael Götz , Timo Ropinski

Analysis of public opinions collected from digital media helps organizations maintain positive relationships with the public. Such public relations (PR) analysis often involves assessing opinions, for example, measuring how strongly people…

Human-Computer Interaction · Computer Science 2025-09-08 Sangbong Yoo , Seongbum Seo , Chanyoung Yoon , Hyelim Lee , Jeong-Nam Kim , Chansoo Kim , Yun Jang , Takanori Fujiwara

Image and language modeling is of crucial importance for vision-language pre-training (VLP), which aims to learn multi-modal representations from large-scale paired image-text data. However, we observe that most existing VLP methods focus…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Sunan He , Taian Guo , Tao Dai , Ruizhi Qiao , Chen Wu , Xiujun Shu , Bo Ren

Neuroimaging is a ubiquitous tool for evaluating patients with neurological diseases. The global demand for magnetic resonance imaging (MRI) studies has risen steadily, placing significant strain on health systems, prolonging turnaround…

In ophthalmology, intravitreal operative medication therapy (IVOM) is a widespread treatment for diseases related to the age-related macular degeneration (AMD), the diabetic macular edema (DME), as well as the retinal vein occlusion (RVO).…

Image and Video Processing · Electrical Eng. & Systems 2024-10-03 Tobias Schlosser , Frederik Beuth , Trixy Meyer , Arunodhayan Sampath Kumar , Gabriel Stolze , Olga Furashova , Katrin Engelmann , Danny Kowerko

Inspired by the success of vision-language methods (VLMs) in zero-shot classification, recent works attempt to extend this line of work into object detection by leveraging the localization ability of pre-trained VLMs and generating pseudo…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Yanxin Long , Jianhua Han , Runhui Huang , Xu Hang , Yi Zhu , Chunjing Xu , Xiaodan Liang

Recent advances in vision-language models (VLMs) have shown remarkable potential in bridging visual and textual modalities. In computational pathology, domain-specific VLMs, which are pre-trained on extensive histopathology image-text…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Anh Tien Nguyen , Keunho Byeon , Kyungeun Kim , Jin Tae Kwak

Osteoporosis can be identified by looking at 2D x-ray images of the bone. The high degree of similarity between images of a healthy bone and a diseased one makes classification a challenge. A good bone texture characterization technique is…

Computer Vision and Pattern Recognition · Computer Science 2017-07-19 Rahul Paul , Saeed Alahamri , Sulav Malla , Ghulam Jilani Quadri

While traditional computer vision models have historically struggled to generalize to endoscopic domains, the emergence of foundation models has shown promising cross-domain performance. In this work, we present the first large-scale study…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Leon Mayer , Tim Rädsch , Dominik Michael , Lucas Luttner , Amine Yamlahi , Evangelia Christodoulou , Patrick Godau , Marcel Knopp , Annika Reinke , Fiona Kolbinger , Lena Maier-Hein

Visual grounding (VG) is the capability to identify the specific regions in an image associated with a particular text description. In medical imaging, VG enhances interpretability by highlighting relevant pathological features…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Ta Duc Huy , Duy Anh Huynh , Yutong Xie , Yuankai Qi , Qi Chen , Phi Le Nguyen , Sen Kim Tran , Son Lam Phung , Anton van den Hengel , Zhibin Liao , Minh-Son To , Johan W. Verjans , Vu Minh Hieu Phan

Knee osteoarthritis (OA) is a widespread chronic condition that impairs mobility and diminishes quality of life. Despite the proven benefits of exercise therapy and patient education in managing the OA symptoms pain and functional…

Machine Learning · Computer Science 2024-10-17 M. Rafiei , S. Das , M. Bakhtiari , E. M. Roos , S. T. Skou , D. T. Grønne , J. Baumbach , L. Baumbach

Osteoporosis silently erodes skeletal integrity worldwide; however, early detection through imaging can prevent most fragility fractures. Artificial intelligence (AI) methods now mine routine Dual-energy X-ray Absorptiometry (DXA), X-ray,…

Image and Video Processing · Electrical Eng. & Systems 2025-10-02 Abdul Rahman , Bumshik Lee