English
Related papers

Related papers: Application Of Vision-Language Models For Assessin…

200 papers

Osteoporosis is a widespread and chronic metabolic bone disease that often remains undiagnosed and untreated due to limited access to bone mineral density (BMD) tests like Dual-energy X-ray absorptiometry (DXA). In response to this…

Image and Video Processing · Electrical Eng. & Systems 2024-12-10 Ung Hwang , Chang-Hun Lee , Kijung Yoon

In medical science, the use of computer science in disease detection and diagnosis is gaining popularity. Previously, the detection of disease used to take a significant amount of time and was less reliable. Machine learning (ML) techniques…

Image and Video Processing · Electrical Eng. & Systems 2019-12-18 Nowshin Tasnim , Mahmudul Hasan , Ishrak Islam

We present a knowledge augmentation strategy for assessing the diagnostic groups and gait impairment from monocular gait videos. Based on a large-scale pre-trained Vision Language Model (VLM), our model learns and improves visual, textual,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Diwei Wang , Kun Yuan , Candice Muller , Frédéric Blanc , Nicolas Padoy , Hyewon Seo

Recent advances in machine learning are transforming medical image analysis, particularly in cancer detection and classification. Techniques such as deep learning, especially convolutional neural networks (CNNs) and vision transformers…

Image and Video Processing · Electrical Eng. & Systems 2024-11-05 Arezoo Borji , Gernot Kronreif , Bernhard Angermayr , Sepideh Hatamikia

Every day, countless surgeries are performed worldwide, each within the distinct settings of operating rooms (ORs) that vary not only in their setups but also in the personnel, tools, and equipment used. This inherent diversity poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Ege Özsoy , Chantal Pellegrini , Matthias Keicher , Nassir Navab

The severity of knee osteoarthritis is graded using the 5-point Kellgren-Lawrence (KL) scale where healthy knees are assigned grade 0, and the subsequent grades 1-4 represent increasing severity of the affliction. Although several methods…

Image and Video Processing · Electrical Eng. & Systems 2020-04-21 Sudeep Kondal , Viraj Kulkarni , Ashrika Gaikwad , Amit Kharat , Aniruddha Pant

Background: The 2022 update of the Ovarian-Adnexal Reporting and Data System (O-RADS) ultrasound classification refines risk stratification for adnexal lesions, yet human interpretation remains subject to variability and conservative…

Recent vision-language-action models (VLAs) build upon pretrained vision-language models and leverage diverse robot datasets to demonstrate strong task execution, language following ability, and semantic generalization. Despite these…

Robotics · Computer Science 2025-04-29 Moo Jin Kim , Chelsea Finn , Percy Liang

The previous advancements in pathology image understanding primarily involved developing models tailored to specific tasks. Recent studies has demonstrated that the large vision-language model can enhance the performance of various…

Artificial Intelligence · Computer Science 2024-08-20 Dawei Dai , Yuanhui Zhang , Long Xu , Qianlan Yang , Xiaojing Shen , Shuyin Xia , Guoyin Wang

Recent studies on Vision-Language-Action (VLA) models have shifted from the end-to-end action-generation paradigm toward a pipeline involving task planning followed by action generation, demonstrating improved performance on various…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Chongkai Gao , Zixuan Liu , Zhenghao Chi , Junshan Huang , Xin Fei , Yiwen Hou , Yuxuan Zhang , Yudi Lin , Zhirui Fang , Zeyu Jiang , Lin Shao

Purpose: To propose and evaluate an accelerated $T_{1\rho}$ quantification method that combines $T_{1\rho}$-weighted fast spin echo (FSE) images and proton density (PD)-weighted anatomical FSE images, leveraging deep learning models for…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Junru Zhong , Chaoxing Huang , Ziqiang Yu , Fan Xiao , Siyue Li , Tim-Yun Michael Ong , Ki-Wai Kevin Ho , Queenie Chan , James F. Griffith , Weitian Chen

Occupational pneumoconiosis (OP) staging is a vital task concerning the lung healthy of a subject. The staging result of a patient is depended on the staging standard and his chest X-ray. It is essentially an image classification task.…

Machine Learning · Computer Science 2022-08-16 Kaiguang Yang , Yeping Wang , Qianhao Luo , Xin Liu , Weiling Li

Medical Vision-Language Pre-training (VLP) learns representations jointly from medical images and paired radiology reports. It typically requires large-scale paired image-text datasets to achieve effective pre-training for both the image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Che Liu , Anand Shah , Wenjia Bai , Rossella Arcucci

Knee osteoarthritis frequently exhibits discordance between structural damage observed in imaging and patient-reported symptoms such as pain. This mismatch complicates clinical interpretation and patient stratification and remains…

Machine Learning · Computer Science 2026-04-21 Pegah Ahadian , Mingrui Yang , Sixu Chen , Xiaojuan Li , Qiang Guan

Vision-Language Pre-training (VLP) has advanced the performance of many vision-language tasks, such as image-text retrieval, visual entailment, and visual reasoning. The pre-training mostly utilizes lexical databases and image queries in…

Computation and Language · Computer Science 2023-06-30 Yasmine Karoui , Rémi Lebret , Negar Foroutan , Karl Aberer

Vision-Language Models (VLMs) have significantly advanced medical visual question answering, yet their performance in ultrasound remains suboptimal. In clinical practice, sonographers explicitly focus on lesion regions to formulate reports,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yue Zhou , Erxuan Wu , Yikang Sun , Hongjoo Lee , Yuan Bi , Huixiong Xu , Nassir Navab , Zhongliang Jiang

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

Osteoporotic vertebral compression fractures (OVCFs) are prevalent in the elderly population, typically assessed on computed tomography (CT) scans by evaluating vertebral height loss. This assessment helps determine the fracture's impact on…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Qi Zhang , Cheng Chuang , Shunan Zhang , Ziqi Zhao , Kun Wang , Jun Xu , Jianqi Sun

Modern Vision-Language Models (VLMs) exhibit unprecedented capabilities in cross-modal semantic understanding between visual and textual modalities. Given the intrinsic need for multi-modal integration in clinical applications, VLMs have…

Image and Video Processing · Electrical Eng. & Systems 2025-06-24 Haoneng Lin , Cheng Xu , Jing Qin

Communication has become increasingly dynamic with the popularization of social networks and applications that allow people to express themselves and communicate instantly. In this scenario, distributed representation models have their…

Computation and Language · Computer Science 2024-05-30 Johannes V. Lochter , Renato M. Silva , Tiago A. Almeida