English
Related papers

Related papers: A multimodal vision foundation model for generaliz…

200 papers

Spine disorders affect 619 million people globally and are a leading cause of disability, yet AI-assisted diagnosis remains limited by the lack of level-aware, multimodal datasets. Clinical decision-making for spine disorders requires…

Osteoarthritis (OA) is the most prevalent chronic joint disease worldwide, where knee OA takes more than 80% of commonly affected joints. Knee OA is not a curable disease yet, and it affects large columns of patients, making it costly to…

Artificial Intelligence · Computer Science 2022-12-23 Soheyla Amirian , Husam Ghazaleh , Mehdi Assefi , Hilal Maradit Kremers , Hamid R. Arabnia , Johannes F. Plate , Ahmad P. Tafti

Knee Osteoarthritis (KOA), a leading cause of disability worldwide, is challenging to detect early due to subtle radiographic indicators. Diverse, extensive datasets are needed but are challenging to compile because of privacy, data…

Image and Video Processing · Electrical Eng. & Systems 2023-11-13 Fabi Prezja , Leevi Annala , Sampsa Kiiskinen , Suvi Lahtinen , Timo Ojala

Osteoporosis, characterized by reduced bone mineral density (BMD) and compromised bone microstructure, increases fracture risk in aging populations. While dual-energy X-ray absorptiometry (DXA) is the clinical standard for BMD assessment,…

Image and Video Processing · Electrical Eng. & Systems 2025-06-26 Jiaxing Huang , Heng Guo , Le Lu , Fan Yang , Minfeng Xu , Ge Yang , Wei Luo

Foundation models (FMs) have shown great promise in medical imaging, but most FMs are trained on unimodal data within isolated domains, such as brain MRI alone. Human aging and disease arise through coordinated biological processes across…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Qiangqiang Wu , Grace McIlvain , Zhou Yu , Junhao Wen

Musculoskeletal conditions affect more than 1.7 billion people worldwide based on a study by Global Burden Disease, and they are the second greatest cause of disability[1,2]. The diagnosis of these conditions vary but mostly physical exams…

Computers and Society · Computer Science 2019-08-07 Dennis Banga , Peter Waiganjo

Recent advancements in artificial intelligence (AI), particularly foundation models (FMs), have revolutionized medical image analysis, demonstrating strong zero- and few-shot performance across diverse medical imaging tasks, from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Praveenbalaji Rajendran , Mojtaba Safari , Wenfeng He , Mingzhe Hu , Shansong Wang , Jun Zhou , Xiaofeng Yang

This research paper explores the classification of knee osteoarthritis (OA) severity levels using advanced computer vision models and augmentation techniques. The study investigates the effectiveness of data preprocessing, including…

Current Vision-Language Models (VLMs) struggle to ground anatomical regions in 3D medical images and reason about them in a step-by-step manner, a key requirement of real-world diagnostic assessment. This ability is essential for aligning…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Sraavya Sambara , Sung Eun Kim , Xiaoman Zhang , Luyang Luo , Shreya Johri , Mohammed Baharoon , Du Hyun Ro , Pranav Rajpurkar

Ultra-wide optical coherence tomography angiography (UW-OCTA) is an emerging imaging technique that offers significant advantages over traditional OCTA by providing an exceptionally wide scanning range of up to 24 x 20 $mm^{2}$, covering…

Image and Video Processing · Electrical Eng. & Systems 2023-11-20 Hao Wei , Peilun Shi , Guitao Bai , Minqing Zhang , Shuangle Li , Wu Yuan

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler

The integration of artificial intelligence (AI) in medical diagnostics represents a significant advancement in managing upper gastrointestinal (GI) cancer, a major cause of global cancer mortality. Specifically for gastric cancer (GC),…

Knee osteoarthritis (OA) is the most common musculoskeletal disease in the world. In primary healthcare, knee OA is diagnosed using clinical examination and radiographic assessment. Osteoarthritis Research Society International (OARSI)…

Image and Video Processing · Electrical Eng. & Systems 2019-07-19 Aleksei Tiulpin , Simo Saarakkala

Knee osteoarthritis (OA) is the most common musculoskeletal disorder. OA diagnosis is currently conducted by assessing symptoms and evaluating plain radiographs, but this process suffers from subjectivity. In this study, we present a new…

Computer Vision and Pattern Recognition · Computer Science 2017-10-31 Aleksei Tiulpin , Jérôme Thevenot , Esa Rahtu , Petri Lehenkari , Simo Saarakkala

Background: Accumulation of abnormal contact stress is a primary biomechanical driver of acute meniscal tears and chronic osteoarthritis. While Finite Element Analysis (FEA) provides the necessary fidelity to quantify these injury-inducing…

Quantitative Methods · Quantitative Biology 2025-12-16 Zhengye Pan , Jianwei Zuo , Jiajia Luo

Radiology is a vital and complex component of modern clinical workflow and covers many tasks. Recently, vision-language (VL) foundation models in medicine have shown potential in processing multimodal information, offering a unified…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Xiaohong Liu , Guoxing Yang , Yulin Luo , Jiaji Mao , Xiang Zhang , Ming Gao , Shanghang Zhang , Jun Shen , Guangyu Wang

Knee osteoarthritis (KOA) grading based on radiographic images is a critical yet challenging task due to subtle inter-grade differences, annotation uncertainty, and the inherently ordinal nature of disease progression. Conventional deep…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Xiaoyang Li , Runni Zhou

Background: MRI is the modality of choice for cartilage imaging; however, its diagnostic performance is variable and significantly lower than the gold standard diagnostic knee arthroscopy. In recent years, deep learning has been used to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Gergo Merkely , Alireza Borjali , Molly Zgoda , Evan M. Farina , Simon Gortz , Orhun Muratoglu , Christian Lattermann , Kartik M. Varadarajan

In healthcare, multimodal data is prevalent and requires to be comprehensively analyzed before diagnostic decisions, including medical images, clinical reports, etc. However, current large-scale artificial intelligence models predominantly…

Artificial Intelligence · Computer Science 2023-06-29 Weihua Liu , Yong Zuo

Breast cancer is the most commonly diagnosed cancer and the leading cause of cancer-related mortality in women globally. Mammography is essential for the early detection and diagnosis of breast lesions. Despite recent progress in foundation…