English
Related papers

Related papers: FT-ARM: Fine-Tuned Agentic Reflection Multimodal L…

200 papers

Lung cancer has the highest mortality rate of deadly cancers in the world. Early detection is essential to treatment of lung cancer. However, detection and accurate diagnosis of pulmonary nodules depend heavily on the experiences of…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Chenglong Wang , Yun Liu , Fen Wang , Chengxiu Zhang , Yida Wang , Mei Yuan , Guang Yang

Accurate preoperative assessment of lymph node (LN) metastasis in rectal cancer guides treatment decisions, yet conventional MRI evaluation based on morphological criteria shows limited diagnostic performance. While some artificial…

Machine Learning · Computer Science 2025-07-16 Yaoxian Dong , Yifan Gao , Haoyue Li , Yanfen Cui , Xin Gao

Medical vision-language models (VLMs) excel at image-text understanding but typically rely on a single-pass reasoning that neglects localized visual cues. In clinical practice, however, human experts iteratively scan, focus, and refine the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Kaitao Chen , Shaohao Rui , Yankai Jiang , Jiamin Wu , Qihao Zheng , Chunfeng Song , Xiaosong Wang , Mu Zhou , Mianxin Liu

Burn injuries can result from mechanisms such as thermal, chemical, and electrical insults. A prompt and accurate assessment of burns is essential for deciding definitive clinical treatments. Currently, the primary approach for burn…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Mahla Abdolahnejad , Justin Lee , Hannah Chan , Alex Morzycki , Olivier Ethier , Anthea Mo , Peter X. Liu , Joshua N. Wong , Colin Hong , Rakesh Joshi

Peptide receptor radionuclide therapy (PRRT) is an established treatment for metastatic neuroendocrine tumors (NETs), yet long-term disease control occurs only in a subset of patients. Predicting progression-free survival (PFS) could…

While generative text-to-speech (TTS) models approach human-level quality, monolithic metrics fail to diagnose fine-grained acoustic artifacts or explain perceptual collapse. To address this, we propose TTS-PRISM, a multi-dimensional…

Computation and Language · Computer Science 2026-04-27 Xi Wang , Jie Wang , Xingchen Song , Baijun Song , Jingran Xie , Jiahe Shao , Zijian Lin , Di Wu , Meng Meng , Jian Luan , Zhiyong Wu

Pelvic ring disruptions result from blunt injury mechanisms and are often found in patients with multi-system trauma. To grade pelvic fracture severity in trauma victims based on whole-body CT, the Tile AO/OTA classification is frequently…

Image and Video Processing · Electrical Eng. & Systems 2021-05-24 Anna Zapaishchykova , David Dreizin , Zhaoshuo Li , Jie Ying Wu , Shahrooz Faghih Roohi , Mathias Unberath

Reasoning is a critical frontier for advancing medical image analysis, where transparency and trustworthiness play a central role in both clinician trust and regulatory approval. Although Medical Visual Language Models (VLMs) show promise…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jiazhen Pan , Che Liu , Junde Wu , Fenglin Liu , Jiayuan Zhu , Hongwei Bran Li , Chen Chen , Cheng Ouyang , Daniel Rueckert

Brain tumors represent one of the most critical neurological conditions, where early and accurate diagnosis is directly correlated with patient survival rates. Manual interpretation of Magnetic Resonance Imaging (MRI) scans is…

Computer Vision and Pattern Recognition · Computer Science 2026-04-24 Chinedu Emmanuel Mbonu , Tochukwu Sunday Belonwu , Okwuchukwu Ejike Chukwuogo , Kenechukwu Sylvanus Anigbogu

Current deep learning models are mostly task specific and lack a user-friendly interface to operate. We present Meta-EyeFM, a multi-function foundation model that integrates a large language model (LLM) with vision foundation models (VFMs)…

Despite the outstanding performance of deep learning models in clinical prediction tasks, explainability remains a significant challenge. Inspired by transformer architectures, we introduce the Temporal-Feature Cross Attention Mechanism…

Machine Learning · Computer Science 2025-09-22 Yubo Li , Xinyu Yao , Rema Padman

Fine-grained glomerular subtyping is central to kidney biopsy interpretation, but clinically valuable labels are scarce and difficult to obtain. Existing computational pathology approaches instead tend to evaluate coarse diseased…

Objective: Post-traumatic epilepsy (PTE) is a debilitating neurological disorder that develops after traumatic brain injury (TBI). Early prediction of PTE remains challenging due to heterogeneous clinical data, limited positive cases, and…

Machine Learning · Computer Science 2026-04-17 Wenhui Cui , Nicholas Swingle , Anand A. Joshi , Dileep Nair , Richard M. Leahy

The differential diagnosis of neurodegenerative dementias is a challenging clinical task, mainly because of the overlap in symptom presentation and the similarity of patterns observed in structural neuroimaging. To improve diagnostic…

Machine Learning · Computer Science 2025-05-27 Andrew Zamai , Nathanael Fijalkow , Boris Mansencal , Laurent Simon , Eloi Navet , Pierrick Coupe

The two-stage fine-tuning (FT) method, linear probing (LP) then fine-tuning (LP-FT), outperforms linear probing and FT alone. This holds true for both in-distribution (ID) and out-of-distribution (OOD) data. One key reason for its success…

Machine Learning · Computer Science 2024-10-23 Akiyoshi Tomihari , Issei Sato

Negation is a fundamental linguistic operation in clinical reporting, yet vision-language models (VLMs) frequently fail to distinguish affirmative from negated medical statements. To systematically characterize this limitation, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Ali Abbasi , Mehdi Taghipour , Rahmatollah Beheshti

Patients with Frontotemporal Dementia (FTD) have impaired cognitive abilities, executive and behavioral traits, loss of language ability, and decreased memory capabilities. Based on the distinct patterns of cortical atrophy and symptoms,…

Artificial Intelligence · Computer Science 2021-04-13 Km Poonam , Rajlakshmi Guha , Partha P Chakrabarti

Background Major depressive disorder (MDD) is a leading cause of global disability, yet current diagnostic approaches often rely on subjective assessments and lack the ability to integrate multimodal clinical information. Large language…

Machine Learning · Computer Science 2025-09-30 Yuyang Sha , Hongxin Pan , Gang Luo , Caijuan Shi , Jing Wang , Kefeng Li

Accurate segmentation of organs and lesions in medical images is essential for clinical applications including diagnosis, prognosis, and treatment planning. While Vision Transformers (ViTs) have shown impressive segmentation performance,…

Image and Video Processing · Electrical Eng. & Systems 2026-05-13 Jin Yang , Xiaobing Yu , Peijie Qiu

Monitoring the health status of patients in the Intensive Care Unit (ICU) is a critical aspect of providing superior care and treatment. The availability of large-scale electronic health records (EHR) provides machine learning models with…

Artificial Intelligence · Computer Science 2023-05-05 Jun Wu , Xuesong Ye , Chengjie Mou , Weinan Dai