English
Related papers

Related papers: FT-ARM: Fine-Tuned Agentic Reflection Multimodal L…

200 papers

Background: This study proposes a Vision-Language Model (VLM) leveraging the SIGLIP encoder and Gemma-3b transformer decoder to enhance automated chronic tuberculosis (TB) screening. By integrating chest X-ray images with clinical data, the…

Medical vision-language models (Med-VLMs) have shown impressive results in tasks such as report generation and visual question answering, but they still face several limitations. Most notably, they underutilize patient metadata and lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Fangqi Cheng , Surajit Ray , Xiaochen Yang

Chronic pain is a pervasive disorder which is often very disabling and is associated with comorbidities such as depression and anxiety. Neuropathic Pain (NP) is a common sub-type which is often caused due to nerve damage and has a known…

The performance of diagnostic Computer-Aided Design (CAD) systems for retinal diseases depends on the quality of the retinal images being screened. Thus, many studies have been developed to evaluate and assess the quality of such retinal…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Saif Khalid , Hatem A. Rashwan , Saddam Abdulwahab , Mohamed Abdel-Nasser , Facundo Manuel Quiroga , Domenec Puig

Large Language Models (LLMs) have demonstrated impressive capabilities, yet their deployment in high-stakes domains is hindered by inherent limitations in trustworthiness, including hallucinations, instability, and a lack of transparency.…

Computation and Language · Computer Science 2025-10-21 David Peer , Sebastian Stabinger

Early identification of high-risk ICU patients is crucial for directing limited medical resources. We introduce ALFIA (Adaptive Layer Fusion with Intelligent Attention), a modular, attention-based architecture that jointly trains LoRA…

Multimodal emotion analysis is shifting from static classification to generative reasoning. Beyond simple label prediction, robust affective reasoning must synthesize fine-grained signals such as facial micro-expressions and prosodic which…

Multimedia · Computer Science 2026-02-05 Zhixian Zhao , Wenjie Tian , Lei Xie

Depression poses significant challenges to patients and healthcare organizations, necessitating efficient assessment methods. Existing paradigms typically focus on a patient-doctor way that overlooks multi-role interactions, such as family…

Human-Computer Interaction · Computer Science 2026-03-10 Zhiyuan Zhou , Jilong Liu , Sanwang Wang , Shijie Hao , Yanrong Guo , Richang Hong

We are concerned with the challenge of reliably classifying and assessing intracranial aneurysms using deep learning without compromising clinical transparency. While traditional black-box models achieve high predictive accuracy, their lack…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Toqa Khaled , Ahmad Al-Kabbany

Conversational emotion recognition (CER) is an important research topic in human-computer interactions. {Although recent advancements in transformer-based cross-modal fusion methods have shown promise in CER tasks, they tend to overlook the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yuntao Shou , Huan Liu , Xiangyong Cao , Deyu Meng , Bo Dong

Medical image analysis increasingly relies on large vision-language models (VLMs), yet most systems remain single-pass black boxes that offer limited control over reasoning, safety, and spatial grounding. We propose R^4, an agentic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Md. Faiyaz Abdullah Sayeedi , Rashedur Rahman , Siam Tahsin Bhuiyan , Sefatul Wasi , Ashraful Islam , Saadia Binte Alam , AKM Mahbubur Rahman

Objective: To develop an explainable multimodal large language model (MM-LLM) that (1) screens optic nerve head (ONH) OCT circle scans for quality and (2) generates structured clinical reports that include glaucoma diagnosis and sector-wise…

Melanoma is a malignant tumor that originates from skin cell lesions. Accurate and efficient segmentation of skin lesions is essential for quantitative analysis but remains a challenge due to blurred lesion boundaries, gradual color…

Image and Video Processing · Electrical Eng. & Systems 2025-07-03 Saqib Qamar , Syed Furqan Qadri , Roobaea Alroobaea , Goram Mufarah M Alshmrani , Richard Jiang

The main challenges hindering the adoption of deep learning-based systems in clinical settings are the scarcity of annotated data and the lack of interpretability and trust in these systems. Concept Bottleneck Models (CBMs) offer inherent…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Cristiano Patrício , Luís F. Teixeira , João C. Neves

Large Audio Language Models (LALMs) have expanded the interaction with human to speech modality, which introduces great interactive potential, due to the paralinguistic cues implicitly indicating the user context. However, building on the…

Sound · Computer Science 2026-03-13 Hao Yang , Minghan Wang , Tongtong Wu , Lizhen Qu , Ehsan Shareghi , Gholamreza Haffari

Uterine leiomyosarcoma (LMS) is a rare but aggressive malignancy. On imaging, it is difficult to differentiate LMS from, for example, degenerated leiomyoma (LM), a prevalent but benign condition. We curated a data set of 115 axial…

While Vision-Language Models (VLMs) have achieved notable progress in computational pathology (CPath), the gigapixel scale and spatial heterogeneity of Whole Slide Images (WSIs) continue to pose challenges for multimodal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Fengchun Liu , Songhan Jiang , Linghan Cai , Ziyue Wang , Yongbing Zhang

Depression remains widely underdiagnosed and undertreated because stigma and subjective symptom ratings hinder reliable screening. To address this challenge, we propose a coarse-to-fine, multi-stage framework that leverages large language…

Artificial Intelligence · Computer Science 2026-04-14 Shiyu Teng , Jiaqing Liu , Hao Sun , Yu Li , Shurong Chai , Ruibo Hou , Tomoko Tateyama , Lanfen Lin , Yen-Wei Chen

Skin cancer is a common and fast rising malignancy worldwide. Early detection is critical for improving outcomes. Deep learning models trained on dermoscopic and clinical images can support automated and fast triage. However, many studies…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Durjoy Dey , Yuhong Yan , Hassan Hajjdiab

Large language models (LLMs) have shown promise in medical domains, but their ability to handle specialized neurological reasoning requires systematic evaluation. We developed a comprehensive benchmark using 305 questions from Israeli Board…

Information Retrieval · Computer Science 2025-08-21 Moran Sorka , Alon Gorenshtein , Dvir Aran , Shahar Shelly