English
Related papers

Related papers: DermAgent: A Self-Reflective Agentic System for De…

200 papers

Multimodal clinical reasoning in the field of gastrointestinal (GI) oncology necessitates the integrated interpretation of endoscopic imagery, radiological data, and biochemical markers. Despite the evident potential exhibited by Multimodal…

Dermatological care via telemedicine often lacks the rich context of in-person visits. Clinicians must make diagnoses based on a handful of images and brief descriptions, without the benefit of physical exams, second opinions, or reference…

Artificial Intelligence · Computer Science 2025-08-27 Karishma Thakrar , Shreyas Basavatia , Akshay Daftardar

In modern medicine, clinical diagnosis relies on the comprehensive analysis of primarily textual and visual data, drawing on medical expertise to ensure systematic and rigorous reasoning. Recent advances in large Vision-Language Models…

Artificial Intelligence · Computer Science 2025-07-03 Ziyue Wang , Junde Wu , Linghan Cai , Chang Han Low , Xihong Yang , Qiaxuan Li , Yueming Jin

Language-guided segmentation transcends the scope limitations of traditional semantic segmentation, enabling models to segment arbitrary target regions based on natural language instructions. Existing approaches typically adopt a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Chao Hao , Jun Xu , Ji Du , Shuo Ye , Ziyue Qiao , Xiaodong Cun , Guangcong Wang , Xubin Zheng , Zitong Yu

Precision therapeutics require multimodal adaptive models that generate personalized treatment recommendations. We introduce TxAgent, an AI agent that leverages multi-step reasoning and real-time biomedical knowledge retrieval across a…

Artificial Intelligence · Computer Science 2025-03-17 Shanghua Gao , Richard Zhu , Zhenglun Kong , Ayush Noori , Xiaorui Su , Curtis Ginder , Theodoros Tsiligkaridis , Marinka Zitnik

Recent multimodal LLMs have shown promise in chart-based visual question answering, but their performance declines sharply on unannotated charts-those requiring precise visual interpretation rather than relying on textual shortcuts. To…

Artificial Intelligence · Computer Science 2026-01-08 Rachneet Kaur , Nishan Srishankar , Zhen Zeng , Sumitra Ganesh , Manuela Veloso

Large Vision-Language Models (LVLMs) have demonstrated strong reasoning capabilities in geo-localization, yet they often struggle in real-world scenarios where visual cues are sparse, long-tailed, and highly ambiguous. Previous approaches,…

Artificial Intelligence · Computer Science 2026-03-03 Furong Jia , Ling Dai , Wenjin Deng , Fan Zhang , Chen Hu , Daxin Jiang , Yu Liu

Diagnosing lung cancer typically involves physicians identifying lung nodules in Computed tomography (CT) scans and generating diagnostic reports based on their morphological features and medical expertise. Although advancements have been…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Cheng Yang , Hui Jin , Xinlei Yu , Zhipeng Wang , Yaoqun Liu , Fenglei Fan , Dajiang Lei , Gangyong Jia , Changmiao Wang , Ruiquan Ge

Medical Decision-Making (MDM) is a multi-faceted process that requires clinicians to assess complex multi-modal patient data patient, often collaboratively. Large Language Models (LLMs) promise to streamline this process by synthesizing…

Recent progress in Large Language Models (LLMs) has drawn attention to their potential for accelerating drug discovery. However, a central problem remains: translating theoretical ideas into robust implementations in the highly specialized…

Machine Learning · Computer Science 2025-03-06 Sizhe Liu , Yizhou Lu , Siyu Chen , Xiyang Hu , Jieyu Zhao , Yingzhou Lu , Yue Zhao

Medical Large Vision-Language Models (Med-LVLMs) have been widely adopted for medical report generation. Despite Med-LVLMs producing state-of-the-art performance, they exhibit a bias toward predicting all findings as normal, leading to…

Multiagent Systems · Computer Science 2025-05-27 Pengyu Wang , Shuchang Ye , Usman Naseem , Jinman Kim

Precise surgical interventions are vital to patient safety, and advanced enhancement algorithms have been developed to assist surgeons in decision-making. Despite significant progress, these algorithms are typically designed for single…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zeyu Lei , Hongyuan Yu , Jinlin Wu , Zhen Chen

Large Language Models (LLMs) have shown promising potential in the medical domain, assisting with tasks like clinical note generation and patient communication. However, current LLMs are limited to text-based communication, hindering their…

Computation and Language · Computer Science 2025-06-17 Yusheng Liao , Shuyang Jiang , Yanfeng Wang , Yu Wang

Skin diseases are among the most prevalent health issues, and accurate computer-aided diagnosis methods are of importance for both dermatologists and patients. However, most of the existing methods overlook the essential domain knowledge…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Yan-Jie Zhou , Wei Liu , Yuan Gao , Jing Xu , Le Lu , Yuping Duan , Hao Cheng , Na Jin , Xiaoyong Man , Shuang Zhao , Yu Wang

Despite recent advances in multimodal large language models (MLLMs), their ability to understand and interact with music remains limited. Music understanding requires grounded reasoning over symbolic scores and expressive performance audio,…

Multimedia · Computer Science 2026-01-21 Qihao Zhao , Yunqi Cao , Yangyu Huang , Hui Yi Leong , Fan Zhang , Kim-Hui Yap , Wei Hu

Recommender models excel at providing domain-specific item recommendations by leveraging extensive user behavior data. Despite their ability to act as lightweight domain experts, they struggle to perform versatile tasks such as providing…

Information Retrieval · Computer Science 2024-01-31 Xu Huang , Jianxun Lian , Yuxuan Lei , Jing Yao , Defu Lian , Xing Xie

Vocal health plays a crucial role in peoples' lives, significantly impacting their communicative abilities and interactions. However, despite the global prevalence of voice disorders, many lack access to convenient diagnosis and treatment.…

Recent advances in computational pathology have led to the emergence of numerous foundation models. These models typically rely on general-purpose encoders with multi-instance learning for whole slide image (WSI) classification or apply…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Yuxuan Sun , Yixuan Si , Chenglu Zhu , Kai Zhang , Zhongyi Shui , Bowen Ding , Tao Lin , Lin Yang

Emerging 6G networks rely on complex cross-layer optimization, yet manually translating high-level intents into mathematical formulations remains a bottleneck. While Large Language Models (LLMs) offer promise, monolithic approaches often…

Artificial Intelligence · Computer Science 2026-01-28 Haoyun Li , Ming Xiao , Kezhi Wang , Robert Schober , Dong In Kim , Yong Liang Guan

High-quality code documentation is crucial for software development especially in the era of AI. However, generating it automatically using Large Language Models (LLMs) remains challenging, as existing approaches often produce incomplete,…

Software Engineering · Computer Science 2025-05-27 Dayu Yang , Antoine Simoulin , Xin Qian , Xiaoyi Liu , Yuwei Cao , Zhaopu Teng , Grey Yang