English
Related papers

Related papers: DermAgent: A Self-Reflective Agentic System for De…

200 papers

Formulating a treatment plan is inherently a complex reasoning and refinement task rather than a simple generation problem. However, existing large language models (LLMs) mainly rely on one-shot output without explicit verification, which…

Artificial Intelligence · Computer Science 2026-05-08 Junkai Li , Yunghwei Lai , Tianyi Zhu , Zheng Long Lee , Weizhi Ma , Yang Liu

Differential Diagnosis (DDx) is a fundamental yet complex aspect of clinical decision-making, in which physicians iteratively refine a ranked list of possible diseases based on symptoms, antecedents, and medical knowledge. While recent…

Computation and Language · Computer Science 2025-06-16 Daniel Rose , Chia-Chien Hung , Marco Lepri , Israa Alqassem , Kiril Gashteovski , Carolin Lawrence

Multimodal Large Language Models (MLLMs) show promise for medical applications, yet progress in dermatology lags due to limited training data, narrow task coverage, and lack of clinically-grounded supervision that mirrors expert diagnostic…

Computation and Language · Computer Science 2026-01-06 Jinghan Ru , Siyuan Yan , Yuguo Yin , Yuexian Zou , Zongyuan Ge

Multi-Modal Large Language Models (MLLMs), despite being successful, exhibit limited generality and often fall short when compared to specialized models. Recently, LLM-based agents have been developed to address these challenges by…

Computation and Language · Computer Science 2024-10-08 Binxu Li , Tiankai Yan , Yuanting Pan , Jie Luo , Ruiyang Ji , Jiayuan Ding , Zhe Xu , Shilong Liu , Haoyu Dong , Zihao Lin , Yixin Wang

Photo retouching is integral to photographic art, extending far beyond simple technical fixes to heighten emotional expression and narrative depth. While artists leverage expertise to create unique visual effects through deliberate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Haoyu Chen , Keda Tao , Yizao Wang , Xinlei Wang , Lei Zhu , Jinjin Gu

Dental image analysis plays a pivotal role in supporting accurate diagnosis and treatment planning in oral healthcare. Although recent advances have produced dental AI models for specific tasks and individual imaging modalities, their…

Relational learning is a challenging problem that has motivated a wide range of approaches, including graph-based models (e.g., graph neural networks, graph transformers), tabular methods (e.g., tabular foundation models), and…

Machine Learning · Computer Science 2026-05-11 Xingyue Huang , Louis Tichelman , Jinwoo Kim , Krzysztof Olejniczak , İsmail İlkan Ceylan

Foundation models are becoming valuable tools in medicine. Yet despite their promise, the best way to leverage Large Language Models (LLMs) in complex medical tasks remains an open question. We introduce a novel multi-agent framework, named…

Computation and Language · Computer Science 2024-10-31 Yubin Kim , Chanwoo Park , Hyewon Jeong , Yik Siu Chan , Xuhai Xu , Daniel McDuff , Hyeonhoon Lee , Marzyeh Ghassemi , Cynthia Breazeal , Hae Won Park

Analyzing whole-slide images (WSIs) requires an iterative, evidence-driven reasoning process that parallels how pathologists dynamically zoom, refocus, and self-correct while collecting the evidence. However, existing computational…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jingyun Chen , Linghan Cai , Zhikang Wang , Yi Huang , Songhan Jiang , Shenjin Huang , Hongpeng Wang , Yongbing Zhang

Multimodal large language models (MLLMs) that integrate visual and textual reasoning leverage chain-of-thought (CoT) prompting to tackle complex visual tasks, yet continue to exhibit visual hallucinations and an over-reliance on textual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Jing Bi , Guangyu Sun , Ali Vosoughi , Chen Chen , Chenliang Xu

Recent advancements have highlighted that Large Language Models (LLMs) are prone to hallucinations when solving complex reasoning problems, leading to erroneous results. To tackle this issue, researchers incorporate Knowledge Graphs (KGs)…

Artificial Intelligence · Computer Science 2025-02-19 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng , Wotao Yin

LLM-based multimodal emotion recognition relies on static parametric memory and often hallucinates when interpreting nuanced affective states. In this paper, given that single-round retrieval-augmented generation is highly susceptible to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Zeheng Wang , Zitong Yu , Yijie Zhu , Bo Zhao , Haochen Liang , Taorui Wang , Wei Xia , Jiayu Zhang , Zhishu Liu , Hui Ma , Fei Ma , Qi Tian

Visual Language Models (VLMs) achieve promising results in medical reasoning but struggle with hallucinations, vague descriptions, inconsistent logic and poor localization. To address this, we propose a agent framework named Medical Visual…

Artificial Intelligence · Computer Science 2025-10-22 Guangfu Guo , Xiaoqian Lu , Yue Feng

The rise of Artificial Intelligence creates great promise in the field of medical discovery, diagnostics and patient management. However, the vast complexity of all medical domains require a more complex approach that combines machine…

Computation and Language · Computer Science 2025-03-28 Dimitrios P. Panagoulias , Evridiki Tsoureli-Nikita , Maria Virvou , George A. Tsihrintzis

With the continuous advancement of vision language models (VLMs) technology, remarkable research achievements have emerged in the dermatology field, the fourth most prevalent human disease category. However, despite these advancements, VLM…

Multimedia · Computer Science 2025-02-14 Bo Lin , Yingjing Xu , Xuanwen Bao , Zhou Zhao , Zhouyang Wang , Jianwei Yin

Embodied agents for creative tasks like photography must bridge the semantic gap between high-level language commands and geometric control. We introduce PhotoAgent, an agent that achieves this by integrating Large Multimodal Models (LMMs)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Lirong Che , Zhenfeng Gan , Yanbo Chen , Junbo Tan , Xueqian Wang

3D CT analysis spans a continuum from low-level perception to high-level clinical understanding. Existing 3D-oriented analysis methods adopt either isolated task-specific modeling or task-agnostic end-to-end paradigms to produce one-hop…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Ziyue Wang , Linghan Cai , Chang Han Low , Haofeng Liu , Junde Wu , Jingyu Wang , Rui Wang , Lei Song , Jiang Bian , Jingjing Fu , Yueming Jin

Hallucination detection is a challenging task for large language models (LLMs), and existing studies heavily rely on powerful closed-source LLMs such as GPT-4. In this paper, we propose an autonomous LLM-based agent framework, called…

Computation and Language · Computer Science 2024-06-18 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Hongzhi Zhang , Fuzheng Zhang , Di Zhang , Kun Gai , Ji-Rong Wen

Document Question Answering (DocQA) is a very common task. Existing methods using Large Language Models (LLMs) or Large Vision Language Models (LVLMs) and Retrieval Augmented Generation (RAG) often prioritize information from a single…

Machine Learning · Computer Science 2025-03-19 Siwei Han , Peng Xia , Ruiyi Zhang , Tong Sun , Yun Li , Hongtu Zhu , Huaxiu Yao

Chemical reasoning usually involves complex, multi-step processes that demand precise calculations, where even minor errors can lead to cascading failures. Furthermore, large language models (LLMs) encounter difficulties handling…

Computation and Language · Computer Science 2025-01-14 Xiangru Tang , Tianyu Hu , Muyang Ye , Yanjun Shao , Xunjian Yin , Siru Ouyang , Wangchunshu Zhou , Pan Lu , Zhuosheng Zhang , Yilun Zhao , Arman Cohan , Mark Gerstein