English
Related papers

Related papers: AURA: A Multi-Modal Medical Agent for Understandin…

200 papers

The emergence of large language models and their applications as AI agents have significantly advanced state-of-the-art code generation benchmarks, transforming modern software engineering tasks. However, even with test-time computed…

Artificial Intelligence · Computer Science 2025-03-25 Hao-Yuan Chen , Cheng-Pong Huang , Jui-Ming Yao

Thematic analysis (TA) is a widely used qualitative approach for uncovering latent meanings in unstructured text data. TA provides valuable insights in healthcare but is resource-intensive. Large Language Models (LLMs) have been introduced…

Human-Computer Interaction · Computer Science 2025-03-27 Huimin Xu , Seungjun Yi , Terence Lim , Jiawei Xu , Andrew Well , Carlos Mery , Aidong Zhang , Yuji Zhang , Heng Ji , Keshav Pingali , Yan Leng , Ying Ding

The recent boom of large language models (LLMs) has re-ignited the hope that artificial intelligence (AI) systems could aid medical diagnosis. Yet despite dazzling benchmark scores, LLM assistants have yet to deliver measurable improvements…

Artificial Intelligence · Computer Science 2025-07-03 Matthew JY Kang , Wenli Yang , Monica R Roberts , Byeong Ho Kang , Charles B Malpas

The advent of Large Language Models (LLMs) is transforming search engines into conversational AI search products, primarily using Retrieval-Augmented Generation (RAG) on web corpora. However, this paradigm has significant industrial…

Computation and Language · Computer Science 2026-03-13 Zhejun Zhao , Yuchen Li , Alley Liu , Yuehu Dong , Xiaolong Wei , Lixue Zheng , Pingsheng Liu , Dongdong Shen , Long Xia , Jiashu Zhao , Dawei Yin

Foundation models, including large language models (LLMs) and vision-language models (VLMs), have recently enabled novel approaches to robot autonomy and human-robot interfaces. In parallel, vision-language-action models (VLAs) or large…

In modern medicine, clinical diagnosis relies on the comprehensive analysis of primarily textual and visual data, drawing on medical expertise to ensure systematic and rigorous reasoning. Recent advances in large Vision-Language Models…

Artificial Intelligence · Computer Science 2025-07-03 Ziyue Wang , Junde Wu , Linghan Cai , Chang Han Low , Xihong Yang , Qiaxuan Li , Yueming Jin

Large Language Models (LLMs) show promise in medicine but are prone to factual and logical errors, which is unacceptable in this high-stakes field. To address this, we introduce the "Haibu Mathematical-Medical Intelligent Agent" (MMIA), an…

Artificial Intelligence · Computer Science 2025-10-10 Yilun Zhang , Dexing Kong

Building robust vision systems for high-stakes domains such as remote sensing requires stronger visual reasoning than what single-pass inference typically provides; yet, retraining large models is often computationally expensive and data…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Chung-En Johnny Yu , Brian Jalaian , Nathaniel D. Bastian

The development of intelligent agents, particularly those powered by language models (LMs), has shown a critical role in various environments that require intelligent and autonomous decision-making. Environments are not passive testing…

Artificial Intelligence · Computer Science 2025-10-21 Antonin Sulc , Thorsten Hellert

We present Experiment Automation Agents (EAA), a vision-language-model-driven agentic system designed to automate complex experimental microscopy workflows. EAA integrates multimodal reasoning, tool-augmented action, and optional long-term…

Artificial Intelligence · Computer Science 2026-02-18 Ming Du , Yanqi Luo , Srutarshi Banerjee , Michael Wojcik , Jelena Popovic , Mathew J. Cherukara

Effective attribution of Advanced Persistent Threats (APTs) increasingly hinges on the ability to correlate behavioral patterns and reason over complex, varied threat intelligence artifacts. We present AURA (Attribution Using…

Cryptography and Security · Computer Science 2025-06-13 Nanda Rani , Sandeep Kumar Shukla

We introduce Orion, a visual agent that integrates vision-based reasoning with tool-augmented execution to achieve powerful, precise, multi-step visual intelligence across images, video, and documents. Unlike traditional vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 N Dinesh Reddy , Dylan Snyder , Lona Kiragu , Mirajul Mohin , Shahrear Bin Amin , Sudeep Pillai

Medical Visual Language Models have shown great potential in various healthcare applications, including medical image captioning and diagnostic assistance. However, most existing models rely on text-based instructions, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Tan-Hanh Pham , Chris Ngo , Trong-Duong Bui , Minh Luu Quang , Tan-Huong Pham , Truong-Son Hy

Multimodal Large Language Model (MLLM) has recently garnered attention as a prominent research focus. By harnessing powerful LLM, it facilitates a transition of conversational generative AI from unimodal text to performing multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xuechen Guo , Wenhao Chai , Shi-Yan Li , Gaoang Wang

Academic advising in higher education is under severe strain, with advisor-to-student ratios commonly exceeding 300:1. These structural bottlenecks limit timely access to guidance, increase the risk of delayed graduation, and contribute to…

Artificial intelligence has shown promise in medical imaging, yet most existing systems lack flexibility, interpretability, and adaptability - challenges especially pronounced in ophthalmology, where diverse imaging modalities are…

Large Language Models (LLMs) are transforming healthcare through the development of LLM-based agents that can understand, reason about, and assist with medical tasks. This survey provides a comprehensive review of LLM-based agents in…

Computation and Language · Computer Science 2025-05-27 Wenxuan Wang , Zizhan Ma , Zheng Wang , Chenghan Wu , Jiaming Ji , Wenting Chen , Xiang Li , Yixuan Yuan

This paper explores the integration of two AI subdisciplines employed in the development of artificial agents that exhibit intelligent behavior: Large Language Models (LLMs) and Cognitive Architectures (CAs). We present three integration…

Artificial Intelligence · Computer Science 2023-09-29 Oscar J. Romero , John Zimmerman , Aaron Steinfeld , Anthony Tomasic

The evolution of agentic systems represents a significant milestone in artificial intelligence and modern software systems, driven by the demand for vertical intelligence tailored to diverse industries. These systems enhance business…

Multiagent Systems · Computer Science 2025-01-03 Fouad Bousetouane

The massive successes of large language models (LLMs) encourage the emerging exploration of LLM-augmented Autonomous Agents (LAAs). An LAA is able to generate actions with its core LLM and interact with environments, which facilitates the…