English
Related papers

Related papers: Exploring General-Purpose Autonomous Multimodal Ag…

200 papers

We envision the Full-Body AI Agent as a comprehensive AI system designed to simulate, analyze, and optimize the dynamic processes of the human body across multiple biological levels. By integrating computational models, machine learning…

Tissues and Organs · Quantitative Biology 2025-08-28 Aoqi Wang , Jiajia Liu , Jianguo Wen , Yangyang Luo , Zhiwei Fan , Liren Yang , Xi Hu , Ruihan Luo , Yankai Yu , Sophia Li , Weiling Zhao , Xiaobo Zhou

Dermatological care via telemedicine often lacks the rich context of in-person visits. Clinicians must make diagnoses based on a handful of images and brief descriptions, without the benefit of physical exams, second opinions, or reference…

Artificial Intelligence · Computer Science 2025-08-27 Karishma Thakrar , Shreyas Basavatia , Akshay Daftardar

Pathology has played a crucial role in the diagnosis and evaluation of patient tissue samples obtained from surgeries and biopsies for many years. The advent of Whole Slide Scanners and the development of deep learning technologies have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Mieko Ochi , Daisuke Komura , Shumpei Ishikawa

Tissue phenotyping is a fundamental computational pathology (CPath) task in learning objective characterizations of histopathologic biomarkers in anatomic pathology. However, whole-slide imaging (WSI) poses a complex computer vision problem…

Although Vision Language Models (VLMs) have shown strong generalization in medical imaging, pathology presents unique challenges due to ultra-high resolution, complex tissue structures, and nuanced clinical semantics. These factors make…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Wenchuan Zhang , Jingru Guo , Hengzhe Zhang , Penghao Zhang , Jie Chen , Shuwan Zhang , Zhang Zhang , Yuhao Yi , Hong Bu

Tissue detection is a crucial first step in most digital pathology applications. Details of the segmentation algorithm are rarely reported, and there is a lack of studies investigating the downstream effects of a poor segmentation…

Artificial intelligence (AI)-enabled diagnostics in maxillofacial pathology require structured, high-quality multimodal datasets. However, existing resources provide limited ameloblastoma coverage and lack the format consistency needed for…

Artificial Intelligence · Computer Science 2026-02-06 Ajo Babu George , Anna Mariam John , Athul Anoop , Balu Bhasuran

Multimodal neuroimaging analysis often involves complex, modality-specific preprocessing workflows that require careful configuration, quality control, and coordination across heterogeneous toolchains. Beyond preprocessing, downstream…

Artificial Intelligence · Computer Science 2026-05-08 Lujia Zhong , Yihao Xia , Jianwei Zhang , Shuo huang , Jiaxin Yue , Mingyang Xia , Yonggang Shi

Quantifying the distribution and morphology of tau protein structures in brain tissues is key to diagnosing Alzheimer's Disease (AD) and its subtypes. Recently, deep learning (DL) models such as UNet have been successfully used for…

Image and Video Processing · Electrical Eng. & Systems 2023-02-20 Gabriel Jimenez , Anuradha Kar , Mehdi Ounissi , Léa Ingrassia , Susana Boluda , Benoît Delatour , Lev Stimmer , Daniel Racoceanu

Recent advancements in Large Language Models (LLMs) have catalyzed a paradigm shift from static prediction systems to agentic AI agents capable of reasoning, interacting with tools, and adapting to complex tasks. While LLM-based agentic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Nima Fathi , Amar Kumar , Tal Arbel

Automated pathology report generation from Whole Slide Images (WSIs) faces two key challenges: (1) lack of semantic content in visual features and (2) inherent information redundancy in WSIs. To address these issues, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Ling Zhang , Boxiang Yun , Qingli Li , Yan Wang

Real-world multimodal agents solve multi-step workflows grounded in visual evidence. For example, an agent can troubleshoot a device by linking a wiring photo to a schematic and validating the fix with online documentation, or plan a trip…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhaochen Su , Jincheng Gao , Hangyu Guo , Zhenhua Liu , Lueyang Zhang , Xinyu Geng , Shijue Huang , Peng Xia , Guanyu Jiang , Cheng Wang , Yue Zhang , Yi R. Fung , Junxian He

Early identification of stroke symptoms is essential for enabling timely intervention and improving patient outcomes, particularly in prehospital settings. This study presents a fast, non-invasive multimodal deep learning framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Ngoc-Khai Hoang , Thi-Nhu-Mai Nguyen , Huy-Hieu Pham

The development of computational pathology lies in the consensus that pathological characteristics of tumors are significant guidance for cancer diagnostics. Most existing research focuses on the inner-contextual information within each WSI…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jun Shi , Tong Shu , Zhiguo Jiang , Wei Wang , Haibo Wu , Yushan Zheng

Deep learning for histopathology has been successfully used for disease classification, image segmentation and more. However, combining image and text modalities using current state-of-the-art (SOTA) methods has been a challenge due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Saurav Sengupta , Donald E. Brown

While artificial intelligence (AI) holds promise for supporting healthcare providers and improving the accuracy of medical diagnoses, a lack of transparency in the composition of datasets exposes AI models to the possibility of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Matthew Groh , Caleb Harris , Roxana Daneshjou , Omar Badri , Arash Koochek

Poor performance of quantitative analysis in histopathological Whole Slide Images (WSI) has been a significant obstacle in clinical practice. Annotating large-scale WSIs manually is a demanding and time-consuming task, unlikely to yield the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Sarah Cechnicka , James Ball , Hadrien Reynaud , Callum Arthurs , Candice Roufosse , Bernhard Kainz

A multimodal AI agent is characterized by its ability to process and learn from various types of data, including natural language, visual, and audio inputs, to inform its actions. Despite advancements in large language models that…

Computation and Language · Computer Science 2024-04-19 Wei Chen , Zhiyuan Li

Remarkable strides in computational pathology have been made in the task-agnostic foundation model that advances the performance of a wide array of downstream clinical tasks. Despite the promising performance, there are still several…

Accurate analysis of histopathological images is critical for disease diagnosis and treatment planning. Whole-slide images (WSIs), which digitize tissue specimens at gigapixel resolution, are fundamental to this process but require…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Enhui Chai , Sicheng Chen , Tianyi Zhang , Chad Wong , Kecheng Huang , Zeyu Liu , Fei Xia