English
Related papers

Related papers: Exploring General-Purpose Autonomous Multimodal Ag…

200 papers

Study Design: The study outlines the development of an autonomous AI system for chest X-ray (CXR) interpretation, trained on a vast dataset of over 5 million X rays sourced from healthcare systems across India. This AI system integrates…

Cervical spondylosis, a complex and prevalent condition, demands precise and efficient diagnostic techniques for accurate assessment. While MRI offers detailed visualization of cervical spine anatomy, manual interpretation remains…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Qi Zhang , Xiuyuan Chen , Ziyi He , Lianming Wu , Kun Wang , Jianqi Sun , Hongxing Shen

Empathy involves understanding other people's situation, perspective, and feelings. In clinical interactions, it helps clinicians establish rapport with a patient and support patient-centered care and decision making. Understanding…

Audio and Speech Processing · Electrical Eng. & Systems 2020-07-03 Zhuohao Chen , James Gibson , Ming-Chang Chiu , Qiaohong Hu , Tara K Knight , Daniella Meeker , James A Tulsky , Kathryn I Pollak , Shrikanth Narayanan

Artificial intelligence (AI) agents are emerging as transformative tools in drug discovery, with the ability to autonomously reason, act, and learn through complicated research workflows. Building on large language models (LLMs) coupled…

Artificial intelligence (AI) algorithms using deep learning have advanced the classification of skin disease images; however these algorithms have been mostly applied "in silico" and not validated clinically. Most dermatology AI algorithms…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Roxana Daneshjou , Carrie Kovarik , Justin M Ko

Advancing AI in computational pathology requires large, high-quality, and diverse datasets, yet existing public datasets are often limited in organ diversity, class coverage, or annotation quality. To bridge this gap, we introduce SPIDER…

Image and Video Processing · Electrical Eng. & Systems 2025-04-08 Dmitry Nechaev , Alexey Pchelnikov , Ekaterina Ivanova

Digital pathology involves converting physical tissue slides into high-resolution Whole Slide Images (WSIs), which pathologists analyze for disease-affected tissues. However, large histology slides with numerous microscopic fields pose…

Image and Video Processing · Electrical Eng. & Systems 2024-02-19 Mobina Mansoori , Sajjad Shahabodini , Jamshid Abouei , Arash Mohammadi , Konstantinos N. Plataniotis

Dermatological diagnosis requires integrating fine-grained visual perception with expert clinical knowledge. Although Multimodal Large Language Models (MLLMs) facilitate interactive medical image analysis, their application in dermatology…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yize Liu , Siyuan Yan , Ming Hu , Lie Ju , Xieji Li , Feilong Tang , Wei Feng , Zongyuan Ge

Agentic Artificial Intelligence (AI) systems leveraging Large Language Models (LLMs) exhibit significant potential for complex reasoning, planning, and tool utilization. We demonstrate that a specialized computer vision system can be built…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Jin Kim , Muhammad Wahi-Anwa , Sangyun Park , Shawn Shin , John M. Hoffman , Matthew S. Brown

Kinematic monitoring plays a critical role in long-term rehabilitation for patients with spinal cord injury (SCI), where multi-view markerless motion capture methods have shown significant potential. However, owing to the reliance on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Juncheng Yu , Lusi A , Haoxuan Xie , Weiming Wang

State-of-the-art multimodal web agents, powered by Multimodal Large Language Models (MLLMs), can autonomously execute many web tasks by processing user instructions and interacting with graphical user interfaces (GUIs). Current strategies…

Artificial Intelligence · Computer Science 2024-11-21 Gaurav Verma , Rachneet Kaur , Nishan Srishankar , Zhen Zeng , Tucker Balch , Manuela Veloso

Diagnosis based on medical images, such as X-ray images, often involves manual annotation of anatomical keypoints. However, this process involves significant human efforts and can thus be a bottleneck in the diagnostic process. To fully…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jinhee Kim , Taesung Kim , Taewoo Kim , Jaegul Choo , Dong-Wook Kim , Byungduk Ahn , In-Seok Song , Yoon-Ji Kim

Autonomous graphical user interface (GUI) agents aim to facilitate task automation by interacting with the user interface without manual intervention. Recent studies have investigated eliciting the capabilities of large language models…

Computation and Language · Computer Science 2024-06-10 Zhuosheng Zhang , Aston Zhang

Automatic pain intensity estimation plays a pivotal role in healthcare and medical fields. While many methods have been developed to gauge human pain using behavioral or physiological indicators, facial expressions have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Issam Serraoui , Eric Granger , Abdenour Hadid , Abdelmalik Taleb-Ahmed

Automatic pathological speech detection approaches have shown promising results, gaining attention as potential diagnostic tools alongside costly traditional methods. While these approaches can achieve high accuracy, their lack of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-01 Mahdi Amiri , Hatef Otroshi Shahreza , Ina Kodrasi

Study Design: This study presents the development of an autonomous AI system for MRI spine pathology detection, trained on a dataset of 2 million MRI spine scans sourced from diverse healthcare facilities across India. The AI system…

Traditional whole slide image (WSI) analysis methods typically rely on the multiple instance learning (MIL) paradigm, which extracts patch-level features at high magnification and aggregates them for slide-level prediction. However, such…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Jiusong Ge , Yingkang Zhan , Wenjie Zhao , Di Zhang , Ke Wang , Jiashuai Liu , Chunze Yang , Chengzu Li , Jian Zhang , Yuxin Dong , Ni Zhang , Qidong Liu , Mireia Crispin-Ortuzar , Huazhu Fu , Chen Li , Zeyu Gao

For many patients, current ovarian cancer treatments offer limited clinical benefit. For some therapies, it is not possible to predict patients' responses, potentially exposing them to the adverse effects of treatment without any…

Image and Video Processing · Electrical Eng. & Systems 2023-10-20 Jack Breen , Katie Allen , Kieran Zucker , Geoff Hall , Nishant Ravikumar , Nicolas M. Orsi

Deep learning methods are widely used for medical applications to assist medical doctors in their daily routines. While performances reach expert's level, interpretability (highlight how and what a trained model learned and why it makes a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Antoine Pirovano , Hippolyte Heuberger , Sylvain Berlemont , Saïd Ladjal , Isabelle Bloch

Large Language Model (LLM)-based agents have demonstrated strong capabilities across a wide range of tasks, and their application in the medical domain holds particular promise due to the demand for high generalizability and reliance on…

Artificial Intelligence · Computer Science 2025-08-18 Yangyang Zhuang , Wenjia Jiang , Jiayu Zhang , Ze Yang , Joey Tianyi Zhou , Chi Zhang