English
Related papers

Related papers: Exploring General-Purpose Autonomous Multimodal Ag…

200 papers

Whole slide images are the foundation of digital pathology for the diagnosis and treatment of carcinomas. Writing pathology reports is laborious and error-prone for inexperienced pathologists. To reduce the workload and improve clinical…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Pingyi Chen , Honglin Li , Chenglu Zhu , Sunyi Zheng , Zhongyi Shui , Lin Yang

Despite rapid progress in autonomous web agents, human involvement remains essential for shaping preferences and correcting agent behavior as tasks unfold. However, current agentic systems lack a principled understanding of when and why…

Computation and Language · Computer Science 2026-03-02 Faria Huq , Zora Zhiruo Wang , Zhanqiu Guo , Venu Arvind Arangarajan , Tianyue Ou , Frank Xu , Shuyan Zhou , Graham Neubig , Jeffrey P. Bigham

For doctors to truly trust artificial intelligence, it can't be a black box. They need to understand its reasoning, almost as if they were consulting a colleague. We created HistoLens1 to be that transparent, collaborative partner. It…

Artificial Intelligence · Computer Science 2025-10-29 Sandeep Vissapragada , Vikrant Sahu , Gagan Raj Gupta , Vandita Singh

Agentic systems are becoming more capable: agents define strategies, take actions, and interact with different environments. This autonomy poses serious challenges for overseeing and assessing agent behavior. Most current tools are limited,…

Computation and Language · Computer Science 2026-05-22 Asaf Yehudai , Lilach Eden , Michal Shmueli-Scheuer

Artificial Intelligence (AI) can potentially support histopathologists in the diagnosis of a broad spectrum of cancer types. In colorectal cancer (CRC), AI can alleviate the laborious task of characterization and reporting on resected…

Image and Video Processing · Electrical Eng. & Systems 2023-02-10 John-Melle Bokhorst , Iris D. Nagtegaal , Filippo Fraggetta , Simona Vatrano , Wilma Mesker , Michael Vieth , Jeroen van der Laak , Francesco Ciompi

The rapid emergence of highly adaptable and reusable artificial intelligence (AI) models is set to revolutionize the medical field, particularly in the diagnosis and management of Parkinson's disease (PD). Currently, there are no effective…

Machine Learning · Computer Science 2025-02-18 Aite Zhao , Yongcan Liu , Xinglin Yu , Xinyue Xing

Pathologists diagnose cancer using gigapixel whole-slide images (WSIs), but the current digital workflow is fragmented. These multiscale datasets often exceed 100,000 x 100,000 pixels, yet standard 2D monitors restrict the field of view.…

Human-Computer Interaction · Computer Science 2026-02-27 Jai Prakash Veerla , Partha Sai Guttikonda , Helen H. Shang , Mohammad Sadegh Nasr , Cesar Torres , Jacob M. Luber

Whole slide imaging (WSI) is an emerging technology for digital pathology. The process of autofocusing is the main influence of the performance of WSI. Traditional autofocusing methods either are time-consuming due to repetitive mechanical…

Image and Video Processing · Electrical Eng. & Systems 2020-03-17 Qiang Li , Xianming Liu , Kaige Han , Cheng Guo , Xiangyang Ji , Xiaolin Wu

Surgeons exhibit distinct operating styles shaped by training, experience, and motor behavior-yet most surgical AI systems overlook this personalization signal. We propose a novel agentic modeling approach for surgeon-specific behavior…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Huixin Zhan , Jason H. Moore

From the simple measurement of tissue attributes in pathology workflow to designing an explainable diagnostic/prognostic AI tool, access to accurate semantic segmentation of tissue regions in histology images is a prerequisite. However,…

Image and Video Processing · Electrical Eng. & Systems 2021-08-31 Mostafa Jahanifar , Neda Zamani Tajeddin , Navid Alemi Koohbanani , Nasir Rajpoot

With the development of digital imaging in medical microscopy, artificial intelligent-based analysis of pathological whole slide images (WSIs) provides a powerful tool for cancer diagnosis. Limited by the expensive cost of pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Jiawen Li , Qiehe Sun , Renao Yan , Yizhi Wang , Yuqiu Fu , Yani Wei , Tian Guan , Huijuan Shi , Yonghonghe He , Anjia Han

As advances in large language models (LLMs) and multimodal techniques continue to mature, the development of general-purpose multimodal large language models (MLLMs) has surged, offering significant applications in interpreting natural…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Yuxuan Sun , Chenglu Zhu , Sunyi Zheng , Kai Zhang , Lin Sun , Zhongyi Shui , Yunlong Zhang , Honglin Li , Lin Yang

To develop intelligent speech assistants and integrate them seamlessly with intra-operative decision-support frameworks, accurate and efficient surgical phase recognition is a prerequisite. In this study, we propose a multimodal framework…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-24 Kubilay Can Demir , Belen Lojo Rodriguez , Tobias Weise , Andreas Maier , Seung Hee Yang

Edge-based multimodal medical monitoring requires models that balance diagnostic accuracy with severe energy constraints. Continuous acquisition of ECG, PPG, EMG, and IMU streams rapidly drains wearable batteries, often limiting operation…

Emerging Technologies · Computer Science 2026-04-14 Chengwei Zhou , Zhaoyan Jia , Haotian Yu , Xuming Chen , Brandon Lee , Christopher Pulliam , Steve Majerus , Massoud Pedram , Gourav Datta

Large language models (LLMs) have demonstrated notable potential in medical applications, yet they face substantial challenges in handling complex real-world clinical diagnoses using conventional prompting methods. Current prompt…

Artificial Intelligence · Computer Science 2026-03-02 Wenliang Li , Rui Yan , Xu Zhang , Li Chen , Hongji Zhu , Jing Zhao , Junjun Li , Mengru Li , Wei Cao , Zihang Jiang , Wei Wei , Kun Zhang , Shaohua Kevin Zhou

Histopathology whole slide images (WSIs) are being widely used to develop deep learning-based diagnostic solutions, especially for precision oncology. Most of these diagnostic softwares are vulnerable to biases and impurities in the…

Image and Video Processing · Electrical Eng. & Systems 2024-10-01 Abhijeet Patil , Harsh Diwakar , Jay Sawant , Nikhil Cherian Kurian , Subhash Yadav , Swapnil Rane , Tripti Bameta , Amit Sethi

Autonomous agents capable of navigating Graphical User Interfaces (GUIs) hold the potential to revolutionize digital productivity. However, achieving true digital autonomy extends beyond reactive element matching; it necessitates a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Hongxin Li , Xiping Wang , Jingran Su , Zheng Ju , Yuntao Chen , Qing Li , Zhaoxiang Zhang

Automated whole slide image (WSI) tagging has become a growing demand due to the increasing volume and diversity of WSIs collected nowadays in histopathology. Various methods have been studied to classify WSIs with single tags but none of…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Weijian Li , Viet-Duy Nguyen , Haofu Liao , Matt Wilder , Ke Cheng , Jiebo Luo

Accessing high-quality, open-access dermatopathology image datasets for learning and cross-referencing is a common challenge for clinicians and dermatopathology trainees. To establish a comprehensive open-access dermatopathology dataset for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Ziyang Xu , Mingquan Lin , Yiliang Zhou , Zihan Xu , Seth J. Orlow , Shane A. Meehan , Alexandra Flamm , Ata S. Moshiri , Yifan Peng

Neural networks promise to bring robust, quantitative analysis to medical fields, but adoption is limited by the technicalities of training these networks. To address this translation gap between medical researchers and neural networks in…

Image and Video Processing · Electrical Eng. & Systems 2019-02-20 Brendon Lutnick , Brandon Ginley , Darshana Govind , Sean D. McGarry , Peter S. LaViolette , Rabi Yacoub , Sanjay Jain , John E. Tomaszewski , Kuang-Yu Jen , Pinaki Sarder