English
Related papers

Related papers: Foundation Models -- A Panacea for Artificial Inte…

200 papers

The rapidly evolving field of digital oncopathology faces significant challenges, including the need to address diverse and complex clinical questions, often involving rare conditions, with limited availability of labeled data. These…

Image and Video Processing · Electrical Eng. & Systems 2024-09-05 Jonathan Zalach , Inbal Gazy , Assaf Avinoam , Ron Sinai , Eran Shmuel , Inbar Gilboa , Christine Swisher , Naim Matasci , Reva Basho , David B. Agus

Despite their successes in vision and language, foundation models have stumbled in pathology, revealing low accuracy, instability, and heavy computational demands. These shortcomings stem not from tuning problems but from deeper conceptual…

Artificial Intelligence · Computer Science 2026-04-21 Hamid R. Tizhoosh

Grading precancerous lesions on whole slide images is a challenging task: the continuous space of morphological phenotypes makes clear-cut decisions between different grades often difficult, leading to low inter- and intra-rater agreements.…

Image and Video Processing · Electrical Eng. & Systems 2023-03-09 Mélanie Lubrano , Yaëlle Bellahsen-Harrar , Rutger Fick , Cécile Badoual , Thomas Walter

Foundational models are trained on extensive datasets to capture the general trends of a domain. However, in medical imaging, the scarcity of data makes pre-training for every domain, modality, or task challenging. Instead of building…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Mohammad Areeb Qazi , Munachiso S Nwadike , Ibrahim Almakky , Mohammad Yaqub , Numan Saeed

In pathological research, education, and clinical practice, the decision-making process based on pathological images is critically important. This significance extends to digital pathology image analysis: its adequacy is demonstrated by the…

Image and Video Processing · Electrical Eng. & Systems 2024-08-19 Zhi-Bo Liu , Xiaobo Pang , Jizhao Wang , Shuai Liu , Chen Li

Brain foundation models (BFMs) have emerged as a transformative paradigm in computational neuroscience, offering a revolutionary framework for processing diverse neural signals across different brain-related tasks. These models leverage…

Machine Learning · Computer Science 2025-07-22 Xinliang Zhou , Chenyu Liu , Zhisheng Chen , Kun Wang , Yi Ding , Ziyu Jia , Qingsong Wen

Artificial intelligence (AI) has shown promise in detecting and characterizing musculoskeletal diseases from radiographs. However, most existing models remain task-specific, annotation-dependent, and limited in generalizability across…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Shinn Kim , Soobin Lee , Kyoungseob Shin , Han-Soo Kim , Yongsung Kim , Minsu Kim , Juhong Nam , Somang Ko , Daeheon Kwon , Wook Huh , Ilkyu Han , Sunghoon Kwon

In recent years, Multi-modal Foundation Models (MFMs) and Embodied Artificial Intelligence (EAI) have been advancing side by side at an unprecedented pace. The integration of the two has garnered significant attention from the AI research…

Artificial Intelligence · Computer Science 2024-10-08 Min Zhang , Xian Fu , Jianye Hao , Peilong Han , Hao Zhang , Lei Shi , Hongyao Tang , Yan Zheng

Despite the impressive advancements achieved using deep-learning for functional brain activity analysis, the heterogeneity of functional patterns and scarcity of imaging data still pose challenges in tasks such as prediction of future onset…

Image and Video Processing · Electrical Eng. & Systems 2023-12-25 Wenhui Cui , Haleh Akrami , Ganning Zhao , Anand A. Joshi , Richard M. Leahy

Large AI models, or foundation models, are models recently emerging with massive scales both parameter-wise and data-wise, the magnitudes of which can reach beyond billions. Once pretrained, large AI models demonstrate impressive…

Artificial Intelligence · Computer Science 2023-09-26 Jianing Qiu , Lin Li , Jiankai Sun , Jiachuan Peng , Peilun Shi , Ruiyang Zhang , Yinzhao Dong , Kyle Lam , Frank P. -W. Lo , Bo Xiao , Wu Yuan , Ningli Wang , Dong Xu , Benny Lo

Foundation models pretrained on large-scale histopathology data have found great success in various fields of computational pathology, but their impact on regressive biomarker prediction remains underexplored. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Alexander Blezinger , Wolfgang Nejdl , Ming Tang

Accurate molecular property prediction is central to drug discovery, catalysis, and process design, yet real-world applications are often limited by small datasets. Molecular foundation models provide a promising direction by learning…

Machine Learning · Computer Science 2026-04-21 Karim K. Ben Hicham , Jan G. Rittig , Martin Grohe , Alexander Mitsos

Pathology foundation models (PFMs) have demonstrated strong representational capabilities through self-supervised pre-training on large-scale, unannotated histopathology image datasets. However, their diverse yet opaque pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Yuxiang Xiao , Yang Hu , Bin Li , Tianyang Zhang , Zexi Li , Huazhu Fu , Jens Rittscher , Kaixiang Yang

Digital pathology, augmented by artificial intelligence (AI), holds significant promise for improving the workflow of pathologists. However, challenges such as the labor-intensive annotation of whole slide images (WSIs), high computational…

Image and Video Processing · Electrical Eng. & Systems 2025-04-18 Walid Rehamnia , Alexandra Getmanskaya , Evgeniy Vasilyev , Vadim Turlapov

We present UNIPHY+, a unified physiological foundation model (physioFM) framework designed to enable continuous human health and diseases monitoring across care settings using ubiquitously obtainable physiological data. We propose novel…

The advent of foundation models (FMs) in healthcare offers unprecedented opportunities to enhance medical diagnostics through automated classification and segmentation tasks. However, these models also raise significant concerns about their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Ruinan Jin , Zikang Xu , Yuan Zhong , Qiongsong Yao , Qi Dou , S. Kevin Zhou , Xiaoxiao Li

While computer science has seen remarkable advancements in foundation models, which remain underexplored in geoscience. Addressing this gap, we introduce a workflow to develop geophysical foundation models, including data preparation, model…

Geophysics · Physics 2023-12-18 Hanlin Sheng , Xinming Wu , Xu Si , Jintao Li , Sibo Zhang , Xudong Duan

While reinforcement learning from scratch has shown impressive results in solving sequential decision-making tasks with efficient simulators, real-world applications with expensive interactions require more sample-efficient agents.…

Machine Learning · Computer Science 2025-09-22 Remo Sasso , Michelangelo Conserva , Dominik Jeurissen , Paulo Rauber

Artificial intelligence (AI)-driven decision support systems can improve diagnostic accuracy and efficiency in computational pathology. However, collaboration between human experts and AI may introduce cognitive biases such as automation…

Human-Computer Interaction · Computer Science 2026-03-16 Emely Rosbach , Jonas Ammeling , Jonathan Ganz , Christof Albert Bertram , Thomas Conrad , Andreas Riener , Marc Aubreville

Machine learning and deep learning methods have become essential for computer-assisted prediction in medicine, with a growing number of applications also in the field of mammography. Typically these algorithms are trained for a specific…

Image and Video Processing · Electrical Eng. & Systems 2021-12-03 Maria Wimmer , Gert Sluiter , David Major , Dimitrios Lenis , Astrid Berg , Theresa Neubauer , Katja Bühler