English
Related papers

Related papers: Mixture of Mini Experts: Overcoming the Linear Lay…

200 papers

Although multi-instance learning (MIL) has succeeded in pathological image classification, it faces the challenge of high inference costs due to the need to process thousands of patches from each gigapixel whole slide image (WSI). To…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Jiuyang Dong , Jiahan Li , Junjun Jiang , Kui Jiang , Yongbing Zhang

Single-cell datasets often lack individual cell labels, making it challenging to identify cells associated with disease. To address this, we introduce Mixture Modeling for Multiple Instance Learning (MMIL), an expectation maximization…

Quantitative Methods · Quantitative Biology 2024-06-13 Erin Craig , Timothy Keyes , Jolanda Sarno , Maxim Zaslavsky , Garry Nolan , Kara Davis , Trevor Hastie , Robert Tibshirani

Multiple Instance Learning (MIL) methods have become increasingly popular for classifying giga-pixel sized Whole-Slide Images (WSIs) in digital pathology. Most MIL methods operate at a single WSI magnification, by processing all the tissue…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Kevin Thandiackal , Boqi Chen , Pushpak Pati , Guillaume Jaume , Drew F. K. Williamson , Maria Gabrani , Orcun Goksel

Multiple Instance Learning (MIL) has been widely applied in pathology towards solving critical problems such as automating cancer diagnosis and grading, predicting patient prognosis, and therapy response. Deploying these models in a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Syed Ashar Javed , Dinkar Juyal , Harshith Padigela , Amaro Taylor-Weiner , Limin Yu , Aaditya Prakash

The computer-aided analysis of medical scans is a longstanding goal in the medical imaging field. Currently, deep learning has became a dominant methodology for supporting pathologists and radiologist. Deep learning algorithms have been…

Machine Learning · Computer Science 2017-12-06 Jakub M. Tomczak , Maximilian Ilse , Max Welling

Selective parameter activation provided by Mixture-of-Expert (MoE) models have made them a popular choice in modern foundational models. However, MoEs face a fundamental tension when employed for serving. Batching, critical for performance…

Machine Learning · Computer Science 2026-05-20 Vima Gupta , Jae Hyung Ju , Kartik Sinha , Ada Gavrilovska , Anand Padmanabha Iyer

Class-incremental learning (CIL) requires deep learning models to continuously acquire new knowledge from streaming data while preserving previously learned information. Recently, CIL based on pre-trained models (PTMs) has achieved…

Machine Learning · Computer Science 2025-06-16 Linjie Li , Zhenyu Wu , Yang Ji

Whole slide image (WSI) classification requires repetitive zoom-in and out for pathologists, as only small portions of the slide may be relevant to detecting cancer. Due to the lack of patch-level labels, multiple instance learning (MIL) is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Seongho Keum , Sanghyun Kim , Soojeong Lee , Juho Lee

Multiple instance learning (MIL) is a powerful approach to classify whole slide images (WSIs) for diagnostic pathology. A fundamental challenge of MIL on WSI classification is to discover the \textit{critical instances} that trigger the bag…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Zhikang Wang , Yue Bi , Tong Pan , Xiaoyu Wang , Chris Bain , Richard Bassed , Seiya Imoto , Jianhua Yao , Jiangning Song

AI-based models for histopathology whole slide image (WSI) analysis are increasingly common, but unsharp or blurred areas within WSI can significantly reduce prediction performance. In this study, we investigated the effect of image blur on…

Image and Video Processing · Electrical Eng. & Systems 2025-07-21 Yujie Xiang , Bojing Liu , Mattias Rantalainen

Analyzing high resolution whole slide images (WSIs) with regard to information across multiple scales poses a significant challenge in digital pathology. Multi-instance learning (MIL) is a common solution for working with high resolution…

Mixture-of-Experts (MoE) models have shown promising potential for parameter-efficient scaling across domains. However, their application to image classification remains limited, often requiring billion-scale datasets to be competitive. In…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Mathurin Videau , Alessandro Leite , Marc Schoenauer , Olivier Teytaud

In-context learning (ICL) adapts LLMs by providing demonstrations without fine-tuning the model parameters; however, it does not differentiate between demonstrations and quadratically increases the complexity of Transformer LLMs, exhausting…

Computation and Language · Computer Science 2024-11-06 Giwon Hong , Emile van Krieken , Edoardo Ponti , Nikolay Malkin , Pasquale Minervini

For classifying digital whole slide images in the absence of pixel level annotation, typically multiple instance learning methods are applied. Due to the generic applicability, such methods are currently of very high interest in the…

Multi-instance learning (MIL) is a form of weakly supervised learning where a single class label is assigned to a bag of instances while the instance-level labels are not available. Training classifiers to accurately determine the bag label…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Bin Li , Kevin W. Eliceiri

Advances in medical imaging and deep learning have propelled progress in whole slide image (WSI) analysis, with multiple instance learning (MIL) showing promise for efficient and accurate diagnostics. However, conventional MIL models often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Xianrui Li , Yufei Cui , Jun Li , Antoni B. Chan

With the increasing demand for histopathological specimen examination and diagnostic reporting, Multiple Instance Learning (MIL) has received heightened research focus as a viable solution for AI-centric diagnostic aid. Recently, to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Sungrae Hong , Sol Lee , Jisu Shin , Jiwon Jeong , Mun Yong Yi

Mammograms are commonly employed in the large scale screening of breast cancer which is primarily characterized by the presence of malignant masses. However, automated image-level detection of malignancy is a challenging task given the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Sarath Chandra K , Arunava Chakravarty , Nirmalya Ghosh , Tandra Sarkar , Ramanathan Sethuraman , Debdoot Sheet

Attention-based multiple instance learning (MIL) has emerged as a powerful framework for whole slide image (WSI) diagnosis, leveraging attention to aggregate instance-level features into bag-level predictions. Despite this success, we find…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Linfeng Ye , Shayan Mohajer Hamidi , Zhixiang Chi , Guang Li , Mert Pilanci , Takahiro Ogawa , Miki Haseyama , Konstantinos N. Plataniotis

In the field of computational pathology, the use of decision support systems powered by state-of-the-art deep learning solutions has been hampered by the lack of large labeled datasets. Until recently, studies relied on datasets in the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Gabriele Campanella , Vitor Werneck Krauss Silva , Thomas J. Fuchs