English
Related papers

Related papers: Mixture of Mini Experts: Overcoming the Linear Lay…

200 papers

Multiple Instance Learning (MIL) for whole slide image (WSI) analysis in computational pathology often neglects instance-level learning as supervision is typically provided only at the bag level, hindering the integrated consideration of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Shuyang Wu , Yifu Qiu , Ines P. Nearchou , Sandrine Prost , Jonathan A. Fallowfield , Hideki Ueno , Hitoshi Tsuda , David J. Harrison , Hakan Bilen , Timothy J. Kendall

Multiple-instance Learning (MIL) is commonly used to undertake computational pathology (CPath) tasks, and the use of multi-scale patches allows diverse features across scales to be learned. Previous studies using multi-scale features in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shuyang Wu , Yifu Qiu , Ines P. Nearchou , Sandrine Prost , Jonathan A Fallowfield , Hakan Bilen , Timothy J Kendall

Multiple instance learning (MIL) is often used in medical imaging to classify high-resolution 2D images by processing patches or classify 3D volumes by processing slices. However, conventional MIL approaches treat instances separately,…

Machine Learning · Computer Science 2025-11-13 Ethan Harvey , Dennis Johan Loevlie , Michael C. Hughes

Multiple instance learning (MIL) significantly reduced annotation costs via bag-level weak labels for large-scale images, such as histopathological whole slide images (WSIs). However, its adaptability to continual tasks with minimal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Byung Hyun Lee , Wongi Jeong , Woojae Han , Kyoungbun Lee , Se Young Chun

Optimization in multi-task learning (MTL) is more challenging than single-task learning (STL), as the gradient from different tasks can be contradictory. When tasks are related, it can be beneficial to share some parameters among them…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Zitian Chen , Yikang Shen , Mingyu Ding , Zhenfang Chen , Hengshuang Zhao , Erik Learned-Miller , Chuang Gan

Multiple instance learning (MIL) is a form of weakly supervised learning where training instances are arranged in sets, called bags, and a label is provided for the entire bag. This formulation is gaining interest because it naturally fits…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Marc-André Carbonneau , Veronika Cheplygina , Eric Granger , Ghyslain Gagnon

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several…

Multiple instance learning (MIL) was a weakly supervised learning approach that sought to assign binary class labels to collections of instances known as bags. However, due to their weak supervision nature, the MIL methods were susceptible…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Wenhui Zhu , Peijie Qiu , Xiwen Chen , Oana M. Dumitrascu , Yalin Wang

Whole slide images (WSIs) are the gold standard for pathological diagnosis and sub-typing. Current main-stream two-step frameworks employ offline feature encoders trained without domain-specific knowledge. Among them, attention-based…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Mingrui Ma , Chentao Li , Pan Huang , Jing Qin

Whole slide image (WSI) classification is a critical task in computational pathology, requiring the processing of gigapixel-sized images, which is challenging for current deep-learning methods. Current state of the art methods are based on…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Jingwei Zhang , Saarthak Kapse , Ke Ma , Prateek Prasanna , Joel Saltz , Maria Vakalopoulou , Dimitris Samaras

Digital histopathology whole slide images (WSIs) provide gigapixel-scale high-resolution images that are highly useful for disease diagnosis. However, digital histopathology image analysis faces significant challenges due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Bodong Zhang , Xiwen Li , Hamid Manoochehri , Xiaoya Tang , Deepika Sirohi , Beatrice S. Knudsen , Tolga Tasdizen

Mixture-of-Experts (MoE) Multimodal large language models (MLLMs) excel at vision-language tasks, but they suffer from high computational inefficiency. To reduce inference overhead, expert skipping methods have been proposed to deactivate…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yushi Huang , Zining Wang , Zhihang Yuan , Yifu Ding , Ruihao Gong , Jinyang Guo , Xianglong Liu , Jun Zhang

Multiple Instance Learning (MIL) has emerged as a promising paradigm for Whole Slide Image (WSI) diagnosis, offering effective learning with limited annotations. However, existing MIL frameworks overlook diagnostic priorities and fail to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Sungrae Hong , Jiwon Jeong , Jisu Shin , Donghee Han , Sol Lee , Kyungeun Kim , Mun Yong Yi

Mixture-of-Experts (MoE) activates only a subset of experts during inference, allowing the model to maintain low inference FLOPs and latency even as the parameter count scales up. However, since MoE dynamically selects the experts, all the…

Machine Learning · Computer Science 2025-05-27 Shibo Jie , Yehui Tang , Kai Han , Yitong Li , Duyu Tang , Zhi-Hong Deng , Yunhe Wang

While Large Language Models (LLMs) are emerging as a promising direction in computational pathology, the substantial computational cost of giga-pixel Whole Slide Images (WSIs) necessitates the use of Multi-Instance Learning (MIL) to enable…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhenfeng Zhuang , Fangyu Zhou , Liansheng Wang

Whole slide images (WSIs) classification represents a fundamental challenge in computational pathology, where multiple instance learning (MIL) has emerged as the dominant paradigm. Current state-of-the-art (SOTA) MIL methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Chengying She , Chengwei Chen , Dongjie Fan , Lizhuang Liu , Chengwei Shao , Yun Bian , Ben Wang , Xinran Zhang

described by multiple instances (e.g., image patches) and simultaneously associated with multiple labels. Existing MIML methods are useful in many applications but most of which suffer from relatively low accuracy and training efficiency…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Qi Lai , Jianhang Zhou , Yanfen Gan , Chi-Man Vong , Deshuang Huang

Weakly supervised whole slide image classification is usually formulated as a multiple instance learning (MIL) problem, where each slide is treated as a bag, and the patches cut out of it are treated as instances. Existing methods either…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Linhao Qu , Yingfan Ma , Xiaoyuan Luo , Manning Wang , Zhijian Song

Large Language Models (LLMs) with Mixture-of-Experts (MoE) architectures are distinguished by their strong performance scaling with increasing parameters across a wide range of tasks, yet they also suffer from substantial computational and…

Computation and Language · Computer Science 2025-11-27 Yuzhuang Xu , Xu Han , Yuanchi Zhang , Yixuan Wang , Yijun Liu , Shiyu Ji , Qingfu Zhu , Wanxiang Che

Given the special situation of modeling gigapixel images, multiple instance learning (MIL) has become one of the most important frameworks for Whole Slide Image (WSI) classification. In current practice, most MIL networks often face two…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Pei Liu , Luping Ji , Xinyu Zhang , Feng Ye