English
Related papers

Related papers: Data-driven Knowledge Fusion for Deep Multi-instan…

200 papers

Due to the ease of training, ability to scale, and high sample quality, diffusion models (DMs) have become the preferred option for generative modeling, with numerous pre-trained models available for a wide variety of datasets. Containing…

Machine Learning · Computer Science 2024-01-17 Weijian Luo , Tianyang Hu , Shifeng Zhang , Jiacheng Sun , Zhenguo Li , Zhihua Zhang

Deep learning models for multimodal expression recognition have reached remarkable performance in controlled laboratory environments because of their ability to learn complementary and redundant semantic information. However, these models…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Muhammad Haseeb Aslam , Muhammad Osama Zeeshan , Soufiane Belharbi , Marco Pedersoli , Alessandro Koerich , Simon Bacon , Eric Granger

Class Incremental Learning (CIL) is challenging due to catastrophic forgetting. On top of that, Exemplar-free Class Incremental Learning is even more challenging due to forbidden access to previous task data. Recent exemplar-free CIL…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zichong Meng , Jie Zhang , Changdi Yang , Zheng Zhan , Pu Zhao , Yanzhi Wang

Deep metric learning (DML) has received much attention in deep learning due to its wide applications in computer vision. Previous studies have focused on designing complicated losses and hard example mining methods, which are mostly…

Machine Learning · Computer Science 2020-06-19 Qi Qi , Yan Yan , Xiaoyu Wang , Tianbao Yang

Multiple instance learning (MIL) can reduce the need for costly annotation in tasks such as semantic segmentation by weakening the required degree of supervision. We propose a novel MIL formulation of multi-class semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2015-04-16 Deepak Pathak , Evan Shelhamer , Jonathan Long , Trevor Darrell

Instance-incremental learning (IIL) focuses on learning continually with data of the same classes. Compared to class-incremental learning (CIL), the IIL is seldom explored because IIL suffers less from catastrophic forgetting (CF). However,…

Machine Learning · Computer Science 2024-06-06 Qiang Nie , Weifu Fu , Yuhuan Lin , Jialin Li , Yifeng Zhou , Yong Liu , Lei Zhu , Chengjie Wang

Multiple Instance Learning (MIL) is the predominant framework for classifying gigapixel whole-slide images in computational pathology. MIL follows a sequence of 1) extracting patch features, 2) applying a linear layer to obtain…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Daniel Shao , Joel Runevic , Richard J. Chen , Drew F. K. Williamson , Ahrong Kim , Andrew H. Song , Faisal Mahmood

Knowledge distillation (KD) has proven highly effective for compressing large models and enhancing the performance of smaller ones. However, its effectiveness diminishes in cross-modal scenarios, such as vision-to-language distillation,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Junhong Liu , Yuan Zhang , Tao Huang , Wenchao Xu , Renyu Yang

Vision Language Models (VLMs), pre-trained on large-scale image-text datasets, enable zero-shot predictions for unseen data but may underperform on specific unseen tasks. Continual learning (CL) can help VLMs effectively adapt to new data…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Hongsheng Zhang , Zhong Ji , Jingren Liu , Yanwei Pang , Jungong Han

A new random forest based model for solving the Multiple Instance Learning (MIL) problem under small tabular data, called Soft Tree Ensemble MIL (STE-MIL), is proposed. A new type of soft decision trees is considered, which is similar to…

Machine Learning · Computer Science 2023-02-14 Andrei V. Konstantinov , Lev V. Utkin

Multiple Instance Learning (MIL) methods allow for gigapixel Whole-Slide Image (WSI) analysis with only slide-level annotations. Interpretability is crucial for safely deploying such algorithms in high-stakes medical domains. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Susu Sun , Leslie Tessier , Frédérique Meeuwsen , Clément Grisi , Dominique van Midden , Geert Litjens , Christian F. Baumgartner

Multiple instance learning (MIL) has emerged as a popular method for classifying histopathology whole slide images (WSIs). However, existing approaches typically rely on pre-trained models from large natural image datasets, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yi Lin , Zhongchen Zhao , Zhengjie ZHU , Lisheng Wang , Kwang-Ting Cheng , Hao Chen

Knowledge distillation, the technique of transferring knowledge from large, complex models to smaller ones, marks a pivotal step towards efficient AI deployment. Distilling Step-by-Step~(DSS), a novel method utilizing chain-of-thought~(CoT)…

Computation and Language · Computer Science 2024-06-11 Xin Chen , Hanxian Huang , Yanjun Gao , Yi Wang , Jishen Zhao , Ke Ding

Multi-modal learning plays a crucial role in cancer diagnosis and prognosis. Current deep learning based multi-modal approaches are often limited by their abilities to model the complex correlations between genomics and histology data,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Yupei Zhang , Xiaofei Wang , Fangliangzi Meng , Jin Tang , Chao Li

Signal processing, communications, and control have traditionally relied on classical statistical modeling techniques. Such model-based methods utilize mathematical formulations that represent the underlying physics, prior information and…

Signal Processing · Electrical Eng. & Systems 2022-09-13 Nir Shlezinger , Jay Whang , Yonina C. Eldar , Alexandros G. Dimakis

In recent years, pre-trained multimodal large models have attracted widespread attention due to their outstanding performance in various multimodal applications. Nonetheless, the extensive computational resources and vast datasets required…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Zhengyang Liang , Meiyu Liang , Wei Huang , Yawen Li , Zhe Xue

Multimodal learning has become a prominent research area, with the potential of substantial performance gains by combining information across modalities. At the same time, model development has trended toward increasingly complex deep…

Machine Learning · Computer Science 2026-05-08 Tillmann Rheude , Roland Eils , Benjamin Wild

Weakly supervised object detection (WSOD) is a challenging task that requires simultaneously learn object classifiers and estimate object locations under the supervision of image category labels. A major line of WSOD methods roots in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Shiwei Zhang , Wei Ke , Lin Yang

Knowledge distillation (KD), as an efficient and effective model compression technique, has been receiving considerable attention in deep learning. The key to its success is to transfer knowledge from a large teacher network to a small…

Machine Learning · Computer Science 2021-01-28 Liyuan Sun , Jianping Gou , Baosheng Yu , Lan Du , Dacheng Tao

In the recent past, complex deep neural networks have received huge interest in various document understanding tasks such as document image classification and document retrieval. As many document types have a distinct visual style, learning…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Souhail Bakkali , Ziheng Ming , Mickael Coustaty , Marçal Rusiñol