English
Related papers

Related papers: Leukocyte Classification using Multimodal Architec…

200 papers

Humans make accurate decisions by interpreting complex data from multiple sources. Medical diagnostics, in particular, often hinge on human interpretation of multi-modal information. In order for artificial intelligence to make progress in…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Faisal Mahmood , Ziyun Yang , Thomas Ashley , Nicholas J. Durr

Deep learning methods are widely used for medical applications to assist medical doctors in their daily routines. While performances reach expert's level, interpretability (highlight how and what a trained model learned and why it makes a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Antoine Pirovano , Hippolyte Heuberger , Sylvain Berlemont , Saïd Ladjal , Isabelle Bloch

Multimodal Large Language Models (MLLMs) have shown promise in visual-textual reasoning, with Multimodal Chain-of-Thought (MCoT) prompting significantly enhancing interpretability. However, existing MCoT methods rely on rationale-rich…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yiwen Jiang , Deval Mehta , Siyuan Yan , Yaling Shen , Zimu Wang , Zongyuan Ge

Breast cancer is the most diagnosed cancer and the most predominant cause of death in women worldwide. Imaging techniques such as the breast cancer pathology helps in the diagnosis and monitoring of the disease. However identification of…

Image and Video Processing · Electrical Eng. & Systems 2019-08-06 Francisco Perdigon Romero , An Tang , Samuel Kadoury

As the development of neural networks, more and more deep neural networks are adopted in various tasks, such as image classification. However, as the huge computational overhead, these networks could not be applied on mobile devices or…

Computer Vision and Pattern Recognition · Computer Science 2019-12-03 Yunteng Luan , Hanyu Zhao , Zhi Yang , Yafei Dai

The ability to quickly learn a new task with minimal instruction - known as few-shot learning - is a central aspect of intelligent agents. Classical few-shot benchmarks make use of few-shot samples from a single modality, but such samples…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Zhiqiu Lin , Samuel Yu , Zhiyi Kuang , Deepak Pathak , Deva Ramanan

Accurate classification of blood cells plays a vital role in hematological analysis as it aids physicians in diagnosing various medical conditions. In this study, we present a novel approach for classifying blood cell images known as…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Yongcheng Li , Lingcong Cai , Ying Lu , Yupeng Zhang , Jingyan Jiang , Genan Dai , Bowen Zhang , Jingzhou Cao , Xiangzhong Zhang , Xiaomao Fan

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

Hierarchical clustering recursively partitions data at an increasingly finer granularity. In real-world applications, multi-view data have become increasingly important. This raises a less investigated problem, i.e., multi-view hierarchical…

Machine Learning · Computer Science 2022-05-06 Fangfei Lin , Bing Bai , Kun Bai , Yazhou Ren , Peng Zhao , Zenglin Xu

This thesis aims to investigate the feasibility of knowledge transfer between neural networks for medical image segmentation tasks, specifically focusing on the transfer from a larger multi-task "Teacher" network to a smaller "Student"…

Image and Video Processing · Electrical Eng. & Systems 2024-06-06 Risab Biswas

This paper considers self-supervised cross-modal coordination as a strategy enabling utilization of multiple modalities and large volumes of unlabeled plankton data to build models for plankton recognition. Automated imaging instruments…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Joona Kareinen , Veikka Immonen , Tuomas Eerola , Lumi Haraguchi , Lasse Lensu , Kaisa Kraft , Sanna Suikkanen , Heikki Kälviäinen

Wireless capsule endoscopy (WCE) is an effective means of diagnosis of gastrointestinal disorders. Detection of informative scenes by WCE could reduce the length of transmitted videos and can help with the diagnosis. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2018-02-23 Mohsen Hajabdollahi , Reza Esfandiarpoor , S. M. Reza Soroushmehr , Nader Karimi , Shadrokh Samavi , Kayvan Najarian

Immunohistochemical (IHC) biomarker prediction benefits from multi-modal data fusion analysis. However, the simultaneous acquisition of multi-modal data, such as genomic and pathological information, is often challenging due to cost or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Qibin Zhang , Xinyu Hao , Qiao Chen , Rui Xu , Fengyu Cong , Cheng Lu , Hongming Xu

Multiple Instance Learning (MIL) for whole slide image (WSI) analysis in computational pathology often neglects instance-level learning as supervision is typically provided only at the bag level, hindering the integrated consideration of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Shuyang Wu , Yifu Qiu , Ines P. Nearchou , Sandrine Prost , Jonathan A. Fallowfield , Hideki Ueno , Hitoshi Tsuda , David J. Harrison , Hakan Bilen , Timothy J. Kendall

We propose a novel deep layer cascade (LC) method to improve the accuracy and speed of semantic segmentation. Unlike the conventional model cascade (MC) that is composed of multiple independent models, LC treats a single deep model as a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-06 Xiaoxiao Li , Ziwei Liu , Ping Luo , Chen Change Loy , Xiaoou Tang

Training a multimodal network is challenging and it requires complex architectures to achieve reasonable performance. We show that one reason for this phenomena is the difference between the convergence rate of various modalities. We…

Artificial Intelligence · Computer Science 2020-11-13 Aya Abdelsalam Ismail , Mahmudul Hasan , Faisal Ishtiaq

Predicting stroke risk is a complex challenge that can be enhanced by integrating diverse clinically available data modalities. This study introduces a self-supervised multimodal framework that combines 3D brain imaging, clinical data, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Camille Delgrange , Olga Demler , Samia Mora , Bjoern Menze , Ezequiel de la Rosa , Neda Davoudi

For any type of microscopy image, getting a deep learning model to work well requires considerable effort to select a suitable architecture and time to train it. As there is a wide range of microscopes and experimental setups, designing a…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Duc Hoa Tran , Michel Meunier , Farida Cheriet

Multiple clustering aims at exploring alternative clusterings to organize the data into meaningful groups from different perspectives. Existing multiple clustering algorithms are designed for single-view data. We assume that the…

Machine Learning · Computer Science 2019-05-16 Shixing Yao , Guoxian Yu , Jun Wang , Carlotta Domeniconi , Xiangliang Zhang

Image clustering, which involves grouping images into different clusters without labels, is a key task in unsupervised learning. Although previous deep clustering methods have achieved remarkable results, they only explore the intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Haixin Zhang , Yongjun Li , Dong Huang