English
Related papers

Related papers: Benchmarking In-the-wild Multimodal Disease Recogn…

200 papers

Automatic identification of plant specimens from amateur photographs could improve species range maps, thus supporting ecosystems research as well as conservation efforts. However, classifying plant specimens based on image data alone is…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Riccardo de Lutio , Yihang She , Stefano D'Aronco , Stefania Russo , Philipp Brun , Jan D. Wegner , Konrad Schindler

In this paper, an innovative multi-modal deep learning model is proposed to deeply integrate heterogeneous information from medical images and clinical reports. First, for medical images, convolutional neural networks were used to extract…

Machine Learning · Computer Science 2024-05-29 Ziyan Yao , Fei Lin , Sheng Chai , Weijie He , Lu Dai , Xinghui Fei

Supervised learning is limited both by the quantity and quality of the labeled data. In the field of medical record tagging, writing styles between hospitals vary drastically. The knowledge learned from one hospital might not transfer well…

Computation and Language · Computer Science 2018-11-30 Yuhui Zhang , Allen Nie , James Zou

Accurate biomedical image classification under low-resource conditions remains challenging due to limited annotations, subtle inter-class visual differences, and complex disease semantics. While vision--language models offer a promising…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Xiaoliu Luo , Minxue Xiao , Ting Xie , Mengzhu Wang , Huiqing Qi , Joey Tianyi Zhou , Taiping Zhang , Xu Wang

Data is one of the essential ingredients to power deep learning research. Small datasets, especially specific to medical institutes, bring challenges to deep learning training stage. This work aims to develop a practical deep multimodal…

Machine Learning · Computer Science 2019-02-26 Faik Aydin , Maggie Zhang , Michelle Ananda-Rajah , Gholamreza Haffari

In standard classification, we typically treat class categories as independent of one-another. In many problems, however, we would be neglecting the natural relations that exist between categories, which are often dictated by an underlying…

Computer Vision and Pattern Recognition · Computer Science 2020-06-25 Muhamedrahimov Raouf , Bar Amir , Akselrod-Ballin Ayelet

Every year, plant parasitic nematodes, one of the major groups of plant pathogens, cause a significant loss of crops worldwide. To mitigate crop yield losses caused by nematodes, an efficient nematode monitoring method is essential for…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Zhipeng Yuan , Nasamu Musa , Katarzyna Dybal , Matthew Back , Daniel Leybourne , Po Yang

One of the critical biotic stress factors paddy farmers face is diseases caused by bacteria, fungi, and other organisms. These diseases affect plants' health severely and lead to significant crop loss. Most of these diseases can be…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Petchiammal A , Briskline Kiruba S , D. Murugan , Pandarasamy A

Understanding the interplay between intra-modality dependencies (the contribution of an individual modality to a target task) and inter-modality dependencies (the relationships between modalities and the target task) is fundamental to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Divyam Madaan , Varshan Muhunthan , Kyunghyun Cho , Sumit Chopra

Visual impairment represents a major global health challenge, with multimodal imaging providing complementary information that is essential for accurate ophthalmic diagnosis. This comprehensive survey systematically reviews the latest…

Image and Video Processing · Electrical Eng. & Systems 2025-08-07 Xiaoling Luo , Ruli Zheng , Qiaojian Zheng , Zibo Du , Shuo Yang , Meidan Ding , Qihao Xu , Chengliang Liu , Linlin Shen

Failure detection in automated image classification is a critical safeguard for clinical deployment. Detected failure cases can be referred to human assessment, ensuring patient safety in computer-aided clinical decision making. Despite its…

Artificial Intelligence · Computer Science 2022-10-25 Melanie Bernhardt , Fabio De Sousa Ribeiro , Ben Glocker

Benchmark datasets for visual recognition assume that data is uniformly distributed, while real-world datasets obey long-tailed distribution. Current approaches handle the long-tailed problem to transform the long-tailed dataset to uniform…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Renhui Zhang , Tiancheng Lin , Rui Zhang , Yi Xu

It is estimated that there are more than 300,000 species of vascular plants in the world. Increasing our knowledge of these species is of paramount importance for the development of human civilization (agriculture, construction,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Herve Goeau , Pierre Bonnet , Alexis Joly

Recent studies on multi-label image classification have focused on designing more complex architectures of deep neural networks such as the use of attention mechanisms and region proposal networks. Although performance gains have been…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Qian Wang , Ning Jia , Toby P. Breckon

Long-tailed learning is considered to be an extremely challenging problem in data imbalance learning. It aims to train well-generalized models from a large number of images that follow a long-tailed class distribution. In the medical field,…

Image and Video Processing · Electrical Eng. & Systems 2024-10-04 Lie Ju , Siyuan Yan , Yukun Zhou , Yang Nan , Xiaodan Xing , Peibo Duan , Zongyuan Ge

While conversational generative AI has shown considerable potential in enhancing decision-making for agricultural professionals, its exploration has predominantly been anchored in text-based interactions. The evolution of multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiang Liu , Zhaoxiang Liu , Huan Hu , Zezhou Chen , Kohou Wang , Kai Wang , Shiguo Lian

Recent progress in self-supervised learning has resulted in models that are capable of extracting rich representations from image collections without requiring any explicit label supervision. However, to date the vast majority of these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Grant Van Horn , Elijah Cole , Sara Beery , Kimberly Wilber , Serge Belongie , Oisin Mac Aodha

Deep learning has brought significant progress to medical image classification, yet most existing methods still rely on isolated visual evidence and cannot effectively leverage similar cases or external knowledge. In clinical practice,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Yiming Xu , Yixuan Liu , Yuhang Zhang , Ling Zheng , Yihan Wang , Qi Song

In multi-label text classification, each textual document can be assigned with one or more labels. Due to this nature, the multi-label text classification task is often considered to be more challenging compared to the binary or multi-class…

Information Retrieval · Computer Science 2019-07-02 Jingcheng Du , Qingyu Chen , Yifan Peng , Yang Xiang , Cui Tao , Zhiyong Lu

The multiple-biomarker classifier problem and its assessment are reviewed against the background of some fundamental principles from the field of statistical pattern recognition, machine learning, or the recently so-called "data science". A…

Genomics · Quantitative Biology 2019-11-01 Waleed A. Yousef