English
Related papers

Related papers: BIOSCAN-5M: A Multimodal Dataset for Insect Biodiv…

200 papers

The task of clustering a set of objects based on multiple sources of data arises in several modern applications. We propose an integrative statistical model that permits a separate clustering of the objects for each data source. These…

Machine Learning · Statistics 2015-12-01 Eric F. Lock , David B. Dunson

Collections of biological specimens are fundamental to scientific understanding and characterization of natural diversity. This paper presents a system for liberating useful information from physical collections by bringing specimens into…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Chuong V. Nguyen , David R. Lovell , Matt Adcock , John La Salle

Microbial ecology serves as a foundation for a wide range of scientific and biomedical studies. Rapidly-evolving high-throughput sequencing technology enables the comprehensive search for microbial biomarkers using longitudinal experiments.…

We introduce an architecture to learn joint multilingual sentence representations for 93 languages, belonging to more than 30 different families and written in 28 different scripts. Our system uses a single BiLSTM encoder with a shared BPE…

Computation and Language · Computer Science 2021-12-28 Mikel Artetxe , Holger Schwenk

Animal sounds can be recognised automatically by machine learning, and this has an important role to play in biodiversity monitoring. Yet despite increasingly impressive capabilities, bioacoustic species classifiers still exhibit imbalanced…

Identifying species in biology among tens of thousands of visually similar taxa while discovering unknown species in open-world environments remains a fundamental challenge in biodiversity research. Current methods treat identification and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Jiawei Wang , Ming Lei , Yaning Yang , Xinyan Lin , Yuquan Le , Qiwei Ma , Zhiwei Xu , Zheqi Lv , Yuchen Ang , Zhe Quan , Tat-Seng Chua

Accurate classification of second-trimester fetal ultrasound images remains challenging due to low image quality, high intra-class variability, and significant class imbalance. In this work, we introduce a simple yet powerful, biologically…

Image and Video Processing · Electrical Eng. & Systems 2025-06-11 Rinat Prochii , Elizaveta Dakhova , Pavel Birulin , Maxim Sharaev

The development of foundation vision models has pushed the general visual recognition to a high level, but cannot well address the fine-grained recognition in specialized domain such as invasive species classification. Identifying and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Wei He , Kai Han , Ying Nie , Chengcheng Wang , Yunhe Wang

Recently, Vision-Language Models (VLMs) have achieved remarkable progress in multimodal tasks, and multimodal instruction data serves as the foundation for enhancing VLM capabilities. Despite the availability of several open-source…

Pollinator insects such as honeybees and bumblebees are vital to global food production and ecosystem stability, yet their populations are declining due to anthropogenic and environmental stressors. Scalable, automated monitoring in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Ahmed Emam , Mohamed Elbassiouny , Julius Miller , Patrick Donworth , Sabine Seidel , Ribana Roscher

Deep learning (DL) has greatly advanced audio classification, yet the field is limited by the scarcity of large-scale benchmark datasets that have propelled progress in other domains. While AudioSet is a pivotal step to bridge this gap as a…

The sixth generation (6G) of mobile communication system is witnessing a new paradigm shift, i.e., integrated sensing-communication system. A comprehensive dataset is a prerequisite for 6G integrated sensing-communication research. This…

Signal Processing · Electrical Eng. & Systems 2023-06-27 Xiang Cheng , Ziwei Huang , Lu Bai , Haotian Zhang , Mingran Sun , Boxun Liu , Sijiang Li , Jianan Zhang , Minson Lee

Multimodal large language models (MLLMs) have demonstrated impressive cross-domain capabilities, yet their proficiency in specialized scientific fields like marine biology remains underexplored. In this work, we systematically evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Faizan Farooq Khan , Yousef Radwan , Eslam Abdelrahman , Abdulwahab Felemban , Aymen Mir , Nico K. Michiels , Andrew J. Temple , Michael L. Berumen , Mohamed Elhoseiny

Nematode worms are one of most abundant metazoan groups on the earth, occupying diverse ecological niches. Accurate recognition or identification of nematodes are of great importance for pest control, soil ecology, bio-geography, habitat…

Quantitative Methods · Quantitative Biology 2021-03-16 Xuequan Lu , Yihao Wang , Sheldon Fung , Xue Qing

Monitoring of bird populations has played a vital role in conservation efforts and in understanding biodiversity loss. The automation of this process has been facilitated by both sensing technologies, such as passive acoustic monitoring,…

Machine Learning · Computer Science 2021-08-23 Irina Tolkova , Brian Chu , Marcel Hedman , Stefan Kahl , Holger Klinck

Background: The integration of multi-stain histopathology images through deep learning poses a significant challenge in digital histopathology. Current multi-modal approaches struggle with data heterogeneity and missing data. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Valentin Koch , Sabine Bauer , Valerio Luppberger , Michael Joner , Heribert Schunkert , Julia A. Schnabel , Moritz von Scheidt , Carsten Marr

We present IMDD-1M, the first large-scale Industrial Multimodal Defect Dataset comprising 1,000,000 aligned image-text pairs, designed to advance multimodal learning for manufacturing and quality inspection. IMDD-1M contains high-resolution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 TsaiChing Ni , ZhenQi Chen , YuanFu Yang

BOLD, the Barcode of Life Data System, supports the acquisition, storage, validation, analysis, and publication of DNA barcodes, activities requiring the integration of molecular, morphological, and distributional data. Its pivotal role in…

There has been a recent spike in interest in multi-modal Language and Vision problems. On the language side, most of these models primarily focus on English since most multi-modal datasets are monolingual. We try to bridge this gap with a…

Machine Learning · Computer Science 2021-09-17 Pranav Aggarwal , Ritiz Tambi , Ajinkya Kale

Biological signals, such as electroencephalograms (EEG), play a crucial role in numerous clinical applications, exhibiting diverse data formats and quality profiles. Current deep learning models for biosignals are typically specialized for…

Signal Processing · Electrical Eng. & Systems 2023-05-18 Chaoqi Yang , M. Brandon Westover , Jimeng Sun