English
Related papers

Related papers: ProBio: A Protocol-guided Multimodal Dataset for M…

200 papers

We present an outline of the first large language model (LLM) based chatbot application in the context of patient-reported outcome measures (PROMs) for diabetic retinopathy. By utilizing the capabilities of current LLMs, we enable patients…

Computation and Language · Computer Science 2024-11-06 Maren Pielka , Tobias Schneider , Jan Terheyden , Rafet Sifa

Multi-modal learning is a fast growing area in artificial intelligence. It tries to help machines understand complex things by combining information from different sources, like images, text, and audio. By using the strengths of each…

Machine Learning · Computer Science 2025-12-22 Qihang Jin , Enze Ge , Yuhang Xie , Hongying Luo , Junhao Song , Ziqian Bi , Chia Xin Liang , Jibin Guan , Joe Yeong , Xinyuan Song , Junfeng Hao

Computer simulations have become a very powerful tool for scientific research. Given the vast complexity that comes with many open scientific questions, a purely analytical or experimental approach is often not viable. For example,…

Neural and Evolutionary Computing · Computer Science 2016-07-12 Roman Bauer , Lukas Breitwieser , Alberto Di Meglio , Leonard Johard , Marcus Kaiser , Marco Manca , Manuel Mazzara , Max Talanov

Ensuring the reproducibility of scientific work is crucial as it allows the consistent verification of scientific claims and facilitates the advancement of knowledge by providing a reliable foundation for future research. However,…

Software Engineering · Computer Science 2025-04-14 Lázaro Costa , Susana Barbosa , Jácome Cunha

As deep learning systems are scaled up to many billions of parameters, relating their internal structure to external behaviors becomes very challenging. Although daunting, this problem is not new: Neuroscientists and cognitive scientists…

Artificial intelligence has become pervasive across disciplines and fields, and biomedical image and signal processing is no exception. The growing and widespread interest on the topic has triggered a vast research activity that is…

Machine Learning · Computer Science 2022-07-12 Guang Yang , Arvind Rao , Christine Fernandez-Maloigne , Vince Calhoun , Gloria Menegaz

Crop biomass, a critical indicator of plant growth, health, and productivity, is invaluable for crop breeding programs and agronomic research. However, the accurate and scalable quantification of crop biomass remains inaccessible due to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Xuesong Li , Zeeshan Hayder , Ali Zia , Connor Cassidy , Shiming Liu , Warwick Stiller , Eric Stone , Warren Conaty , Lars Petersson , Vivien Rolland

In the genome biology research, regulatory genome modeling is an important topic for many regulatory downstream tasks, such as promoter classification, transaction factor binding sites prediction. The core problem is to model how regulatory…

Genomics · Quantitative Biology 2021-11-04 Shentong Mo , Xi Fu , Chenyang Hong , Yizhen Chen , Yuxuan Zheng , Xiangru Tang , Zhiqiang Shen , Eric P Xing , Yanyan Lan

Proactive monitoring of one's health could avoid serious diseases as well as better maintain the individual's well-being. In today's IoT world, there has been numerous wearable technological devices to monitor/measure different health…

Computers and Society · Computer Science 2016-12-05 Shubhi Asthana , Ray Strong , Aly Megahed

We present CrypticBio, the largest publicly available multimodal dataset of visually confusing species, specifically curated to support the development of AI models in the context of biodiversity applications. Visually confusing or cryptic…

Multimedia · Computer Science 2025-05-22 Georgiana Manolache , Gerard Schouten , Joaquin Vanschoren

Multimodal learning enables neural networks to integrate information from heterogeneous sources, but active learning in this setting faces distinct challenges. These include missing modalities, differences in modality difficulty, and…

Machine Learning · Computer Science 2026-04-01 Dustin Eisenhardt , Yunhee Jeong , Florian Buettner

Large Multimodal Models (LMMs) exhibit remarkable multi-tasking ability by learning mixed instruction datasets. However, novel tasks would be encountered sequentially in dynamic world, which urges for equipping LMMs with multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Fanhu Zeng , Fei Zhu , Haiyang Guo , Xu-Yao Zhang , Cheng-Lin Liu

We present a novel multi-modal bio-sensing platform capable of integrating multiple data streams for use in real-time applications. The system is composed of a central compute module and a companion headset. The compute node collects,…

Human-Computer Interaction · Computer Science 2018-02-23 Siddharth , Aashish Patel , Tzyy-Ping Jung , Terrence J. Sejnowski

The rapid growth and diversity in service offerings and the ensuing complexity of information technology ecosystems present numerous management challenges (both operational and strategic). Instrumentation and measurement technology is, by…

Software Engineering · Computer Science 2012-06-26 Moises Goldszmidt

Data Mining is a promising field and is applied in multiple domains for its predictive capabilities. Data in the real world cannot be readily used for data mining as it suffers from the problems of multidimensionality, unbalance and missing…

Machine Learning · Computer Science 2024-06-07 Pooja Thakar , Anil Mehta , Manisha

There is growing symbiosis between artificial and biological intelligence sciences: neural principles inspire new intelligent machines, which are in turn used to advance our theoretical understanding of the brain. To promote further…

Neurons and Cognition · Quantitative Biology 2025-01-07 Alessandro T. Gifford , Domenic Bersch , Marie St-Laurent , Basile Pinsard , Julie Boyle , Lune Bellec , Aude Oliva , Gemma Roig , Radoslaw M. Cichy

The rapid evolution of artificial intelligence (AI) has shifted from static, data-driven models to dynamic systems capable of perceiving and interacting with real-world environments. Despite advancements in pattern recognition and symbolic…

Understanding protein dynamics are essential for deciphering protein functional mechanisms and developing molecular therapies. However, the complex high-dimensional dynamics and interatomic interactions of biological processes pose…

Quantitative Methods · Quantitative Biology 2025-05-15 Tiexin Qin , Mengxu Zhu , Chunyang Li , Terry Lyons , Hong Yan , Haoliang Li

Modern information systems that support complex business processes generally maintain significant amounts of process execution data, particularly records of events corresponding to the execution of activities (event logs). In this paper, we…

Software Engineering · Computer Science 2025-07-22 Fabrizio Maria Maggi , Chiara Di Francescomarino , Marlon Dumas , Chiara Ghidini

New technologies have enabled the investigation of biology and human health at an unprecedented scale and in multiple dimensions. These dimensions include a myriad of properties describing genome, epigenome, transcriptome, microbiome,…

Quantitative Methods · Quantitative Biology 2018-10-22 Marinka Zitnik , Francis Nguyen , Bo Wang , Jure Leskovec , Anna Goldenberg , Michael M. Hoffman