English
Related papers

Related papers: Leveraging Biomolecule and Natural Language throug…

200 papers

Computer-assisted diagnostic and prognostic systems of the future should be capable of simultaneously processing multimodal data. Multimodal deep learning (MDL), which involves the integration of multiple sources of data, such as images and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Zhaoyi Sun , Mingquan Lin , Qingqing Zhu , Qianqian Xie , Fei Wang , Zhiyong Lu , Yifan Peng

Large Language Models (LLMs) have significantly advanced molecular discovery, but existing multimodal molecular architectures fundamentally rely on autoregressive (AR) backbones. This strict left-to-right inductive bias is sub-optimal for…

Artificial Intelligence · Computer Science 2026-04-08 Seohyeon Shin , HanJun Choi , Jun-Hyung Park , Hong Kook Kim , Mansu Kim

Biological multimodal large language models (MLLMs) have emerged as powerful foundation models for scientific discovery. However, existing models are specialized to a single modality, limiting their ability to solve inherently cross-modal…

Machine Learning · Computer Science 2026-03-17 Wonbin Lee , Dongki Kim , Sung Ju Hwang

The exploration of multimodal language models integrates multiple data types, such as images, text, language, audio, and other heterogeneity. While the latest large language models excel in text-based tasks, they often struggle to…

Artificial Intelligence · Computer Science 2023-11-23 Jiayang Wu , Wensheng Gan , Zefeng Chen , Shicheng Wan , Philip S. Yu

Language Models (LMs) have greatly influenced diverse domains. However, their inherent limitation in comprehending 3D molecular structures has considerably constrained their potential in the biomolecular domain. To bridge this gap, we focus…

Machine Learning · Computer Science 2024-03-19 Sihang Li , Zhiyuan Liu , Yanchen Luo , Xiang Wang , Xiangnan He , Kenji Kawaguchi , Tat-Seng Chua , Qi Tian

Large Language Models (LLMs), with their remarkable task-handling capabilities and innovative outputs, have catalyzed significant advancements across a spectrum of fields. However, their proficiency within specialized domains such as…

Quantitative Methods · Quantitative Biology 2024-03-05 Yin Fang , Xiaozhuan Liang , Ningyu Zhang , Kangwei Liu , Rui Huang , Zhuo Chen , Xiaohui Fan , Huajun Chen

Multilingual language models have significantly advanced due to rapid progress in natural language processing. Models like BLOOM 1.7B, trained on diverse multilingual datasets, aim to bridge linguistic gaps. However, their effectiveness in…

Computation and Language · Computer Science 2026-02-03 Santhosh Kakarla , Gautama Shastry Bulusu Venkata , Aishwarya Gaddam , Maheedhar Sai Omtri Mohan

This survey and application guide to multimodal large language models(MLLMs) explores the rapidly developing field of MLLMs, examining their architectures, applications, and impact on AI and Generative Models. Starting with foundational…

Artificial Intelligence · Computer Science 2025-12-02 Chia Xin Liang , Pu Tian , Caitlyn Heqi Yin , Yao Yua , Wei An-Hou , Li Ming , Xinyuan Song , Tianyang Wang , Ziqian Bi , Ming Liu

Recent advancements in deep learning, particularly large language models (LLMs), made a significant impact on how researchers study microbiome and metagenomics data. Microbial protein and genomic sequences, like natural languages, form a…

Quantitative Methods · Quantitative Biology 2024-09-18 Binghao Yan , Yunbi Nam , Lingyao Li , Rebecca A. Deek , Hongzhe Li , Siyuan Ma

Lately, researchers in artificial intelligence have been really interested in how language and vision come together, giving rise to the development of multimodal models that aim to seamlessly integrate textual and visual information.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Rajat Chawla , Arkajit Datta , Tushar Verma , Adarsh Jha , Anmol Gautam , Ayush Vatsal , Sukrit Chaterjee , Mukunda NS , Ishaan Bhola

At the intersection of the rapidly growing biological data landscape and advancements in Natural Language Processing (NLP), protein language models (PLMs) have emerged as a transformative force in modern research. These models have achieved…

Biomolecules · Quantitative Biology 2025-02-12 Lei Wang , Xudong Li , Han Zhang , Jinyi Wang , Dingkang Jiang , Zhidong Xue , Yan Wang

Large Language Models (LLMs) have achieved remarkable success and have been applied across various scientific fields, including chemistry. However, many chemical tasks require the processing of visual information, which cannot be…

Molecules play a crucial role in biomedical research and discovery, particularly in the field of small molecule drug development. Given the rapid advancements in large language models, especially the recent emergence of reasoning models, it…

Artificial Intelligence · Computer Science 2025-12-12 Chenyang Zuo , Siqi Fan , Zaiqing Nie

Artificial Intelligence (AI) and Machine Learning (ML) are weaving their way into the fabric of society, where they are playing a crucial role in numerous facets of our lives. As we witness the increased deployment of AI and ML in various…

Emerging Technologies · Computer Science 2022-12-23 Sasitharan Balasubramaniam , Samitha Somathilaka , Sehee Sun , Adrian Ratwatte , Massimiliano Pierobon

Large language models (LLMs) are a class of artificial intelligence models based on deep learning, which have great performance in various tasks, especially in natural language processing (NLP). Large language models typically consist of…

Quantitative Methods · Quantitative Biology 2025-02-04 Jiajia Liu , Mengyuan Yang , Yankai Yu , Haixia Xu , Tiangang Wang , Kang Li , Xiaobo Zhou

Capturing molecular knowledge with representation learning approaches holds significant potential in vast scientific fields such as chemistry and life science. An effective and generalizable molecular representation is expected to capture…

Machine Learning · Computer Science 2024-06-17 Yizhen Luo , Kai Yang , Massimo Hong , Xing Yi Liu , Zikun Nie , Hao Zhou , Zaiqing Nie

Large Language Models (LLMs) with their strong task-handling capabilities have shown remarkable advancements across a spectrum of fields, moving beyond natural language understanding. However, their proficiency within the chemistry domain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Khiem Le , Zhichun Guo , Kaiwen Dong , Xiaobao Huang , Bozhao Nan , Roshni Iyer , Xiangliang Zhang , Olaf Wiest , Wei Wang , Ting Hua , Nitesh V. Chawla

The rapid development of Artificial Intelligence (AI) has revolutionized numerous fields, with large language models (LLMs) and computer vision (CV) systems driving advancements in natural language understanding and visual processing,…

Computation and Language · Computer Science 2024-12-04 Yunkai Dang , Kaichen Huang , Jiahao Huo , Yibo Yan , Sirui Huang , Dongrui Liu , Mengxi Gao , Jie Zhang , Chen Qian , Kun Wang , Yong Liu , Jing Shao , Hui Xiong , Xuming Hu

Molecular Relational Learning (MRL) aims to understand interactions between molecular pairs, playing a critical role in advancing biochemical research. With the recent development of large language models (LLMs), a growing number of studies…

Machine Learning · Computer Science 2025-06-03 Zhuo Chen , Yizhen Zheng , Huan Yee Koh , Hongxin Xiang , Linjiang Chen , Wenjie Du , Yang Wang

Artificial intelligence (AI) is reshaping computational and network biology by enabling new approaches to decode cellular communication networks. We introduce Hierarchical Molecular Language Models (HMLMs), a novel framework that models…

Molecular Networks · Quantitative Biology 2025-12-16 Hasi Hays , Yue Yu , William J. Richardson