English
Related papers

Related papers: BioMedGPT-Mol: Multi-task Learning for Molecular U…

200 papers

This study aims to explore the performance improvement method of large language models based on GPT-4 under the multi-task learning framework and conducts experiments on two tasks: text classification and automatic summary generation.…

Computation and Language · Computer Science 2024-12-10 Zhen Qi , Jiajing Chen , Shuo Wang , Bingying Liu , Hongye Zheng , Chihang Wang

To advance biomedical vison-language model capabilities through scaling up, fine-tuning, and instruction tuning, develop vision-language models with improved performance in handling long text, explore strategies to efficiently adopt vision…

Artificial Intelligence · Computer Science 2025-05-26 Cheng Peng , Kai Zhang , Mengxian Lyu , Hongfang Liu , Lichao Sun , Yonghui Wu

Molecular optimization is a crucial yet complex and time-intensive process that often acts as a bottleneck for drug development. Traditional methods rely heavily on trial and error, making multi-objective optimization both time-consuming…

Biomolecules · Quantitative Biology 2025-03-06 Jiajun Yu , Yizhen Zheng , Huan Yee Koh , Shirui Pan , Tianyue Wang , Haishuai Wang

Large language models (LLMs), especially Explicit Long Chain-of-Thought (CoT) reasoning models like DeepSeek-R1 and QWQ, have demonstrated powerful reasoning capabilities, achieving impressive performance in commonsense reasoning and…

Computation and Language · Computer Science 2025-08-13 Jiatong Li , Weida Wang , Qinggang Zhang , Junxian Li , Di Zhang , Changmeng Zheng , Shufei Zhang , Xiaoyong Wei , Qing Li

Traditional biomedical artificial intelligence (AI) models, designed for specific tasks or modalities, often exhibit limited flexibility in real-world deployment and struggle to utilize holistic information. Generalist AI holds the…

The integration of biomolecular modeling with natural language (BL) has emerged as a promising interdisciplinary area at the intersection of artificial intelligence, chemistry and biology. This approach leverages the rich, multifaceted…

Computation and Language · Computer Science 2025-12-01 Qizhi Pei , Zhimeng Zhou , Kaiyuan Gao , Jinhua Zhu , Yue Wang , Zun Wang , Tao Qin , Lijun Wu , Rui Yan

Long-term biomolecular dynamics are critical for understanding key evolutionary transformations in molecular systems. However, capturing these processes requires extended simulation timescales that often exceed the practical limits of…

Quantitative Methods · Quantitative Biology 2025-07-04 Wenqi Zeng , Lu Zhang , Yuan Yao

Generative tasks about molecules, including but not limited to molecule generation, are crucial for drug discovery and material design, and have consistently attracted significant attention. In recent years, diffusion models have emerged as…

Machine Learning · Computer Science 2025-02-14 Liang Wang , Chao Song , Zhiyuan Liu , Yu Rong , Qiang Liu , Shu Wu , Liang Wang

We discover a robust self-supervised strategy tailored towards molecular representations for generative masked language models through a series of tailored, in-depth ablations. Using this pre-training strategy, we train BARTSmiles, a…

Large Language Models (LLMs) have made great strides in areas such as language processing and computer vision. Despite the emergence of diverse techniques to improve few-shot learning capacity, current LLMs fall short in handling the…

Biomolecules · Quantitative Biology 2024-05-14 Xianggen Liu , Yan Guo , Haoran Li , Jin Liu , Shudong Huang , Bowen Ke , Jiancheng Lv

Molecular generative models, often employing GPT-style language modeling on molecular string representations, have shown promising capabilities when scaled to large datasets and model sizes. However, it remains unclear and subject to debate…

Machine Learning · Computer Science 2026-02-02 Dong Xu , Qihua Pan , Sisi Yuan , Jianqiang Li , Zexuan Zhu , Junkai Ji

Recent advances in reasoning with large language models (LLMs)has shown remarkable reasoning capabilities in domains such as mathematics and coding, yet their application to clinical diagnosis remains underexplored. Here, we introduce…

Computation and Language · Computer Science 2025-04-16 Wuyang Lan , Wenzheng Wang , Changwei Ji , Guoxing Yang , Yongbo Zhang , Xiaohong Liu , Song Wu , Guangyu Wang

Capturing molecular knowledge with representation learning approaches holds significant potential in vast scientific fields such as chemistry and life science. An effective and generalizable molecular representation is expected to capture…

Machine Learning · Computer Science 2024-06-17 Yizhen Luo , Kai Yang , Massimo Hong , Xing Yi Liu , Zikun Nie , Hao Zhou , Zaiqing Nie

Large Language Models (LLMs), particularly those similar to ChatGPT, have significantly influenced the field of Natural Language Processing (NLP). While these models excel in general language tasks, their performance in domain-specific…

Computation and Language · Computer Science 2024-01-02 Omid Rohanian , Mohammadmahdi Nouriborji , David A. Clifton

Large Language Models (LLMs) stand at the forefront of a number of Natural Language Processing (NLP) tasks. Despite the widespread adoption of LLMs in NLP, much of their potential in broader fields remains largely unexplored, and…

Machine Learning · Computer Science 2024-03-11 Zhiqiang Zhong , Kuangyu Zhou , Davide Mottin

Large Language Models (LLMs) are central to the one-for-all intelligent paradigm, but they face a fundamental challenge when dealing with heterogeneous scientific data such as molecules: the inherent gap between discrete linguistic symbols…

Artificial Intelligence · Computer Science 2026-05-22 Yuxuan Chen , Changwei Lv , Yunduo Xiao , Zhongjing Du , Daquan Zhou , Yukun Yan , Zheni Zeng , Zhiyuan Liu

Recent advances in large language models (LLMs) have shown impressive ability in biomedical question-answering, but have not been adequately investigated for more specific biomedical applications. This study investigates the performance of…

Computation and Language · Computer Science 2024-03-29 Shan Chen , Yingya Li , Sheng Lu , Hoang Van , Hugo JWL Aerts , Guergana K. Savova , Danielle S. Bitterman

Molecular representation learning is crucial for the problem of molecular property prediction, where graph neural networks (GNNs) serve as an effective solution due to their structure modeling capabilities. Since labeled data is often…

Machine Learning · Computer Science 2023-09-26 Cameron Diao , Kaixiong Zhou , Zirui Liu , Xiao Huang , Xia Hu

Pretrained language models have served as important backbones for natural language processing. Recently, in-domain pretraining has been shown to benefit various domain-specific downstream tasks. In the biomedical domain, natural language…

Computation and Language · Computer Science 2022-04-25 Hongyi Yuan , Zheng Yuan , Ruyi Gan , Jiaxing Zhang , Yutao Xie , Sheng Yu

Molecular representation learning plays a crucial role in advancing applications such as drug discovery and material design. Existing work leverages 2D and 3D modalities of molecular information for pre-training, aiming to capture…

Machine Learning · Computer Science 2025-10-09 Tengwei Song , Min Wu , Yuan Fang