English
Related papers

Related papers: Bridging the Gap Between Molecule and Textual Desc…

200 papers

Recently, large language models (LLMs) have shown significant progress, approaching human perception levels. In this work, we demonstrate that despite these advances, LLMs still struggle to reason using molecular structural information.…

Machine Learning · Computer Science 2025-05-26 Yunhui Jang , Jaehyung Kim , Sungsoo Ahn

Fine-grained image-text alignment is a pivotal challenge in multimodal learning, underpinning key applications such as visual question answering, image captioning, and vision-language navigation. Unlike global alignment, fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jiale Liu , Haoming Zhou , Yishu Liu , Bingzhi Chen , Yuncheng Jiang

Understanding how chemical perturbations propagate through biological systems is essential for robust molecular property prediction. While most existing methods focus on chemical structures alone, recent advances highlight the crucial role…

Machine Learning · Computer Science 2025-11-27 Mengran Li , Zelin Zang , Wenbin Xing , Junzhou Chen , Ronghui Zhang , Jiebo Luo , Stan Z. Li

Drug discovery aims to find novel compounds with specified chemical property profiles. In terms of generative modeling, the goal is to learn to sample molecules in the intersection of multiple property constraints. This task becomes…

Machine Learning · Computer Science 2020-07-06 Wengong Jin , Regina Barzilay , Tommi Jaakkola

Large language models (LLMs) exhibit strong general intelligence, yet their multilingual performance remains highly imbalanced. Although LLMs encode substantial cross-lingual knowledge in a unified semantic space, they often struggle to…

Computation and Language · Computer Science 2026-04-17 Mengyu Bu , Yang Feng

Recent multimodal models such as Contrastive Language-Image Pre-training (CLIP) have shown remarkable ability to align visual and linguistic representations. However, domains where small visual differences carry large semantic significance,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Hiroshi Sasaki

Accurate molecular property prediction is a critical challenge with wide-ranging applications in chemistry, materials science, and drug discovery. Molecular representation methods, including fingerprints and graph neural networks (GNNs),…

Machine Learning · Computer Science 2025-08-13 Jiaxin Ju , Yizhen Zheng , Huan Yee Koh , Can Wang , Shirui Pan

In recent years, Multimodal Large Language Models (MLLMs) have achieved remarkable progress on a wide range of multimodal benchmarks. Despite these advances, most existing benchmarks mainly focus on single-image or multi-image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Bingli Wang , Huanze Tang , Haijun Lv , Zhishan Lin , Lixin Gu , Lei Feng , Qipeng Guo , Kai Chen

Molecular Relational Learning (MRL) aims to understand interactions between molecular pairs, playing a critical role in advancing biochemical research. With the recent development of large language models (LLMs), a growing number of studies…

Machine Learning · Computer Science 2025-06-03 Zhuo Chen , Yizhen Zheng , Huan Yee Koh , Hongxin Xiang , Linjiang Chen , Wenjie Du , Yang Wang

Small-molecule foundation models are typically pretrained on standalone molecular data, unlike vision and language models that often benefit from cross-modal or relational supervision. Protein-ligand co-folding provides a molecular analogue…

Biomolecules · Quantitative Biology 2026-05-25 Hyosoon Jang , Hyunjin Seo , Honghui Kim , Seonghyun Park , Taewon Kim , Yunhui Jang , Sungsoo Ahn

Recent research in molecular discovery has primarily been devoted to small, drug-like molecules, leaving many similarly important applications in material design without adequate technology. These applications often rely on more complex…

Neural visual decoding is a central problem in brain computer interface research, aiming to reconstruct human visual perception and to elucidate the structure of neural representations. However, existing approaches overlook a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Yang Du , Siyuan Dai , Yonghao Song , Paul M. Thompson , Haoteng Tang , Liang Zhan

Molecular representation learning plays an essential role in cheminformatics. Recently, language model-based approaches have gained popularity as an alternative to traditional expert-designed features to encode molecules. However, these…

Machine Learning · Computer Science 2022-04-19 Zhihui Guo , Pramod Sharma , Andy Martinez , Liang Du , Robin Abraham

We present MolLingo, a multi-agent system that emulates the reasoning process of a chemist to automate molecular design. Existing LLM-based approaches either operate as standalone generative models without access to external tools or lack…

Artificial Intelligence · Computer Science 2026-05-28 Thao Nguyen , Heng Ji

Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent…

Machine Learning · Computer Science 2024-09-16 Xiaohua Lu , Liangxu Xie , Lei Xu , Rongzhi Mao , Shan Chang , Xiaojun Xu

Large Language Models (LLMs) stand at the forefront of a number of Natural Language Processing (NLP) tasks. Despite the widespread adoption of LLMs in NLP, much of their potential in broader fields remains largely unexplored, and…

Machine Learning · Computer Science 2024-03-11 Zhiqiang Zhong , Kuangyu Zhou , Davide Mottin

Multimodal retrieval, which seeks to retrieve relevant content across modalities such as text or image, supports applications from AI search to contents production. Despite the success of separate-encoder approaches like CLIP align…

Computation and Language · Computer Science 2025-10-20 Qiyu Wu , Shuyang Cui , Satoshi Hayakawa , Wei-Yao Wang , Hiromi Wakaki , Yuki Mitsufuji

Recent advances in molecular representation integrates molecular topological and visual modalities, opening new avenues for precise Molecular Relational Learning (MRL). Existing MRL methods focus on intra-domain modeling, and their inherent…

Machine Learning · Computer Science 2026-05-25 Peiliang Zhang , Jingling Yuan , Shiqing Wu , Mengqing Hu , Chao Che , Yongjun Zhu , Lin Li

With the rapid increase of compound databases available in medicinal and material science, there is a growing need for learning representations of molecules in a semi-supervised manner. In this paper, we propose an unsupervised hierarchical…

Machine Learning · Statistics 2017-11-30 Hai Nguyen , Shin-ichi Maeda , Kenta Oono

Pretrained language models (LMs) showcase significant capabilities in processing molecular text, while concurrently, message passing neural networks (MPNNs) demonstrate resilience and versatility in the domain of molecular science. Despite…

Machine Learning · Computer Science 2025-06-17 Jiaqing Xie , Ziheng Chi