English
Related papers

Related papers: MolMole: Molecule Mining from Scientific Literatur…

200 papers

Extracting structured information from visual documents (Visual Information Extraction, VIE) is a cornerstone of business automation. While recent Multimodal Large Language Models (MLLMs) have shown promising capabilities, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Yandi Wang , Libin Zhan , Ziwei Huang , Tiancheng Luo , Yuxuan Jiang , Wang Dong , Leilei Gan , Jun Chen

How to effectively represent molecules is a long-standing challenge for molecular property prediction and drug discovery. This paper studies this problem and proposes to incorporate chemical domain knowledge, specifically related to…

Machine Learning · Computer Science 2023-05-04 Liang Zeng , Lanqing Li , Jian Li

Designing a neural network architecture for molecular representation is crucial for AI-driven drug discovery and molecule design. In this work, we propose a new framework for molecular representation learning. Our contribution is threefold:…

Machine Learning · Computer Science 2022-10-18 Jiye Kim , Seungbeom Lee , Dongwoo Kim , Sungsoo Ahn , Jaesik Park

Large Vision-Language Models (LVLMs) have achieved remarkable performance in many vision-language tasks, yet their capabilities in fine-grained visual understanding remain insufficiently evaluated. Existing benchmarks either contain limited…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Fengbin Zhu , Ziyang Liu , Xiang Yao Ng , Haohui Wu , Wenjie Wang , Fuli Feng , Chao Wang , Huanbo Luan , Tat Seng Chua

Text-rich document understanding (TDU) requires comprehensive analysis of documents containing substantial textual content and complex layouts. While Multimodal Large Language Models (MLLMs) have achieved fast progress in this domain,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Wenhui Liao , Jiapeng Wang , Hongliang Li , Chengyu Wang , Jun Huang , Lianwen Jin

Toxicity remains a leading cause of early-stage drug development failure. Despite advances in molecular design and property prediction, the task of molecular toxicity repair, generating structurally valid molecular alternatives with reduced…

Artificial Intelligence · Computer Science 2026-01-29 Fei Lin , Ziyang Gong , Cong Wang , Tengchao Zhang , Yonglin Tian , Yining Jiang , Ji Dai , Chao Guo , Xiaotong Yu , Xue Yang , Gen Luo , Fei-Yue Wang

Geometric deep learning (GDL) has demonstrated huge power and enormous potential in molecular data analysis. However, a great challenge still remains for highly efficient molecular representations. Currently, covalent-bond-based molecular…

Computational Physics · Physics 2023-06-28 Cong Shen , Jiawei Luo , Kelin Xia

Retrieving molecular structures from tandem mass spectra is a crucial step in rapid compound identification. Existing retrieval methods, such as traditional mass spectral library matching, suffer from limited spectral library coverage,…

Machine Learning · Computer Science 2025-11-11 Yiwen Zhang , Keyan Ding , Yihang Wu , Xiang Zhuang , Yi Yang , Qiang Zhang , Huajun Chen

The remarkable success of Large Language Models (LLMs) across diverse tasks has driven the research community to extend their capabilities to molecular applications. However, most molecular LLMs employ adapter-based architectures that do…

Computation and Language · Computer Science 2025-06-24 Shuhan Guo , Yatao Bian , Ruibing Wang , Nan Yin , Zhen Wang , Quanming Yao

Document Visual Question Answering (DocVQA) faces dual challenges in processing lengthy multimodal documents (text, images, tables) and performing cross-modal reasoning. Current document retrieval-augmented generation (DocRAG) methods…

Information Retrieval · Computer Science 2025-11-10 Kuicai Dong , Yujing Chang , Shijie Huang , Yasheng Wang , Ruiming Tang , Yong Liu

Human expertise in chemistry and biomedicine relies on contextual molecular understanding, a capability that large language models (LLMs) can extend through fine-grained alignment between molecular structures and text. Recent multimodal…

Computation and Language · Computer Science 2025-03-10 Sumin Ha , Jun Hyeong Kim , Yinhua Piao , Sun Kim

We address the extraction of mathematical statements and their proofs from scholarly PDF articles as a multimodal classification problem, utilizing text, font features, and bitmap image renderings of PDFs as distinct modalities. We propose…

Artificial Intelligence · Computer Science 2024-10-14 Shrey Mishra , Antoine Gauquier , Pierre Senellart

In recent years, self-supervised learning has emerged as a powerful tool to harness abundant unlabelled data for representation learning and has been broadly adopted in diverse areas. However, when applied to molecular representation…

Machine Learning · Computer Science 2024-02-22 Han Tang , Shikun Feng , Bicheng Lin , Yuyan Ni , JIngjing Liu , Wei-Ying Ma , Yanyan Lan

Artificial Intelligence (AI)-aided drug discovery is an active research field, yet AI models often exhibit poor accuracy in regression tasks for molecular property prediction, and perform catastrophically poorly for out-of-distribution…

Machine Learning · Computer Science 2026-01-06 Xiaoyu Fan , Lin Guo , Ruizhen Jia , Yang Tian , Zhihao Yang , Weihao Li , Boxue Tian

The generation of molecules with desired properties has become increasingly popular, revolutionizing the way scientists design molecular structures and providing valuable support for chemical and drug design. However, despite the potential…

Machine Learning · Computer Science 2024-03-05 Yin Fang , Ningyu Zhang , Zhuo Chen , Lingbing Guo , Xiaohui Fan , Huajun Chen

A molecule's properties are fundamentally determined by its composition and structure encoded in its molecular graph. Thus, reasoning about molecular properties requires the ability to parse and understand the molecular graph. Large…

Machine Learning · Computer Science 2026-01-22 Christoph Bartmann , Johannes Schimunek , Mykyta Ielanskyi , Philipp Seidl , Günter Klambauer , Sohvi Luukkonen

Most molecular diagram parsers recover chemical structure from raster images (e.g., PNGs). However, many PDFs include commands giving explicit locations and shapes for characters, lines, and polygons. We present a new parser that uses these…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Ayush Kumar Shah , Bryan Manrique Amador , Abhisek Dey , Ming Creekmore , Blake Ocampo , Scott Denmark , Richard Zanibbi

Reproducibility of computational results remains a challenge in materials science, as simulation workflows and parameters are often reported only in unstructured text and tables. While literature data are valuable for validation and reuse,…

In scientific research, the ability to effectively retrieve relevant documents based on complex, multifaceted queries is critical. Existing evaluation datasets for this task are limited, primarily due to the high cost and effort required to…

Information Retrieval · Computer Science 2023-10-31 Jianyou Wang , Kaicheng Wang , Xiaoyue Wang , Prudhviraj Naidu , Leon Bergen , Ramamohan Paturi

Molecular Dynamics (MD) simulations are ubiquitous in cutting-edge physio-chemical research. They provide critical insights into how a physical system evolves over time given a model of interatomic interactions. Understanding a system's…

Computational Physics · Physics 2023-09-06 Rostyslav Hnatyshyn , Jieqiong Zhao , Danny Perez , James Ahrens , Ross Maciejewski