English
Related papers

Related papers: Zatom-1: Towards a Multimodal Foundation Model for…

200 papers

Generative models have achieved impressive results in many domains including image and text generation. In the natural sciences, generative models have led to rapid progress in automated drug discovery. Many of the current methods focus on…

Machine Learning · Computer Science 2019-09-04 Jordan Hoffmann , Louis Maestrati , Yoshihide Sawada , Jian Tang , Jean Michel Sellier , Yoshua Bengio

Learning representations of molecular structures using deep learning is a fundamental problem in molecular property prediction tasks. Molecules inherently exist in the real world as three-dimensional structures; furthermore, they are not…

Machine Learning · Computer Science 2024-01-22 Daiki Koge , Naoaki Ono , Shigehiko Kanaya

Understanding Earth's subsurface is critical for energy transition, natural hazard mitigation, and planetary science. Yet subsurface analysis remains fragmented, with separate models required for structural interpretation, stratigraphic…

Machine learning models of vastly different modalities and architectures are being trained to predict the behavior of molecules, materials, and proteins. However, it remains unclear whether they learn similar internal representations of…

Machine Learning · Computer Science 2025-12-04 Sathya Edamadaka , Soojung Yang , Ju Li , Rafael Gómez-Bombarelli

Although artificial intelligence (AI) has made significant progress in understanding molecules in a wide range of fields, existing models generally acquire the single cognitive ability from the single molecular modality. Since the hierarchy…

Machine Learning · Computer Science 2022-09-14 Bing Su , Dazhao Du , Zhao Yang , Yujie Zhou , Jiangmeng Li , Anyi Rao , Hao Sun , Zhiwu Lu , Ji-Rong Wen

We study how to generate molecule conformations (i.e., 3D structures) from a molecular graph. Traditional methods, such as molecular dynamics, sample conformations via computationally expensive simulations. Recently, machine learning…

Machine Learning · Computer Science 2021-04-01 Minkai Xu , Shitong Luo , Yoshua Bengio , Jian Peng , Jian Tang

Transition states (TSs) govern the rates and outcomes of chemical reactions, making their accurate prediction a central challenge in computational chemistry. Although recent machine-learning models achieve near chemical accuracy in the…

We study a fundamental problem in structure-based drug design -- generating molecules that bind to specific protein binding sites. While we have witnessed the great success of deep generative models in drug design, the existing methods are…

Biomolecules · Quantitative Biology 2022-11-15 Shitong Luo , Jiaqi Guan , Jianzhu Ma , Jian Peng

Despite recent progress in time-series foundation models, challenges persist in improving representation learning and adapting to diverse downstream tasks. We introduce a General Time-series Model (GTM), which advances representation…

Machine Learning · Computer Science 2026-03-13 Cheng He , Xu Huang , Gangwei Jiang , Zhaoyi Li , Defu Lian , Hong Xie , Enhong Chen , Xijie Liang , Zengrong Zheng , Patrick P. C. Lee

Cryo-EM reconstruction algorithms seek to determine a molecule's 3D density map from a series of noisy, unlabeled 2D projection images captured with an electron microscope. Although reconstruction algorithms typically model the 3D volume as…

Biomolecules · Quantitative Biology 2021-07-06 Ellen D. Zhong , Adam Lerer , Joseph H. Davis , Bonnie Berger

This paper proposes a new 3D molecule generation framework, called GOAT, for fast and effective 3D molecule generation based on the flow-matching optimal transport objective. Specifically, we formulate a geometric transport formula for…

Machine Learning · Computer Science 2025-03-04 Haokai Hong , Wanyu Lin , Kay Chen Tan

The advent of the Transformer architecture has propelled the growth of natural language processing (NLP) models, leading to remarkable achievements in numerous NLP tasks. Yet, the absence of specialized hardware like expansive GPU memory…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-18 Xiaofeng Wu , Jia Rao , Wei Chen

Designing a neural network architecture for molecular representation is crucial for AI-driven drug discovery and molecule design. In this work, we propose a new framework for molecular representation learning. Our contribution is threefold:…

Machine Learning · Computer Science 2022-10-18 Jiye Kim , Seungbeom Lee , Dongwoo Kim , Sungsoo Ahn , Jaesik Park

Generative modeling has become a central paradigm in protein research, extending machine learning beyond structure prediction toward sequence design, backbone generation, inverse folding, and biomolecular interaction modeling. However, the…

Machine Learning · Computer Science 2026-03-30 Senura Hansaja Wanasekara , Minh-Duong Nguyen , Xiaochen Liu , Nguyen H. Tran , Ken-Tye Yong

Traditional drug discovery programs are being transformed by the advent of machine learning methods. Among these, Generative AI methods (GM) have gained attention due to their ability to design new molecules and enhance specific properties…

Scaling large multimodal models (LMMs) to 3D understanding poses unique challenges: point cloud data is sparse and irregular, existing models rely on fragmented architectures with modality-specific encoders, and training pipelines often…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yongyuan Liang , Xiyao Wang , Yuanchen Ju , Jianwei Yang , Furong Huang

3D molecule generation is crucial for drug discovery and material design. While prior efforts focus on 3D diffusion models for their benefits in modeling continuous 3D conformers, they overlook the advantages of 1D SELFIES-based Language…

Quantitative Methods · Quantitative Biology 2025-02-28 Zhiyuan Liu , Yanchen Luo , Han Huang , Enzhi Zhang , Sihang Li , Junfeng Fang , Yaorui Shi , Xiang Wang , Kenji Kawaguchi , Tat-Seng Chua

Generative adversarial networks have led to significant advances in cross-modal/domain translation. However, typically these networks are designed for a specific task (e.g., dialogue generation or image synthesis, but not both). We present…

Computer Vision and Pattern Recognition · Computer Science 2019-07-11 Shuang Ma , Daniel McDuff , Yale Song

Machine learning (ML) outperforms traditional approaches in many molecular design tasks. ML models usually predict molecular properties from a 2D chemical graph or a single 3D structure, but neither of these representations accounts for the…

Computational Physics · Physics 2022-02-11 Simon Axelrod , Rafael Gomez-Bombarelli

Molecular Dynamics (MD) simulations are essential for understanding the atomic-level behavior of molecular systems, giving insights into their transitions and interactions. However, classical MD techniques are limited by the trade-off…

Biomolecules · Quantitative Biology 2026-04-21 Ziyang Yu , Wenbing Huang , Yang Liu