UniGenX: a unified generative foundation model that couples sequence, structure and function to accelerate scientific design across proteins, molecules and materials
Abstract
Function in natural systems arises from one-dimensional sequences forming three-dimensional structures with specific properties. However, current generative models suffer from critical limitations: training objectives seldom target function directly, discrete sequences and continuous coordinates are optimized in isolation, and conformational ensembles are under-modeled. We present UniGenX, a unified generative foundation model that addresses these gaps by co-generating sequences and coordinates under direct functional and property objectives across proteins, molecules, and materials. UniGenX represents heterogeneous inputs as a mixed stream of symbolic and numeric tokens, where a decoder-only autoregressive transformer provides global context and a conditional diffusion head generates numeric fields steered by task-specific tokens. Besides the new high SOTAs on structure prediction tasks, the model demonstrates state-of-the-art or competitive performance for the function-aware generation across domains: in materials, it achieves "conflicted" multi-property conditional generation, yielding 436 crystal candidates meeting triple constraints, including 11 with novel compositions; in chemistry, it sets new benchmarks on five property targets and conformer ensemble generation on GEOM; and in biology, it improves success in modeling protein induced fit (RMSD < 2 {\AA}) by over 23-fold and enhances EC-conditioned enzyme design. Ablation studies and cross-domain transfer substantiate the benefits of joint discrete-continuous training, establishing UniGenX as a significant advance from prediction to controllable, function-aware generation.
Keywords
Cite
@article{arxiv.2503.06687,
title = {UniGenX: a unified generative foundation model that couples sequence, structure and function to accelerate scientific design across proteins, molecules and materials},
author = {Gongbo Zhang and Yanting Li and Renqian Luo and Pipi Hu and Yang Yang and Zeru Zhao and Lingbo Li and Guoqing Liu and Zun Wang and Ran Bi and Kaiyuan Gao and Liya Guo and Yu Xie and Chang Liu and Jia Zhang and Tian Xie and Robert Pinsler and Claudio Zeni and Ziheng Lu and Hongxia Hao and Yingce Xia and Marwin Segler and Maik Riechert and Wei Yang and Hao Jiang and Wen-Bin Zhang and Zhijun Zeng and Yi Zhu and Li Dong and Xiuyuan Hu and Li Yuan and Lei Chen and Haiguang Liu and Tao Qin},
journal= {arXiv preprint arXiv:2503.06687},
year = {2025}
}