English
Related papers

Related papers: SaDiT: Efficient Protein Backbone Design via Laten…

200 papers

Developing effective representations of protein structures is essential for advancing protein science, particularly for protein generative modeling. Current approaches often grapple with the complexities of the SE(3) manifold, rely on…

Machine Learning · Computer Science 2025-10-14 Shaoning Li , Le Zhuo , Yusong Wang , Mingyu Li , Xinheng He , Fandi Wu , Hongsheng Li , Pheng-Ann Heng

Designing protein sequences with specific biological functions and structural stability is crucial in biology and chemistry. Generative models already demonstrated their capabilities for reliable protein design. However, previous models are…

Machine Learning · Computer Science 2024-02-28 Lin Zongying , Li Hao , Lv Liuzhenghao , Lin Bin , Zhang Junwu , Chen Calvin Yu-Chian , Yuan Li , Tian Yonghong

Tokenization is a promising path to multi-modal models capable of jointly understanding protein sequences, structure, and function. Existing protein structure tokenizers create tokens by pooling information from local neighborhoods, an…

Machine Learning · Computer Science 2026-02-09 Rohit Dilip , Ayush Varshney , David Van Valen

Multimodal models that jointly reason over protein sequences, structures, and function annotations within a unified representation hold immense potential for integrating multimodal data and generating new proteins with designed functional…

Biomolecules · Quantitative Biology 2026-05-12 Nabin Giri , Steven Farrell , Kristofer E. Bouchard

Background: It is necessary and essential to discovery protein function from the novel primary sequences. Wet lab experimental procedures are not only time-consuming, but also costly, so predicting protein structure and function reliably…

Quantitative Methods · Quantitative Biology 2017-03-09 Quan Zou , Shixiang Wan , Ying Ju , Jijun Tang , Xiangxiang Zeng

Diffusion models with their powerful expressivity and high sample quality have achieved State-Of-The-Art (SOTA) performance in the generative domain. The pioneering Vision Transformer (ViT) has also demonstrated strong modeling capabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Ali Hatamizadeh , Jiaming Song , Guilin Liu , Jan Kautz , Arash Vahdat

In-context generation significantly enhances Diffusion Transformers (DiTs) by enabling controllable image-to-image generation through reference examples. However, the resulting input concatenation drastically increases sequence length,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Junqing Lin , Xingyu Zheng , Pei Cheng , Bin Fu , Jingwei Sun , Guangzhong Sun

Protein structure tokenizers enable the creation of multimodal models of protein structure, sequence, and function. Current approaches to protein structure tokenization rely on bespoke components that are invariant to spatial symmetries,…

Machine Learning · Computer Science 2025-10-02 Rohit Dilip , Evan Zhang , Ayush Varshney , David Van Valen

Recently, Vision Transformer (ViT) has continuously established new milestones in the computer vision field, while the high computation and memory cost makes its propagation in industrial production difficult. Pruning, a traditional model…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Zhenglun Kong , Peiyan Dong , Xiaolong Ma , Xin Meng , Mengshu Sun , Wei Niu , Xuan Shen , Geng Yuan , Bin Ren , Minghai Qin , Hao Tang , Yanzhi Wang

Proteins perform critical processes in all living systems: converting solar energy into chemical energy, replicating DNA, as the basis of highly performant materials, sensing and much more. While an incredible range of functionality has…

Biomolecules · Quantitative Biology 2021-09-29 Leonardo V. Castorina , Rokas Petrenas , Kartic Subr , Christopher W. Wood

Designing protein-binding proteins with high affinity is critical in biomedical research and biotechnology. Despite recent advancements targeting specific proteins, the ability to create high-affinity binders for arbitrary protein targets…

Machine Learning · Computer Science 2025-11-03 Zhenqiao Song , Tiaoxiao Li , Lei Li , Martin Renqiang Min

Diffusion Transformer (DiT), an emerging diffusion model for image generation, has demonstrated superior performance but suffers from substantial computational costs. Our investigations reveal that these costs stem from the static inference…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Wangbo Zhao , Yizeng Han , Jiasheng Tang , Kai Wang , Yibing Song , Gao Huang , Fan Wang , Yang You

High-quality training datasets are crucial for the development of effective protein design models, but existing synthetic datasets often include unfavorable sequence-structure pairs, impairing generative model performance. We leverage…

Nature creates diverse proteins through a 'divide and assembly' strategy. Inspired by this idea, we introduce ProteinWeaver, a two-stage framework for protein backbone design. Our method first generates individual protein domains and then…

Biomolecules · Quantitative Biology 2024-11-28 Yiming Ma , Fei Ye , Yi Zhou , Zaixiang Zheng , Dongyu Xue , Quanquan Gu

Diffusion Transformers (DiT) are powerful generative models but remain computationally intensive due to their iterative structure and deep transformer stacks. To alleviate this inefficiency, we propose \textbf{FastCache}, a…

Machine Learning · Computer Science 2026-03-30 Dong Liu , Yanxuan Yu , Jiayi Zhang , Yifan Li , Ben Lengerich , Ying Nian Wu

Designing protein binders targeting specific sites, which requires to generate realistic and functional interaction patterns, is a fundamental challenge in drug discovery. Current structure-based generative models are limited in generating…

Machine Learning · Computer Science 2025-10-17 Zishen Zhang , Xiangzhe Kong , Wenbing Huang , Yang Liu

Predicting drug-target interaction (DTI) is critical in the drug discovery process. Despite remarkable advances in recent DTI models through the integration of representations from diverse drug and target encoders, such models often…

Quantitative Methods · Quantitative Biology 2025-09-30 Zhaohan Meng , Zaiqiao Meng , Ke Yuan , Iadh Ounis

Deep learning has been widely used for protein engineering. However, it is limited by the lack of sufficient experimental data to train an accurate model for predicting the functional fitness of high-order mutants. Here, we develop SESNet,…

Quantitative Methods · Quantitative Biology 2023-04-10 Mingchen Li , Liqi Kang , Yi Xiong , Yu Guang Wang , Guisheng Fan , Pan Tan , Liang Hong

Deep learning has transformed protein design, enabling accurate structure prediction, sequence optimization, and de novo protein generation. Advances in single-chain protein structure prediction via AlphaFold2, RoseTTAFold, ESMFold, and…

Machine Learning · Computer Science 2025-02-27 Gregory W. Kyro , Tianyin Qiu , Victor S. Batista

Recent years have witnessed a surge in the development of protein structural tokenization methods, which chunk protein 3D structures into discrete or continuous representations. Structure tokenization enables the direct application of…

Quantitative Methods · Quantitative Biology 2025-06-26 Xinyu Yuan , Zichen Wang , Marcus Collins , Huzefa Rangwala