English
Related papers

Related papers: FoldToken: Learning Protein Language via Vector Qu…

200 papers

Language models typically tokenize text into subwords, using a deterministic, hand-engineered heuristic of combining characters into longer surface-level strings such as 'ing' or whole words. Recent literature has repeatedly shown the…

Computation and Language · Computer Science 2023-10-19 Avijit Thawani , Saurabh Ghanekar , Xiaoyuan Zhu , Jay Pujara

Protein structure prediction is pivotal for understanding the structure-function relationship of proteins, advancing biological research, and facilitating pharmaceutical development and experimental design. While deep learning methods and…

Machine Learning · Computer Science 2024-12-30 Kaihui Cheng , Ce Liu , Qingkun Su , Jun Wang , Liwei Zhang , Yining Tang , Yao Yao , Siyu Zhu , Yuan Qi

Tokenization is a fundamental component of language models for code. It involves breaking down the input into units that are later passed to the language model stack to learn high-dimensional representations used in various contexts, from…

Software Engineering · Computer Science 2025-07-22 Mootez Saad , Hao Li , Tushar Sharma , Ahmed E. Hassan

The advent of deep learning has introduced efficient approaches for de novo protein sequence design, significantly improving success rates and reducing development costs compared to computational or experimental methods. However, existing…

Artificial Intelligence · Computer Science 2024-07-11 Yutong Hu , Yang Tan , Andi Han , Lirong Zheng , Liang Hong , Bingxin Zhou

We present SceneTok, a novel tokenizer for encoding view sets of scenes into a compressed and diffusable set of unstructured tokens. Existing approaches for 3D scene representation and generation commonly use 3D data structures or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Mohammad Asim , Christopher Wewer , Jan Eric Lenssen

Evolutionally conserved quantity that specifies folding nuclei is pursued by a case study for a small protein (PDB code: 1ten). First it is demonstrated that the sequences of amino acids at folding nuclei are not conserved. Then 3D…

Biological Physics · Physics 2007-05-23 S. Nakamura , O. Narikiyo

We introduce a pipeline for representing a protein, or protein complex, as the union of signed distance functions (SDFs) by representing each atom as a sphere with the appropriate radius. While this idea has been used previously as a way to…

Biomolecules · Quantitative Biology 2025-08-19 Cory B. Scott , Charlie Rothschild , Benjamin Nye

Deep learning has made significant progress in protein structure prediction, advancing the development of computational biology. However, despite the high accuracy achieved in predicting single-chain structures, a significant number of…

Biomolecules · Quantitative Biology 2024-03-08 Zhaoqun Li , Jingcheng Yu , Qiwei Ye

Protein representation learning aims to learn informative protein embeddings capable of addressing crucial biological questions, such as protein function prediction. Although sequence-based transformer models have shown promising results by…

Quantitative Methods · Quantitative Biology 2024-10-22 Michail Chatzianastasis , Yang Zhang , George Dasoulas , Michalis Vazirgiannis

Image tokenization has enabled major advances in autoregressive image generation by providing compressed, discrete representations that are more efficient to process than raw pixels. While traditional approaches use 2D grid tokenization,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Roman Bachmann , Jesse Allardice , David Mizrahi , Enrico Fini , Oğuzhan Fatih Kar , Elmira Amirloo , Alaaeldin El-Nouby , Amir Zamir , Afshin Dehghan

Motivation: Protein folding is a dynamic process during which a protein's amino acid sequence undergoes a series of 3-dimensional (3D) conformational changes en route to reaching a native 3D structure; the resulting 3D structural…

Biomolecules · Quantitative Biology 2026-04-09 Aydin Wells , Khalique Newaz , Jennifer Morones , Jianlin Cheng , Tijana Milenković

Motivation Protein fold recognition is an important problem in structural bioinformatics. Almost all traditional fold recognition methods use sequence (homology) comparison to indirectly predict the fold of a tar get protein based on the…

Machine Learning · Computer Science 2017-06-06 Jie Hou , Badri Adhikari , Jianlin Cheng

Multimodal models that jointly reason over protein sequences, structures, and function annotations within a unified representation hold immense potential for integrating multimodal data and generating new proteins with designed functional…

Biomolecules · Quantitative Biology 2026-05-12 Nabin Giri , Steven Farrell , Kristofer E. Bouchard

Although machine learning has transformed protein structure prediction of folded protein ground states with remarkable accuracy, intrinsically disordered proteins and regions (IDPs/IDRs) are defined by diverse and dynamical structural…

Biomolecules · Quantitative Biology 2025-04-01 Oufan Zhang , Zi Hao Liu , Julie D Forman-Kay , Teresa Head-Gordon

While all the information required for the folding of a protein is contained in its amino acid sequence, one has not yet learnt how to extract this information so as to predict the detailed, biological active, three-dimensional structure of…

Condensed Matter · Physics 2007-05-23 R. A. Broglia , G. Tiana

Structure-based drug discovery faces the dual challenge of accurately capturing 3D protein-ligand interactions while navigating ultra-large chemical spaces to identify synthetically accessible candidates. In this work, we present a unified…

Machine Learning · Computer Science 2026-04-22 Carles Navarro , Philipp Tholke , Gianni de Fabritiis

Molecular dynamics (MD) is a central computational tool in physics, chemistry, and biology, enabling quantitative prediction of experimental observables as expectations over high-dimensional molecular distributions such as Boltzmann…

Machine Learning · Computer Science 2026-02-13 Panagiotis Antoniadis , Beatrice Pavesi , Simon Olsson , Ole Winther

Building a working mental model of a protein typically requires weeks of reading, cross-referencing crystal and predicted structures, and inspecting ligand complexes, an effort that is slow, unevenly accessible, and often requires…

Biomolecules · Quantitative Biology 2025-10-22 Carles Navarro , Mariona Torrens , Philipp Thölke , Stefan Doerr , Gianni De Fabritiis

Designing novel functional proteins crucially depends on accurately modeling their fitness landscape. Given the limited availability of functional annotations from wet-lab experiments, previous methods have primarily relied on…

Machine Learning · Computer Science 2024-12-03 Zuobai Zhang , Pascal Notin , Yining Huang , Aurélie Lozano , Vijil Chenthamarakshan , Debora Marks , Payel Das , Jian Tang

The protein backbone is described as a smooth curved and twisted line in three-dimensional (3D) space and characterized by its curvature $\kappa(s)$ and torsion $\tau(s)$ both expressed as a function of arc length s. It is shown that the…

Biomolecules · Quantitative Biology 2008-11-24 Sushilee Ranganathan , Dmitry Izotov , Elfi Kraka , Dieter Cremer