English
Related papers

Related papers: Aligning Proteins and Language: A Foundation Model…

200 papers

Protein one-dimensional (1D) structures such as secondary structure and contact number provide intuitive pictures to understand how the native three-dimensional (3D) structure of a protein is encoded in the amino acid sequence. However, it…

Biomolecules · Quantitative Biology 2007-05-23 Akira R. Kinjo , Ken Nishikawa

Protein language models (pLMs) produce per-residue representations that capture evolutionary and structural information, yet their mean-pooled sequence embeddings are not explicitly trained to reflect functional, evolutionary or structural…

Machine Learning · Computer Science 2026-05-11 Dan Ofer , Oriel Perets , Michal Linial , Nadav Rappoport

Structural templates are 3D signatures representing protein functional sites, such as ligand binding cavities, metal coordination motifs or catalytic sites. Here we explore methods to generate template libraries and algorithms to query…

Biomolecules · Quantitative Biology 2022-03-08 Ioannis G. Riziotis , Janet M. Thornton

Despite the constant evolution of similarity searching research, it continues to face the same challenges stemming from the complexity of the data, such as the curse of dimensionality and computationally expensive distance functions.…

Information Retrieval · Computer Science 2022-10-06 Jaroslav Oľha , Terézia Slanináková , Martin Gendiar , Matej Antol , Vlastislav Dohnal

Protein design aims to compose amino-acid sequences that fold into stable three-dimensional structures while satisfying targeted functional properties. The field is increasingly shifting toward vibe protein design, where a single model is…

Due to the advancements in technology number of entries in the structural database of proteins are increasing day by day. Methods for retrieving protein tertiary structures from this large database is the key to comparative analysis of…

Computer Vision and Pattern Recognition · Computer Science 2014-09-03 Rezaul Karim , Mohd. Momin Al Aziz , Swakkhar Shatabda , M. Sohel Rahman , Md. Abul Kashem Mia , Farhana Zaman , Salman Rakin

Multi-modality pre-training paradigm that aligns protein sequences and biological descriptions has learned general protein representations and achieved promising performance in various downstream applications. However, these works were…

Machine Learning · Computer Science 2024-12-31 Hanjing Zhou , Mingze Yin , Wei Wu , Mingyang Li , Kun Fu , Jintai Chen , Jian Wu , Zheng Wang

Protein language models (PLMs) learn probability distributions over natural protein sequences. By learning from hundreds of millions of natural protein sequences, protein understanding and design capabilities emerge. Recent works have shown…

Quantitative Methods · Quantitative Biology 2026-02-27 Timothy Fei Truong , Tristan Bepler

The objective in this paper is to improve the performance of text-to-image retrieval. To this end, we introduce a new framework that can boost the performance of large-scale pre-trained vision-language models, so that they can be used for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Guanqi Zhan , Yuanpei Liu , Kai Han , Weidi Xie , Andrew Zisserman

Vision-language models (VLMs) like CLIP have been cherished for their ability to perform zero-shot visual recognition on open-vocabulary concepts. This is achieved by selecting the object category whose textual representation bears the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Shaunak Halbe , Junjiao Tian , K J Joseph , James Seale Smith , Katherine Stevo , Vineeth N Balasubramanian , Zsolt Kira

We introduce a pioneering methodology for boosting large language models in the domain of protein representation learning. Our primary contribution lies in the refinement process for correlating the over-reliance on co-evolution knowledge,…

Artificial Intelligence · Computer Science 2024-12-05 Yaoyao Xu , Xinjian Zhao , Xiaozhuang Song , Benyou Wang , Tianshu Yu

Protein research is crucial in various fundamental disciplines, but understanding their intricate structure-function relationships remains challenging. Recent Large Language Models (LLMs) have made significant strides in comprehending…

Computational Engineering, Finance, and Science · Computer Science 2025-01-24 Chao Wang , Hehe Fan , Ruijie Quan , Yi Yang

Recent computational advances in the accurate prediction of protein three-dimensional (3D) structures from amino acid sequences now present a unique opportunity to decipher the interrelationships between proteins. This task entails--but is…

Biomolecules · Quantitative Biology 2020-05-19 Menuka Jaiswal , Saad Saleem , Yonghyeon Kweon , Eli J Draizen , Stella Veretnik , Cameron Mura , Philip E. Bourne

As the structural databases continue to expand, efficient methods are required to search similar structures of the query structure from the database. There are many previous works about comparing protein 3D structures and scanning the…

Databases · Computer Science 2011-02-16 Gook-Pil Roh , Seung-won Hwang , Byoung-Kee Yi

A method to search for local structural similarities in proteins at atomic resolution is presented. It is demonstrated that a huge amount of structural data can be handled within a reasonable CPU time by using a conventional relational…

Biomolecules · Quantitative Biology 2007-12-28 Akira R. Kinjo , Haruki Nakamura

AI-based in silico methods have improved protein structure prediction but often struggle with large protein complexes (PCs) involving multiple interacting proteins due to missing 3D spatial cues. Experimental techniques like Cryo-EM are…

Motivation: Assessing the match between two biomolecular structures is at the heart of structural analyses such as superposition, alignment and docking. These tasks are typically solved with specialized structure-matching techniques…

Biomolecules · Quantitative Biology 2024-01-23 Michael Habeck , Andreas Kröpelin , Nima Vakili

Representation learning and \emph{de novo} generation of proteins are pivotal computational biology tasks. Whilst natural language processing (NLP) techniques have proven highly effective for protein sequence modelling, structure modelling…

Quantitative Methods · Quantitative Biology 2025-01-08 Benoit Gaujac , Jérémie Donà , Liviu Copoiu , Timothy Atkinson , Thomas Pierrot , Thomas D. Barrett

Photo search, the task of retrieving images based on textual queries, has witnessed significant advancements with the introduction of CLIP (Contrastive Language-Image Pretraining) model. CLIP leverages a vision-language pre training…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 Naresh Kumar Lahajal , Harini S

Vision-language models (VLMs) like CLIP have showcased a remarkable ability to extract transferable features for downstream tasks. Nonetheless, the training process of these models is usually based on a coarse-grained contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Ali Abdollah , Amirmohammad Izadi , Armin Saghafian , Reza Vahidimajd , Mohammad Mozafari , Amirreza Mirzaei , Mohammadmahdi Samiei , Mahdieh Soleymani Baghshah