中文
相关论文

相关论文: Transformers in Protein: A Survey

200 篇论文

Recent advancements in immune sequencing and experimental techniques are generating extensive T cell receptor (TCR) repertoire data, enabling the development of models to predict TCR binding specificity. Despite the computational challenges…

定量方法 · 定量生物学 2024-07-24 Anna Weber , Aurélien Pélissier , María Rodríguez Martínez

Graph transformers are a recent advancement in machine learning, offering a new class of neural network models for graph-structured data. The synergy between transformers and graph learning demonstrates strong performance and versatility…

机器学习 · 计算机科学 2025-12-23 Ahsan Shehzad , Feng Xia , Shagufta Abid , Ciyuan Peng , Shuo Yu , Dongyu Zhang , Karin Verspoor

Understanding Transformer-based models has attracted significant attention, as they lie at the heart of recent technological advances across machine learning. While most interpretability methods rely on running models over inputs, recent…

计算与语言 · 计算机科学 2023-12-27 Guy Dar , Mor Geva , Ankit Gupta , Jonathan Berant

Numerous cellular functions rely on protein$\unicode{x2013}$protein interactions. Efforts to comprehensively characterize them remain challenged however by the diversity of molecular recognition mechanisms employed within the proteome. Deep…

生物大分子 · 定量生物学 2023-12-08 Julia R. Rogers , Gergő Nikolényi , Mohammed AlQuraishi

At the intersection of the rapidly growing biological data landscape and advancements in Natural Language Processing (NLP), protein language models (PLMs) have emerged as a transformative force in modern research. These models have achieved…

生物大分子 · 定量生物学 2025-02-12 Lei Wang , Xudong Li , Han Zhang , Jinyi Wang , Dingkang Jiang , Zhidong Xue , Yan Wang

Transformers have become the architecture of choice for learning long-range dependencies, yet their adoption in hyperspectral imaging (HSI) is still emerging. We reviewed more than 300 papers published up to 2025 and present the first…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Guyang Zhang , Waleed Abdulla

Intrinsically disordered proteins and regions are increasingly appreciated for their abundance in the proteome and the many functional roles they play in the cell. In this short review, we describe a variety of approaches used to obtain…

生物物理 · 物理学 2024-12-31 Zi Hao Liu , Maria Tsanai , Oufan Zhang , Teresa Head-Gordon , Julie Forman-Kay

The prediction of protein interactions (CPIs) is crucial for the in-silico screening step in drug discovery. Recently, many end-to-end representation learning methods using deep neural networks have achieved significantly better performance…

定量方法 · 定量生物学 2020-11-30 Jingtao Wang , Xi Li , Hua Zhang

While many good textbooks are available on Protein Structure, Molecular Simulations, Thermodynamics and Bioinformatics methods in general, there is no good introductory level book for the field of Structural Bioinformatics. This book aims…

Deep Learning (DL) algorithms hold great promise for applications in the field of computational biophysics. In fact, the vast amount of available molecular structures, as well as their notable complexity, constitutes an ideal context in…

软凝聚态物质 · 物理学 2019-01-07 Marco Giulini , Raffaello Potestio

Deep learning models are often evaluated in scenarios where the data distribution is different from those used in the training and validation phases. The discrepancy presents a challenge for accurately predicting the performance of models…

计算机视觉与模式识别 · 计算机科学 2024-10-17 Shadi Alijani , Jamil Fayyad , Homayoun Najjaran

Deep learning has deeply influenced protein science, enabling breakthroughs in predicting protein properties, higher-order structures, and molecular interactions. This paper introduces DeepProtein, a comprehensive and user-friendly deep…

机器学习 · 计算机科学 2025-06-17 Jiaqing Xie , Tianfan Fu

This paper presents a comprehensive survey of research works on the topic of form understanding in the context of scanned documents. We delve into recent advancements and breakthroughs in the field, highlighting the significance of language…

计算与语言 · 计算机科学 2024-03-08 Abdelrahman Abdallah , Daniel Eberharter , Zoe Pfister , Adam Jatowt

Conventional machine learning algorithms have traditionally been designed under the assumption that input data follows a vector-based format, with an emphasis on vector-centric paradigms. However, as the demand for tasks involving set-based…

机器学习 · 计算机科学 2024-04-01 Masanari Kimura , Ryotaro Shimizu , Yuki Hirakawa , Ryosuke Goto , Yuki Saito

Transformers have had a significant impact on natural language processing and have recently demonstrated their potential in computer vision. They have shown promising results over convolution neural networks in fundamental computer vision…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Rojina Kashefi , Leili Barekatain , Mohammad Sabokrou , Fatemeh Aghaeipoor

While many good textbooks are available on Protein Structure, Molecular Simulations, Thermodynamics and Bioinformatics methods in general, there is no good introductory level book for the field of Structural Bioinformatics. This book aims…

While many good textbooks are available on Protein Structure, Molecular Simulations, Thermodynamics and Bioinformatics methods in general, there is no good introductory level book for the field of Structural Bioinformatics. This book aims…

生物大分子 · 定量生物学 2023-07-10 K. Anton Feenstra , Sanne Abeln

Transformers have dominated empirical machine learning models of natural language processing. In this paper, we introduce basic concepts of Transformers and present key techniques that form the recent advances of these models. This includes…

计算与语言 · 计算机科学 2023-11-30 Tong Xiao , Jingbo Zhu

The introduction of Transformers architecture has brought about significant breakthroughs in Deep Learning (DL), particularly within Natural Language Processing (NLP). Since their inception, Transformers have outperformed many traditional…

机器人学 · 计算机科学 2024-12-17 Nikunj Sanghai , Nik Bear Brown

Many aspects of the study of protein folding and dynamics have been affected by the recent advances in machine learning. Methods for the prediction of protein structures from their sequences are now heavily based on machine learning tools.…

生物物理 · 物理学 2019-11-25 Frank Noé , Gianni De Fabritiis , Cecilia Clementi