English
Related papers

Related papers: Memory Matching Networks for Genomic Sequence Clas…

200 papers

RNA motifs typically consist of short, modular patterns that include base pairs formed within and between modules. Estimating the abundance of these patterns is of fundamental importance for assessing the statistical significance of matches…

Probability · Mathematics 2007-05-23 Manuel Lladser , M. D. Betterton , Rob Knight

Most tasks in natural language processing can be cast into question answering (QA) problems over language input. We introduce the dynamic memory network (DMN), a neural network architecture which processes input sequences and questions,…

Computation and Language · Computer Science 2016-03-08 Ankit Kumar , Ozan Irsoy , Peter Ondruska , Mohit Iyyer , James Bradbury , Ishaan Gulrajani , Victor Zhong , Romain Paulus , Richard Socher

Graph neural networks (GNNs) have emerged as powerful tools for learning protein structures by capturing spatial relationships at the residue level. However, existing GNN-based methods often face challenges in learning multiscale…

Machine Learning · Computer Science 2026-02-03 Shih-Hsin Wang , Yuhao Huang , Taos Transue , Justin Baker , Jonathan Forstater , Thomas Strohmer , Bao Wang

We introduce and train distributed neural architectures (DNA) in vision and language domains. DNAs are initialized with a proto-architecture that consists of (transformer, MLP, attention, etc.) modules and routers. Any token (or patch) can…

Machine Learning · Computer Science 2025-06-30 Aditya Cowsik , Tianyu He , Andrey Gromov

Knotted molecules occur naturally and are designed by scientists to gain special biological and material properties. Understanding and utilizing knotting require efficient methods to recognize and generate knotted structures, which are…

Computational Physics · Physics 2025-01-23 Zhiyu Zhang , Yongjian Zhu , Liang Dai

Inferring the structural properties of a protein from its amino acid sequence is a challenging yet important problem in biology. Structures are not known for the vast majority of protein sequences, but structure is critical for…

Machine Learning · Computer Science 2019-10-17 Tristan Bepler , Bonnie Berger

Deep neural networks (DNNs) can easily fit a random labeling of the training data with zero training error. What is the difference between DNNs trained with random labels and the ones trained with true labels? Our paper answers this…

Machine Learning · Computer Science 2019-11-22 Jindong Gu , Volker Tresp

The conventional way of identifying DNA motifs, solely based on match alignment information, is susceptible to a high number of spurious sites. A novel scoring system has been introduced by taking both match and mismatch alignment…

Quantitative Methods · Quantitative Biology 2014-03-03 Jian-Jun Shu , Kian Yan Yong

Developing models with high interpretability and even deriving formulas to quantify relationships between biological data is an emerging need. We propose here a framework for ab initio derivation of sequence motifs and linear formula using…

Quantitative Methods · Quantitative Biology 2022-08-23 Chengyu Liu , Wei Wang

Structure based ligand discovery is one of the most successful approaches for augmenting the drug discovery process. Currently, there is a notable shift towards machine learning (ML) methodologies to aid such procedures. Deep learning has…

Machine Learning · Statistics 2018-06-12 Marta M. Stepniewska-Dziubinska , Piotr Zielenkiewicz , Pawel Siedlecki

The goal of protein representation learning is to extract knowledge from protein databases that can be applied to various protein-related downstream tasks. Although protein sequence, structure, and function are the three key modalities for…

Biomolecules · Quantitative Biology 2024-05-14 Eunji Ko , Seul Lee , Minseon Kim , Dongki Kim

This paper describes a process for combining patterns and features, to guide a search process and make predictions. It is based on the functionality that a human brain might have, which is a highly distributed network of simple neuronal…

Artificial Intelligence · Computer Science 2021-01-05 Kieran Greer

The classification of amino acids and their sequence analysis plays a vital role in life sciences and is a challenging task. This article uses and compares state-of-the-art deep learning models like convolution neural networks (CNN), long…

Biomolecules · Quantitative Biology 2022-07-26 Sarwar Khan , Faisal Ghaffar , Imad Ali , Qazi Mazhar

Splice sites play a crucial role in gene expression, and accurate prediction of these sites in DNA sequences is essential for diagnosing and treating genetic disorders. We address the challenge of splice site prediction by introducing…

Genomics · Quantitative Biology 2023-11-23 Asmita Poddar , Vladimir Uzun , Elizabeth Tunbridge , Wilfried Haerty , Alejo Nevado-Holgado

Bayesian network models are finding success in characterizing enzyme-catalyzed reactions, slow conformational changes, predicting enzyme inhibition, and genomics. In this work, we apply them to statistical modeling of peptides by…

Applications · Statistics 2018-10-09 Rainier Barrett , Shaoyi Jiang , Andrew D White

Breakthroughs in deep learning and memory networks have made major advances in natural language understanding. Language is sequential and information carried through the sequence can be captured through memory networks. Learning the…

Computation and Language · Computer Science 2023-05-22 Anupiya Nugaliyadde

DNA language models are increasingly used to represent genomic sequence, yet their effectiveness depends critically on how raw nucleotides are converted into model inputs. Unlike natural language, DNA offers no canonical boundaries, making…

Genomics · Quantitative Biology 2026-05-21 Taewon Kim , Jihwan Shin , Hyomin Kim , Youngmok Jung , Jonghoon Lee , Won-Chul Lee , Sungsoo Ahn , Insu Han

The increasing number of protein sequences decoded from genomes is opening up new avenues of research on linking protein sequence to function with transformer neural networks. Recent research has shown that the number of known protein…

Machine Learning · Computer Science 2022-06-23 Anowarul Kabir , Amarda Shehu

Data of sequential nature arise in many application domains in forms of, e.g. textual data, DNA sequences, and software execution traces. Different research disciplines have developed methods to learn sequence models from such datasets: (i)…

Machine Learning · Statistics 2018-11-02 Niek Tax , Irene Teinemaa , Sebastiaan J. van Zelst

Complex networks have been characterised by their specific connectivity patterns (network motifs), but their building blocks can also be identified and described by node-motifs---a combination of local network features. One technique to…