English
Related papers

Related papers: Graph Neural Networks for Contextual ASR with the …

200 papers

Text classification plays a vital role today especially with the intensive use of social networking media. Recently, different architectures of convolutional neural networks have been used for text classification in which one-hot vector,…

Computation and Language · Computer Science 2019-03-12 Amr Adel Helmy , Yasser M. K. Omar , Rania Hodhod

Graph structured data, specifically text-attributed graphs (TAG), effectively represent relationships among varied entities. Such graphs are essential for semi-supervised node classification tasks. Graph Neural Networks (GNNs) have emerged…

Machine Learning · Computer Science 2024-04-18 Kaiwen Dong , Zhichun Guo , Nitesh V. Chawla

Recently Graph Neural Network (GNN) has been applied successfully to various NLP tasks that require reasoning, such as multi-hop machine reading comprehension. In this paper, we consider a novel case where reasoning is needed over graphs…

Computation and Language · Computer Science 2020-04-13 Ming Tu , Jing Huang , Xiaodong He , Bowen Zhou

We propose a novel convolutional architecture, named $gen$CNN, for word sequence prediction. Different from previous work on neural network-based language modeling and generation (e.g., RNN or LSTM), we choose not to greedily summarize the…

Computation and Language · Computer Science 2015-04-27 Mingxuan Wang , Zhengdong Lu , Hang Li , Wenbin Jiang , Qun Liu

Textual data question answering has gained significant attention due to its growing applicability. Recently, a novel approach leveraging the Retrieval-Augmented Generation (RAG) method was introduced, utilizing the Prize-Collecting Steiner…

Machine Learning · Computer Science 2025-04-22 Manthankumar Solanki

Detecting abusive language in social media conversations poses significant challenges, as identifying abusiveness often depends on the conversational context, characterized by the content and topology of preceding comments. Traditional…

Computation and Language · Computer Science 2025-04-03 Célia Nouri , Jean-Philippe Cointet , Chloé Clavel

Text encoders based on C-DSSM or transformers have demonstrated strong performance in many Natural Language Processing (NLP) tasks. Low latency variants of these models have also been developed in recent years in order to apply them in the…

Computation and Language · Computer Science 2021-05-04 Jason Yue Zhu , Yanling Cui , Yuming Liu , Hao Sun , Xue Li , Markus Pelger , Tianqi Yang , Liangjie Zhang , Ruofei Zhang , Huasha Zhao

This work addresses the task of generating English sentences from Abstract Meaning Representation (AMR) graphs. To cope with this task, we transform each input AMR graph into a structure similar to a dependency tree and annotate it with…

Computation and Language · Computer Science 2017-07-25 Timo Schick

There is a growing interest in the speech community in developing Recurrent Neural Network Transducer (RNN-T) models for automatic speech recognition (ASR) applications. RNN-T is trained with a loss function that does not enforce temporal…

Computation and Language · Computer Science 2020-11-20 Jay Mahadeokar , Yuan Shangguan , Duc Le , Gil Keren , Hang Su , Thong Le , Ching-Feng Yeh , Christian Fuegen , Michael L. Seltzer

End-to-end modeling (E2E) of automatic speech recognition (ASR) blends all the components of a traditional speech recognition system into a unified model. Although it simplifies training and decoding pipelines, the unified model is hard to…

Computation and Language · Computer Science 2018-12-06 Zhehuai Chen , Mahaveer Jain , Yongqiang Wang , Michael L. Seltzer , Christian Fuegen

Feedforward Neural Network (FNN)-based language models estimate the probability of the next word based on the history of the last N words, whereas Recurrent Neural Networks (RNN) perform the same task based only on the last word and some…

Computation and Language · Computer Science 2017-03-24 Youssef Oualil , Clayton Greenberg , Mittul Singh , Dietrich Klakow

Graph neural networks (GNNs) model representations from networked data and allow for decentralized inference through localized communications. Existing GNN architectures often assume ideal communications and ignore potential channel…

Signal Processing · Electrical Eng. & Systems 2024-05-22 Zhan Gao , Deniz Gunduz

Neural sequence-to-sequence systems deliver state-of-the-art performance for automatic speech recognition (ASR). When using appropriate modeling units, e.g., byte-pair encoded characters, these systems are in principal open vocabulary…

Computation and Language · Computer Science 2021-07-07 Christian Huber , Juan Hussain , Sebastian Stüker , Alexander Waibel

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Recently, techniques for applying convolutional neural networks to graph-structured data have emerged. Graph convolutional neural networks (GCNNs) have been used to address node and graph classification and matrix completion. Although the…

Machine Learning · Statistics 2018-11-28 Yingxue Zhang , Soumyasundar Pal , Mark Coates , Deniz Üstebay

Compared to sequential learning models, graph-based neural networks exhibit excellent ability in capturing global information and have been used for semi-supervised learning tasks. Most Graph Convolutional Networks are designed with the…

Computation and Language · Computer Science 2022-04-12 Kunze Wang , Soyeon Caren Han , Siqu Long , Josiah Poon

Knowledge graph-grounded dialog generation requires retrieving a dialog-relevant subgraph from the given knowledge base graph and integrating it with the dialog history. Previous works typically represent the graph using an external…

Computation and Language · Computer Science 2024-10-15 Jinyoung Park , Minseok Joo , Joo-Kyung Kim , Hyunwoo J. Kim

Current graph representation learning techniques use Graph Neural Networks (GNNs) to extract features from dataset embeddings. In this work, we examine the quality of these embeddings and assess how changing them can affect the accuracy of…

Machine Learning · Computer Science 2022-11-30 S. Purchase , A. Zhao , R. D. Mullins

We propose a novel architecture for Graph Neural Networks that is inspired by the idea behind Tree Kernels of measuring similarity between trees by taking into account their common substructures, named fragments. By imposing a series of…

Computation and Language · Computer Science 2021-10-04 Federico Ruggeri , Marco Lippi , Paolo Torroni

We propose an end-to-end Automatic Speech Recognition (ASR) system that can be trained on transcribed speech data, text-only data, or a mixture of both. The proposed model uses an integrated auxiliary block for text-based training. This…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-08 Vladimir Bataev , Roman Korostik , Evgeny Shabalin , Vitaly Lavrukhin , Boris Ginsburg