English
Related papers

Related papers: Incorporating Copying Mechanism in Sequence-to-Seq…

200 papers

A widely studied non-deterministic polynomial time (NP) hard problem lies in finding a route between the two nodes of a graph. Often meta-heuristics algorithms such as $A^{*}$ are employed on graphs with a large number of nodes. Here, we…

Machine Learning · Computer Science 2018-01-18 Alessandro Bay , Biswa Sengupta

We present a voice conversion solution using recurrent sequence to sequence modeling for DNNs. Our solution takes advantage of recent advances in attention based modeling in the fields of Neural Machine Translation (NMT), Text-to-Speech…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-19 Praveen Narayanan , Punarjay Chakravarty , Francois Charette , Gint Puskorius

Sequence-to-Sequence (seq2seq) models have become overwhelmingly popular in building end-to-end trainable dialogue systems. Though highly efficient in learning the backbone of human-computer communications, they suffer from the problem of…

Computation and Language · Computer Science 2018-10-09 Hui Su , Xiaoyu Shen , Wenjie Li , Dietrich Klakow

We describe and analyze a simple and effective algorithm for sequence segmentation applied to speech processing tasks. We propose a neural architecture that is composed of two modules trained jointly: a recurrent neural network (RNN) module…

Computation and Language · Computer Science 2016-10-26 Yossi Adi , Joseph Keshet , Emily Cibelli , Matthew Goldrick

Recurrent neural networks for session-based recommendation have attracted a lot of attention recently because of their promising performance. repeat consumption is a common phenomenon in many recommendation scenarios (e.g., e-commerce,…

Information Retrieval · Computer Science 2018-12-07 Pengjie Ren , Zhumin Chen , Jing Li , Zhaochun Ren , Jun Ma , Maarten de Rijke

Sequential activation of neurons is a common feature of network activity during a variety of behaviors, including working memory and decision making. Previous network models for sequences and memory emphasized specialized architectures in…

Neurons and Cognition · Quantitative Biology 2016-03-16 Kanaka Rajan , Christopher D Harvey , David W Tank

The prevalent approach to sequence to sequence learning maps an input sequence to a variable length output sequence via recurrent neural networks. We introduce an architecture based entirely on convolutional neural networks. Compared to…

Computation and Language · Computer Science 2017-07-26 Jonas Gehring , Michael Auli , David Grangier , Denis Yarats , Yann N. Dauphin

Traditional sequence-to-sequence (seq2seq) models and other variations of the attention-mechanism such as hierarchical attention have been applied to the text summarization problem. Though there is a hierarchy in the way humans use language…

Machine Learning · Computer Science 2019-11-04 Rajeev Bhatt Ambati , Saptarashmi Bandyopadhyay , Prasenjit Mitra

Recently, Chinese word segmentation (CWS) methods using neural networks have made impressive progress. Most of them regard the CWS as a sequence labeling problem which construct models based on local features rather than considering global…

Computation and Language · Computer Science 2019-12-02 Xuewen Shi , Heyan Huang , Ping Jian , Yuhang Guo , Xiaochi Wei , Yi-Kun Tang

The celebrated Sequence to Sequence learning (Seq2Seq) technique and its numerous variants achieve excellent performance on many tasks. However, many machine learning tasks have inputs naturally represented as graphs; existing Seq2Seq…

Artificial Intelligence · Computer Science 2018-12-04 Kun Xu , Lingfei Wu , Zhiguo Wang , Yansong Feng , Michael Witbrock , Vadim Sheinin

Encoder-decoder models have become an effective approach for sequence learning tasks like machine translation, image captioning and speech recognition, but have yet to show competitive results for handwritten text recognition. To this end,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-16 Johannes Michael , Roger Labahn , Tobias Grüning , Jochen Zöllner

Sequence-to-sequence (seq2seq) approach for low-resource ASR is a relatively new direction in speech research. The approach benefits by performing model training without using lexicon and alignments. However, this poses a new problem of…

Recursive processing in sentence comprehension is considered a hallmark of human linguistic abilities. However, its underlying neural mechanisms remain largely unknown. We studied whether a modern artificial neural network trained with…

Computation and Language · Computer Science 2021-05-04 Yair Lakretz , Dieuwke Hupkes , Alessandra Vergallito , Marco Marelli , Marco Baroni , Stanislas Dehaene

Most recent approaches use the sequence-to-sequence model for paraphrase generation. The existing sequence-to-sequence model tends to memorize the words and the patterns in the training dataset instead of learning the meaning of the words.…

Computation and Language · Computer Science 2018-04-02 Shuming Ma , Xu Sun , Wei Li , Sujian Li , Wenjie Li , Xuancheng Ren

In this paper, we propose a novel deep neural network architecture, Sequence-to-Sequence Audio2Vec, for unsupervised learning of fixed-length vector representations of audio segments excised from a speech corpus, where the vectors contain…

Computation and Language · Computer Science 2017-11-07 Yu-An Chung , James Glass

Sequence-to-sequence (seq2seq) models have been successful across many NLP tasks, including ones that require predicting linguistic structure. However, recent work on compositional generalization has shown that seq2seq models achieve very…

Computation and Language · Computer Science 2022-10-25 Yuekun Yao , Alexander Koller

Semantic parsing has emerged as a significant and powerful paradigm for natural language interface and question answering systems. Traditional methods of building a semantic parser rely on high-quality lexicons, hand-crafted grammars and…

Computation and Language · Computer Science 2017-05-10 Liang Li , Pengyu Li , Yifan Liu , Tao Wan , Zengchang Qin

Character-based neural models have recently proven very useful for many NLP tasks. However, there is a gap of sophistication between methods for learning representations of sentences and words. While most character models for learning…

Computation and Language · Computer Science 2018-10-31 Yingwei Xin , Ethan Hart , Vibhuti Mahajan , Jean-David Ruvini

Recurrent Neural Networks can be trained to produce sequences of tokens given some input, as exemplified by recent results in machine translation and image captioning. The current approach to training them consists of maximizing the…

Machine Learning · Computer Science 2015-09-24 Samy Bengio , Oriol Vinyals , Navdeep Jaitly , Noam Shazeer

Large language models make remarkable progress in reasoning capabilities. Existing works focus mainly on deductive reasoning tasks (e.g., code and math), while another type of reasoning mode that better aligns with human learning, inductive…

Computation and Language · Computer Science 2025-03-18 Kedi Chen , Zhikai Lei , Fan Zhang , Yinqi Zhang , Qin Chen , Jie Zhou , Liang He , Qipeng Guo , Kai Chen , Wei Zhang