English
Related papers

Related papers: Integrating Bidirectional Long Short-Term Memory w…

200 papers

Bidirectional Long Short-Term Memory (LSTM) is a special kind of Recurrent Neural Network (RNN) architecture which is designed to model sequences and their long-range dependencies more precisely than RNNs. This paper proposes to use deep…

Machine Learning · Computer Science 2020-04-07 Neda Tavakoli

Matching natural language sentences is central for many applications such as information retrieval and question answering. Existing deep models rely on a single sentence representation or multiple granularity representations for matching.…

Artificial Intelligence · Computer Science 2015-11-30 Shengxian Wan , Yanyan Lan , Jiafeng Guo , Jun Xu , Liang Pang , Xueqi Cheng

This work investigates an alternative model for neural machine translation (NMT) and proposes a novel architecture, where we employ a multi-dimensional long short-term memory (MDLSTM) for translation modeling. In the state-of-the-art…

Computation and Language · Computer Science 2018-10-10 Parnia Bahar , Christopher Brix , Hermann Ney

Long Short-Term Memory (LSTM) is a recurrent neural network (RNN) architecture that has been designed to address the vanishing and exploding gradient problems of conventional RNNs. Unlike feedforward neural networks, RNNs have cyclic…

Neural and Evolutionary Computing · Computer Science 2014-02-06 Haşim Sak , Andrew Senior , Françoise Beaufays

Deep learning mechanisms are prevailing approaches in recent days for the various tasks in natural language processing, speech recognition, image processing and many others. To leverage this we use deep learning based mechanism specifically…

Computation and Language · Computer Science 2019-01-03 Vidya Prasad K , Akarsh S , Vinayakumar R , Soman KP

Deep neural networks have shown good data modelling capabilities when dealing with challenging and large datasets from a wide range of application areas. Convolutional Neural Networks (CNNs) offer advantages in selecting good features and…

Computation and Language · Computer Science 2018-11-02 Abdulaziz M. Alayba , Vasile Palade , Matthew England , Rahat Iqbal

A wide range of Deep Natural Language Processing (NLP) models integrates continuous and low dimensional representations of words and documents. Surprisingly, very few models study representation learning for authors. These representations…

Computation and Language · Computer Science 2025-06-27 Enzo Terreau , Antoine Gourru , Julien Velcin

Despite the success of deep learning on many fronts especially image and speech, its application in text classification often is still not as good as a simple linear SVM on n-gram TF-IDF representation especially for smaller datasets. Deep…

Computation and Language · Computer Science 2017-05-31 Zhenzhou Wu , Xin Zheng , Daniel Dahlmeier

Writing style is a combination of consistent decisions at different levels of language production including lexical, syntactic, and structural associated to a specific author (or author groups). While lexical-based models have been widely…

Computation and Language · Computer Science 2019-02-28 Fereshteh Jafariakinabad , Sansiri Tarnpradab , Kien A. Hua

This paper investigates the impact of word-based RNN language models (RNN-LMs) on the performance of end-to-end automatic speech recognition (ASR). In our prior work, we have proposed a multi-level LM, in which character-based and…

Computation and Language · Computer Science 2018-08-09 Takaaki Hori , Jaejin Cho , Shinji Watanabe

The large language based-model chatbot ChatGPT gained a lot of popularity since its launch and has been used in a wide range of situations. This research centers around a particular situation, when the ChatGPT is used to produce news that…

Computation and Language · Computer Science 2023-10-26 Amanda Ferrari Iaquinta , Gustavo Voltani von Atzingen

Video captioning has been attracting broad research attention in multimedia community. However, most existing approaches either ignore temporal information among video frames or just employ local contextual temporal knowledge. In this work,…

Multimedia · Computer Science 2016-06-16 Yi Bin , Yang Yang , Zi Huang , Fumin Shen , Xing Xu , Heng Tao Shen

Handwritten word recognition from document images using deep learning is an active research area in the field of Document Image Analysis and Recognition. In the present era of Big data, since more and more documents are being generated and…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Bulla Rajesh , Abhishek Kumar Gupta , Ayush Raj , Mohammed Javed , Shiv Ram Dubey

In practice, training language models for individual authors is often expensive because of limited data resources. In such cases, Neural Network Language Models (NNLMs), generally outperform the traditional non-parametric N-gram models.…

Computation and Language · Computer Science 2016-02-18 Zhenhao Ge , Yufang Sun , Mark J. T. Smith

Recent state-of-the-art authorship attribution methods learn authorship representations of texts in a latent, non-interpretable space, hindering their usability in real-world applications. Our work proposes a novel approach to interpreting…

Computation and Language · Computer Science 2024-09-12 Milad Alshomary , Narutatsu Ri , Marianna Apidianaki , Ajay Patel , Smaranda Muresan , Kathleen McKeown

This paper illustrates the details description of technical text classification system and its results that developed as a part of participation in the shared task TechDofication 2020. The shared task consists of two sub-tasks: (i) first…

Computation and Language · Computer Science 2020-12-22 Omar Sharif , Eftekhar Hossain , Mohammed Moshiul Hoque

Named entity recognition is a challenging task that has traditionally required large amounts of knowledge in the form of feature engineering and lexicons to achieve high performance. In this paper, we present a novel neural network…

Computation and Language · Computer Science 2016-07-20 Jason P. C. Chiu , Eric Nichols

Characters have commonly been regarded as the minimal processing unit in Natural Language Processing (NLP). But many non-latin languages have hieroglyphic writing systems, involving a big alphabet with thousands or millions of characters.…

Computation and Language · Computer Science 2018-01-08 Han He , Lei Wu , Xiaokun Yang , Hua Yan , Zhimin Gao , Yi Feng , George Townsend

With the rapid development of Natural Language Processing (NLP) technology, the accuracy and efficiency of machine translation have become hot topics of research. This paper proposes a novel Seq2Seq model aimed at improving translation…

Computation and Language · Computer Science 2024-11-01 Yuxu Wu , Yiren Xing

We present a comprehensive study of deep bidirectional long short-term memory (LSTM) recurrent neural network (RNN) based acoustic models for automatic speech recognition (ASR). We study the effect of size and depth and train models of up…

Neural and Evolutionary Computing · Computer Science 2019-08-06 Albert Zeyer , Patrick Doetsch , Paul Voigtlaender , Ralf Schlüter , Hermann Ney