English
Related papers

Related papers: Deep Reinforcement Learning For Sequence to Sequen…

200 papers

Modern approaches to text to speech require the entire input character sequence to be processed before any audio is synthesised. This latency limits the suitability of such models for time-sensitive tasks like simultaneous interpretation.…

Audio and Speech Processing · Electrical Eng. & Systems 2021-06-16 Devang S Ram Mohan , Raphael Lenain , Lorenzo Foglianti , Tian Huey Teh , Marlene Staib , Alexandra Torresquintero , Jiameng Gao

We introduce a novel schema for sequence to sequence learning with a Deep Q-Network (DQN), which decodes the output sequence iteratively. The aim here is to enable the decoder to first tackle easier portions of the sequences, and then turn…

Computation and Language · Computer Science 2015-11-02 Hongyu Guo

Countless learning tasks require dealing with sequential data. Image captioning, speech synthesis, and music generation all require that a model produce outputs that are sequences. In other domains, such as time series prediction, video…

Machine Learning · Computer Science 2015-10-20 Zachary C. Lipton , John Berkowitz , Charles Elkan

Recently, various neural encoder-decoder models pioneered by Seq2Seq framework have been proposed to achieve the goal of generating more abstractive summaries by learning to map input text to output text. At a high level, such neural models…

Computation and Language · Computer Science 2023-04-11 Yichong Huang , Xiachong Feng , Xiaocheng Feng , Bing Qin

Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of deep learning, Deep RL (DRL) has witnessed great success over…

Machine Learning · Computer Science 2025-09-01 Yunpeng Qing , Shunyu Liu , Jie Song , Yang Zhou , Kaixuan Chen , Huiqiong Wang , Mingli Song

We discuss deep reinforcement learning in an overview style. We draw a big picture, filled with details. We discuss six core elements, six important mechanisms, and twelve applications, focusing on contemporary work, and in historical…

Machine Learning · Computer Science 2018-10-16 Yuxi Li

Sequence-to-sequence (seq2seq) models have been widely used for natural language processing, computer vision, and other deep learning tasks. We find that seq2seq models trained with early-stopping suffer from issues at the token level. In…

Computation and Language · Computer Science 2023-06-23 Guangsheng Bao , Zhiyang Teng , Yue Zhang

Sequence-to-sequence (seq2seq) voice conversion (VC) models are attractive owing to their ability to convert prosody. Nonetheless, without sufficient data, seq2seq VC models can suffer from unstable training and mispronunciation problems in…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-10 Wen-Chin Huang , Tomoki Hayashi , Yi-Chiao Wu , Hirokazu Kameoka , Tomoki Toda

As human society transitions into the information age, reduction in our attention span is a contingency, and people who spend time reading lengthy news articles are decreasing rapidly and the need for succinct information is higher than…

Computation and Language · Computer Science 2024-03-26 Aditya Saxena , Ashutosh Ranjan

Coherence plays a critical role in producing a high-quality summary from a document. In recent years, neural extractive summarization is becoming increasingly attractive. However, most of them ignore the coherence of summaries when…

Computation and Language · Computer Science 2018-04-20 Yuxiang Wu , Baotian Hu

In recent years, a specific machine learning method called deep learning has gained huge attraction, as it has obtained astonishing results in broad applications such as pattern recognition, speech recognition, computer vision, and natural…

Machine Learning · Computer Science 2018-06-26 Seyed Sajad Mousavi , Michael Schukat , Enda Howley

In this paper, we propose a Deep Reinforcement Learning (RL) framework for task arrangement, which is a critical problem for the success of crowdsourcing platforms. Previous works conduct the personalized recommendation of tasks to workers…

Machine Learning · Computer Science 2019-11-05 Caihua Shan , Nikos Mamoulis , Reynold Cheng , Guoliang Li , Xiang Li , Yuqiu Qian

Automatic text summarization (TS) plays a pivotal role in condensing large volumes of information into concise, coherent summaries, facilitating efficient information retrieval and comprehension. This paper presents a novel framework for…

Computation and Language · Computer Science 2024-04-22 Bhavith Chandra Challagundla , Chakradhar Peddavenkatagari

The integration of deep learning to reinforcement learning (RL) has enabled RL to perform efficiently in high-dimensional environments. Deep RL methods have been applied to solve many complex real-world problems in recent years. However,…

Machine Learning · Computer Science 2021-02-24 Ngoc Duy Nguyen , Thanh Thi Nguyen , Hai Nguyen , Doug Creighton , Saeid Nahavandi

This paper explores the applicability of sequence-to-sequence (Seq2Seq) models based on LSTM units for Automatic Speech Recognition (ASR) task within peer-to-peer learning environments. Leveraging two distinct peer-to-peer learning methods,…

Sound · Computer Science 2024-06-06 Robert Šajina , Ivo Ipšić

In recent years, challenging control problems became solvable with deep reinforcement learning (RL). To be able to use RL for large-scale real-world applications, a certain degree of reliability in their performance is necessary. Reported…

Machine Learning · Computer Science 2020-11-11 Nirnai Rao , Elie Aljalbout , Axel Sauer , Sami Haddadin

The advent of promising quantum error correction (QEC) codes with efficient resource utilization and high-performance fault-tolerant quantum memories signifies a critical step towards realizing practical quantum computation. While surface…

Quantum Physics · Physics 2026-01-28 Yidong Zhou , Lingyi Kong , Yifeng Peng , Zhiding Liang

Deep neural networks are data hungry models and thus face difficulties when attempting to train on small text datasets. Transfer learning is a potential solution but their effectiveness in the text domain is not as explored as in areas such…

Machine Learning · Computer Science 2019-01-28 Yaser Keneshloo , Naren Ramakrishnan , Chandan K. Reddy

Deep reinforcement learning is the combination of reinforcement learning (RL) and deep learning. This field of research has been able to solve a wide range of complex decision-making tasks that were previously out of reach for a machine.…

Machine Learning · Computer Science 2018-12-04 Vincent Francois-Lavet , Peter Henderson , Riashat Islam , Marc G. Bellemare , Joelle Pineau

Reinforcement learning (RL) has demonstrated potential for enhancing reasoning in large language models (LLMs). However, effective RL training, which requires medium-difficulty training samples, faces two fundamental challenges: Effective…

Machine Learning · Computer Science 2026-05-19 Ru Zhang , Renda Li , Ziyu Ma , Weijie Qiu , Chongyang Tao , Yong Wang , Xiangxiang Chu