English
Related papers

Related papers: SG-Net: Syntax-Guided Machine Reading Comprehensio…

200 papers

Scene text recognition is a challenging task due to the complex backgrounds and diverse variations of text instances. In this paper, we propose a novel Semantic GAN and Balanced Attention Network (SGBANet) to recognize the texts in scene…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Dajian Zhong , Shujing Lyu , Palaiahnakote Shivakumara , Bing Yin , Jiajia Wu , Umapada Pal , Yue Lu

This paper introduces an improved duration informed attention neural network (DurIAN-E) for expressive and high-fidelity text-to-speech (TTS) synthesis. Inherited from the original DurIAN model, an auto-regressive model structure in which…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-25 Yu Gu , Yianrao Bian , Guangzhi Lei , Chao Weng , Dan Su

Writing style is a combination of consistent decisions at different levels of language production including lexical, syntactic, and structural associated to a specific author (or author groups). While lexical-based models have been widely…

Computation and Language · Computer Science 2019-02-28 Fereshteh Jafariakinabad , Sansiri Tarnpradab , Kien A. Hua

Sentence matching is widely used in various natural language tasks such as natural language inference, paraphrase identification, and question answering. For these tasks, understanding logical and semantic relationship between two sentences…

Computation and Language · Computer Science 2018-11-05 Seonhoon Kim , Inho Kang , Nojun Kwak

Extracting temporal relations (e.g., before, after, and simultaneous) among events is crucial to natural language understanding. One of the key challenges of this problem is that when the events of interest are far away in text, the context…

Computation and Language · Computer Science 2022-10-26 Shuaicheng Zhang , Lifu Huang , Qiang Ning

Sentence compression is the task of compressing a long sentence into a short one by deleting redundant words. In sequence-to-sequence (Seq2Seq) based models, the decoder unidirectionally decides to retain or delete words. Thus, it cannot…

Computation and Language · Computer Science 2020-05-19 Hidetaka Kamigaito , Manabu Okumura

Neural attention, especially the self-attention made popular by the Transformer, has become the workhorse of state-of-the-art natural language processing (NLP) models. Very recent work suggests that the self-attention in the Transformer…

Computation and Language · Computer Science 2020-10-16 Zhengxuan Wu , Thanh-Son Nguyen , Desmond C. Ong

Current end-to-end machine reading and question answering (Q\&A) models are primarily based on recurrent neural networks (RNNs) with attention. Despite their success, these models are often slow for both training and inference due to the…

Computation and Language · Computer Science 2018-04-26 Adams Wei Yu , David Dohan , Minh-Thang Luong , Rui Zhao , Kai Chen , Mohammad Norouzi , Quoc V. Le

Speech Emotion Recognition (SER) task has known significant improvements over the last years with the advent of Deep Neural Networks (DNNs). However, even the most successful methods are still rather failing when adaptation to specific…

Audio and Speech Processing · Electrical Eng. & Systems 2021-04-16 Clément Le Moine , Nicolas Obin , Axel Roebel

In this paper, we present a novel architecture to realize fine-grained style control on the transformer-based text-to-speech synthesis (TransformerTTS). Specifically, we model the speaking style by extracting a time sequence of local style…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-18 Li-Wei Chen , Alexander Rudnicky

Transformer architectures show significant promise for natural language processing. Given that a single pretrained model can be fine-tuned to perform well on many different tasks, these networks appear to extract generally useful linguistic…

Machine Learning · Computer Science 2019-10-29 Andy Coenen , Emily Reif , Ann Yuan , Been Kim , Adam Pearce , Fernanda Viégas , Martin Wattenberg

Sign language recognition and translation first uses a recognition module to generate glosses from sign language videos and then employs a translation module to translate glosses into spoken sentences. Most existing works focus on the…

Computation and Language · Computer Science 2023-05-26 Yong Cao , Wei Li , Xianzhi Li , Min Chen , Guangyong Chen , Long Hu , Zhengdao Li , Hwang Kai

The spoken language serves as an accessible and efficient interface, enabling non-experts and disabled users to interact with complex assistant robots. However, accurately grounding language utterances gives a significant challenge due to…

Robotics · Computer Science 2024-04-16 Dohyun Kim , Yeseung Kim , Jaehwi Jang , Minjae Song , Woojin Choi , Daehyung Park

We introduce a novel approach to incorporate syntax into natural language inference (NLI) models. Our method uses contextual token-level vector representations from a pretrained dependency parser. Like other contextual embedders, our method…

Computation and Language · Computer Science 2019-09-19 Deric Pang , Lucy H. Lin , Noah A. Smith

The spatial attention mechanism captures long-range dependencies by aggregating global contextual information to each query location, which is beneficial for semantic segmentation. In this paper, we present a sparse spatial attention…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Mengyu Liu , Hujun Yin

In this paper, we propose Double Supervised Network with Attention Mechanism (DSAN), a novel end-to-end trainable framework for scene text recognition. It incorporates one text attention module during feature extraction which enforces the…

Computer Vision and Pattern Recognition · Computer Science 2019-10-23 Yuting Gao , Zheng Huang , Yuchen Dai , Cheng Xu , Kai Chen , Jie Tuo

Speech synthesis is used in a wide variety of industries. Nonetheless, it always sounds flat or robotic. The state of the art methods that allow for prosody control are very cumbersome to use and do not allow easy tuning. To tackle some of…

Sound · Computer Science 2021-10-08 Enrique Hortal , Rodrigo Brechard Alarcia

A straightforward approach to context-aware neural machine translation consists in feeding the standard encoder-decoder architecture with a window of consecutive sentences, formed by the current sentence and a number of sentences from its…

Computation and Language · Computer Science 2022-10-25 Lorenzo Lupo , Marco Dinarelli , Laurent Besacier

Structured State Spaces for Sequences (S4) is a recently proposed sequence model with successful applications in various tasks, e.g. vision, language modeling, and audio. Thanks to its mathematical formulation, it compresses its input to a…

Computation and Language · Computer Science 2023-04-26 Ali Vardasbi , Telmo Pessoa Pires , Robin M. Schmidt , Stephan Peitz

Unsupervised cross-lingual transfer involves transferring knowledge between languages without explicit supervision. Although numerous studies have been conducted to improve performance in such tasks by focusing on cross-lingual knowledge,…

Computation and Language · Computer Science 2024-04-26 Jianyu Zheng , Fengfei Fan , Jianquan Li