English
Related papers

Related papers: Leveraging Pre-trained Language Model for Speech S…

200 papers

The ability to learn from large unlabeled corpora has allowed neural language models to advance the frontier in natural language understanding. However, existing self-supervision techniques operate at the word form level, which serves as a…

Computation and Language · Computer Science 2020-05-19 Yoav Levine , Barak Lenz , Or Dagan , Ori Ram , Dan Padnos , Or Sharir , Shai Shalev-Shwartz , Amnon Shashua , Yoav Shoham

Labeling explicit discourse relations is one of the most challenging sub-tasks of the shallow discourse parsing where the goal is to identify the discourse connectives and the boundaries of their arguments. The state-of-the-art models…

Computation and Language · Computer Science 2020-06-23 Murathan Kurfalı

In this paper, we study training of automatic speech recognition system in a weakly supervised setting where the order of words in transcript labels of the audio training data is not known. We train a word-level acoustic model which…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-20 Vineel Pratap , Qiantong Xu , Tatiana Likhomanenko , Gabriel Synnaeve , Ronan Collobert

When pre-trained on large unsupervised textual corpora, language models are able to store and retrieve factual knowledge to some extent, making it possible to use them directly for zero-shot cloze-style question answering. However, storing…

Computation and Language · Computer Science 2020-05-12 Fabio Petroni , Patrick Lewis , Aleksandra Piktus , Tim Rocktäschel , Yuxiang Wu , Alexander H. Miller , Sebastian Riedel

In this paper, we propose a variational approach to unsupervised sentiment analysis. Instead of using ground truth provided by domain experts, we use target-opinion word pairs as a supervision signal. For example, in a document snippet "the…

Computation and Language · Computer Science 2020-08-24 Ziqian Zeng , Wenxuan Zhou , Xin Liu , Zizheng Lin , Yangqin Song , Michael David Kuo , Wan Hang Keith Chiu

We consider the cross-domain sentiment classification problem, where a sentiment classifier is to be learned from a source domain and to be generalized to a target domain. Our approach explicitly minimizes the distance between the source…

Computation and Language · Computer Science 2018-09-05 Ruidan He , Wee Sun Lee , Hwee Tou Ng , Daniel Dahlmeier

User modeling is critical for many personalized web services. Many existing methods model users based on their behaviors and the labeled data of target tasks. However, these methods cannot exploit useful information in unlabeled user…

Information Retrieval · Computer Science 2020-10-06 Chuhan Wu , Fangzhao Wu , Tao Qi , Jianxun Lian , Yongfeng Huang , Xing Xie

User interaction with voice-powered agents generates large amounts of unlabeled utterances. In this paper, we explore techniques to efficiently transfer the knowledge from these unlabeled utterances to improve model performance on Spoken…

Computation and Language · Computer Science 2018-11-14 Aditya Siddhant , Anuj Goyal , Angeliki Metallinou

Self-supervised pre-training using unlabeled data is widely used in automatic speech recognition. In this paper, we propose a new self-supervised pre-training approach to dealing with heterogeneous data. Instead of mixing all the data and…

Machine Learning · Computer Science 2025-09-10 Xiaodong Cui , A F M Saif , Brian Kingsbury , Tianyi Chen

Most existing methods focus on sentiment analysis of textual data. However, recently there has been a massive use of images and videos on social platforms, motivating sentiment analysis from other modalities. Current studies show that…

Machine Learning · Computer Science 2022-10-13 Guilherme Lourenço de Toledo , Ricardo Marcondes Marcacini

Sentiment analysis is a helpful task to automatically analyse opinions and emotions on various topics in areas such as AI for Social Good, AI in Education or marketing. While many of the sentiment analysis systems are developed for English,…

Computation and Language · Computer Science 2025-11-26 Koena Ronny Mabokela , Tim Schlippe , Mpho Raborife , Turgay Celik

Speech representation learning approaches for non-semantic tasks such as language recognition have either explored supervised embedding extraction methods using a classifier model or self-supervised representation learning approaches using…

Computation and Language · Computer Science 2023-06-08 Shikhar Vashishth , Shikhar Bharadwaj , Sriram Ganapathy , Ankur Bapna , Min Ma , Wei Han , Vera Axelrod , Partha Talukdar

The cross-lingual language models are typically pretrained with masked language modeling on multilingual text or parallel sentences. In this paper, we introduce denoising word alignment as a new cross-lingual pre-training task.…

Computation and Language · Computer Science 2021-09-14 Zewen Chi , Li Dong , Bo Zheng , Shaohan Huang , Xian-Ling Mao , Heyan Huang , Furu Wei

The lack of speech data annotated with labels required for spoken language understanding (SLU) is often a major hurdle in building end-to-end (E2E) systems that can directly process speech inputs. In contrast, large amounts of text data…

Computation and Language · Computer Science 2022-03-02 Samuel Thomas , Hong-Kwang J. Kuo , Brian Kingsbury , George Saon

Previous work has shown that for low-resource source languages, automatic speech-to-text translation (AST) can be improved by pretraining an end-to-end model on automatic speech recognition (ASR) data from a high-resource language. However,…

Computation and Language · Computer Science 2020-02-11 Mihaela C. Stoian , Sameer Bansal , Sharon Goldwater

Financial sentiment analysis is a challenging task due to the specialized language and lack of labeled data in that domain. General-purpose models are not effective enough because of the specialized language used in a financial context. We…

Computation and Language · Computer Science 2019-08-28 Dogu Araci

Self-supervised learning (SSL) has been able to leverage unlabeled data to boost the performance of automatic speech recognition (ASR) models when we have access to only a small amount of transcribed speech data. However, this raises the…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-06 Reem Gody , David Harwath

Traditional spoken language processing involves cascading an automatic speech recognition (ASR) system into text processing models. In contrast, "textless" methods process speech representations without ASR systems, enabling the direct use…

Computation and Language · Computer Science 2024-07-16 Shunsuke Kando , Yusuke Miyao , Jason Naradowsky , Shinnosuke Takamichi

Language identification from speech is a common preprocessing step in many spoken language processing systems. In recent years, this field has seen fast progress, mostly due to the use of self-supervised models pretrained on multilingual…

Audio and Speech Processing · Electrical Eng. & Systems 2022-07-04 Kunnar Kukk , Tanel Alumäe

Sentiment analysis is one of the most crucial tasks in Natural Language Processing (NLP), involving the training of machine learning models to classify text based on the polarity of opinions. Pre-trained Language Models (PLMs) can be…

Computation and Language · Computer Science 2025-01-16 Hong-Viet Tran , Van-Tan Bui , Lam-Quan Tran