English
Related papers

Related papers: Unsupervised Dual Paraphrasing for Two-stage Seman…

200 papers

Many important classification problems, such as object classification, speech recognition, and machine translation, have been tackled by the supervised learning paradigm in the past, where training corpora of parallel input-output pairs are…

Machine Learning · Computer Science 2019-06-10 Yu Liu , Li Deng , Jianshu Chen , Chang Wen Chen

We consider the problem of training speech recognition systems without using any labeled data, under the assumption that the learner can only access to the input utterances and a phoneme language model estimated from a non-overlapping…

Audio and Speech Processing · Electrical Eng. & Systems 2018-12-27 Chih-Kuan Yeh , Jianshu Chen , Chengzhu Yu , Dong Yu

In sentence compression, the task of shortening sentences while retaining the original meaning, models tend to be trained on large corpora containing pairs of verbose and compressed sentences. To remove the need for paired corpora, we…

Computation and Language · Computer Science 2018-09-11 Thibault Févry , Jason Phang

The problem of spurious programs is a longstanding challenge when training a semantic parser from weak supervision. To eliminate such programs that have wrong semantics but correct denotation, existing methods focus on exploiting…

Computation and Language · Computer Science 2023-11-03 Kang-il Lee , Segwang Kim , Kyomin Jung

We present a self-training approach to unsupervised dependency parsing that reuses existing supervised and unsupervised parsing algorithms. Our approach, called `iterated reranking' (IR), starts with dependency trees generated by an…

Computation and Language · Computer Science 2015-04-21 Phong Le , Willem Zuidema

Automatic speech quality assessment is an important, transversal task whose progress is hampered by the scarcity of human annotations, poor generalization to unseen recording conditions, and a lack of flexibility of existing approaches. In…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Joan Serrà , Jordi Pons , Santiago Pascual

A fundamental challenge in developing semantic parsers is the paucity of strong supervision in the form of language utterances annotated with logical form. In this paper, we propose to exploit structural regularities in language in…

Computation and Language · Computer Science 2018-01-30 Jonathan Herzig , Jonathan Berant

Spoken question answering (SQA) requires fine-grained understanding of both spoken documents and questions for the optimal answer prediction. In this paper, we propose novel training schemes for spoken question answering with a…

Computation and Language · Computer Science 2021-09-09 Chenyu You , Nuo Chen , Yuexian Zou

In this paper, we propose three methods for generating synthetic samples to train and evaluate multimodal large language models capable of processing both text and speech inputs. Addressing the scarcity of samples containing both…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-21 Vahid Noroozi , Zhehuai Chen , Somshubra Majumdar , Steve Huang , Jagadeesh Balam , Boris Ginsburg

Idiomatic expressions (IEs) play an essential role in natural language. In this paper, we study the task of idiomatic sentence paraphrasing (ISP), which aims to paraphrase a sentence with an IE by replacing the IE with its literal…

Computation and Language · Computer Science 2021-12-17 Jianing Zhou , Ziheng Zeng , Hongyu Gong , Suma Bhat

Pretrained language models are long known to be subpar in capturing sentence and document-level semantics. Though heavily investigated, transferring perturbation-based methods from unsupervised visual representation learning to NLP remains…

Computation and Language · Computer Science 2024-02-14 Chenghao Xiao , Zhuoxu Huang , Danlu Chen , G Thomas Hudson , Yizhi Li , Haoran Duan , Chenghua Lin , Jie Fu , Jungong Han , Noura Al Moubayed

Semantic segmentation is an important technique for environment perception in intelligent transportation systems. With the rapid development of convolutional neural networks (CNNs), road scene analysis can usually achieve satisfactory…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Licong Guan , Xue Yuan

Semi-supervision is a promising paradigm for Bilingual Lexicon Induction (BLI) with limited annotations. However, previous semisupervised methods do not fully utilize the knowledge hidden in annotated and nonannotated data, which hinders…

Computation and Language · Computer Science 2020-10-15 Xu Zhao , Zihao Wang , Hao Wu , Yong Zhang

We introduce MARGE, a pre-trained sequence-to-sequence model learned with an unsupervised multi-lingual multi-document paraphrasing objective. MARGE provides an alternative to the dominant masked language modeling paradigm, where we…

Computation and Language · Computer Science 2020-06-29 Mike Lewis , Marjan Ghazvininejad , Gargi Ghosh , Armen Aghajanyan , Sida Wang , Luke Zettlemoyer

We describe a method for developing broad-coverage semantic dependency parsers for languages for which no semantically annotated resource is available. We leverage a multitask learning framework coupled with an annotation projection method.…

Computation and Language · Computer Science 2020-05-01 Maryam Aminian , Mohammad Sadegh Rasooli , Mona Diab

Answering natural language questions over tables is usually seen as a semantic parsing task. To alleviate the collection cost of full logical forms, one popular approach focuses on weak supervision consisting of denotations instead of…

Information Retrieval · Computer Science 2022-04-21 Jonathan Herzig , Paweł Krzysztof Nowak , Thomas Müller , Francesco Piccinno , Julian Martin Eisenschlos

Paraphrase generation is a long-standing problem and serves an essential role in many natural language processing problems. Despite some encouraging results, recent methods either confront the problem of favoring generic utterance or need…

Computation and Language · Computer Science 2020-12-01 Tien-Cuong Bui , Van-Duc Le , Hai-Thien To , Sang Kyun Cha

Publicly available, large pretrained LanguageModels (LMs) generate text with remarkable quality, but only sequentially from left to right. As a result, they are not immediately applicable to generation tasks that break the unidirectional…

Computation and Language · Computer Science 2021-12-28 Peter West , Ximing Lu , Ari Holtzman , Chandra Bhagavatula , Jena Hwang , Yejin Choi

Neural text-to-speech (TTS) models can synthesize natural human speech when trained on large amounts of transcribed speech. However, collecting such large-scale transcribed data is expensive. This paper proposes an unsupervised pre-training…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-29 Seongyeon Park , Myungseo Song , Bohyung Kim , Tae-Hyun Oh

Cross-lingual Machine Reading Comprehension (xMRC) is challenging due to the lack of training data in low-resource languages. The recent approaches use training data only in a resource-rich language like English to fine-tune large-scale…

Machine Learning · Computer Science 2021-12-10 Nuo Chen , Linjun Shou , Min Gong , Jian Pei , Daxin Jiang