English
Related papers

Related papers: Towards Relation Extraction From Speech

200 papers

While various end-to-end models for spoken language understanding tasks have been explored recently, this paper is probably the first known attempt to challenge the very difficult task of end-to-end spoken question answering (SQA). Learning…

Computation and Language · Computer Science 2020-08-12 Yung-Sung Chuang , Chi-Liang Liu , Hung-Yi Lee , Lin-shan Lee

Analysing the generalisation capabilities of relation extraction (RE) models is crucial for assessing whether they learn robust relational patterns or rely on spurious correlations. Our cross-dataset experiments find that RE models struggle…

Computation and Language · Computer Science 2025-12-16 Varvara Arzt , Allan Hanbury , Michael Wiegand , Gábor Recski , Terra Blevins

End-to-end models are an attractive new approach to spoken language understanding (SLU) in which the meaning of an utterance is inferred directly from the raw audio without employing the standard pipeline composed of a separately trained…

Audio and Speech Processing · Electrical Eng. & Systems 2019-10-22 Loren Lugosch , Brett Meyer , Derek Nowrouzezahrai , Mirco Ravanelli

In this paper we address a task of relation mention extraction from noisy data: extracting representative phrases for a particular relation from noisy sentences that are collected via distant supervision. Despite its significance and value…

Computation and Language · Computer Science 2018-11-06 Jun Feng , Minlie Huang , Yijie Zhang , Yang Yang , Xiaoyan Zhu

Speaker extraction aims to extract target speech signal from a multi-talker environment with interference speakers and surrounding noise, given the target speaker's reference information. Most speaker extraction systems achieve satisfactory…

Audio and Speech Processing · Electrical Eng. & Systems 2022-08-12 Chengyun Deng , Shiqian Ma , Yi Zhang , Yongtao Sha , Hui Zhang , Hui Song , Xiangang Li

Open Relation Extraction (OpenRE) seeks to identify and extract novel relational facts between named entities from unlabeled data without pre-defined relation schemas. Traditional OpenRE methods typically assume that the unlabeled data…

Computation and Language · Computer Science 2025-05-30 Qing Wang , Yuepei Li , Qiao Qiao , Kang Zhou , Qi Li

Relation extraction (RE) models have been challenged by their reliance on training data with expensive annotations. Considering that summarization tasks aim at acquiring concise expressions of synoptical information from the longer context,…

Computation and Language · Computer Science 2022-10-24 Keming Lu , I-Hung Hsu , Wenxuan Zhou , Mingyu Derek Ma , Muhao Chen

Relation Extraction (RE) is a crucial task in Information Extraction, which entails predicting relationships between entities within a given sentence. However, extending pre-trained RE models to other languages is challenging, particularly…

Computation and Language · Computer Science 2023-04-21 Chiaming Hsu , Changtong Zan , Liang Ding , Longyue Wang , Xiaoting Wang , Weifeng Liu , Fu Lin , Wenbin Hu

This paper addresses end-to-end automatic speech recognition (ASR) for long audio recordings such as lecture and conversational speeches. Most end-to-end ASR models are designed to recognize independent utterances, but contextual…

Computation and Language · Computer Science 2021-04-20 Takaaki Hori , Niko Moritz , Chiori Hori , Jonathan Le Roux

Lying at the core of human intelligence, relational thinking is characterized by initially relying on innumerable unconscious percepts pertaining to relations between new sensory signals and prior knowledge, consequently becoming a…

Machine Learning · Computer Science 2020-07-09 Hengguan Huang , Fuzhao Xue , Hao Wang , Ye Wang

In recent years extracting relevant information from biomedical and clinical texts such as research articles, discharge summaries, or electronic health records have been a subject of many research efforts and shared challenges. Relation…

Computation and Language · Computer Science 2016-07-01 Sunil Kumar Sahu , Ashish Anand , Krishnadev Oruganty , Mahanandeeshwar Gattu

We present a novel end-to-end neural model to extract entities and relations between them. Our recurrent neural network based model captures both word sequence and dependency tree substructure information by stacking bidirectional…

Computation and Language · Computer Science 2016-06-09 Makoto Miwa , Mohit Bansal

Supervised training of speech recognition models requires access to transcribed audio data, which often is not possible due to confidentiality issues. Our approach to this problem is to generate synthetic audio from a text-only corpus using…

Audio and Speech Processing · Electrical Eng. & Systems 2025-09-01 Yanis Perrin , Gilles Boulianne

We propose a novel deliberation-based approach to end-to-end (E2E) spoken language understanding (SLU), where a streaming automatic speech recognition (ASR) model produces the first-pass hypothesis and a second-pass natural language…

Computation and Language · Computer Science 2022-09-08 Duc Le , Akshat Shrivastava , Paden Tomasello , Suyoun Kim , Aleksandr Livshits , Ozlem Kalinli , Michael L. Seltzer

We introduce the task of expressive speech retrieval, where the goal is to retrieve speech utterances spoken in a given style based on a natural language description of that style. While prior work has primarily focused on performing speech…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-18 Wonjune Kang , Deb Roy

Distant Supervised Relation Extraction (DSRE) is usually formulated as a problem of classifying a bag of sentences that contain two query entities, into the predefined relation classes. Most existing methods consider those relation classes…

Computation and Language · Computer Science 2019-12-16 Yanjie Gou , Yinjie Lei , Lingqiao Liu , Pingping Zhang , Xi Peng

Extraction of Application Programming Interfaces (APIs) and their semantic relations from unstructured text (e.g., Stack Overflow) is a fundamental work for software engineering tasks (e.g., API recommendation). However, existing approaches…

Software Engineering · Computer Science 2023-01-11 Qing Huang , Yanbang Sun , Zhenchang Xing , Min Yu , Xiwei Xu , Qinghua Lu

Multimodal relation extraction (MRE) is the task of identifying the semantic relationships between two entities based on the context of the sentence image pair. Existing retrieval-augmented approaches mainly focused on modeling the…

Computation and Language · Computer Science 2023-05-26 Xuming Hu , Zhijiang Guo , Zhiyang Teng , Irwin King , Philip S. Yu

The vast majority of speech separation methods assume that the number of speakers is known in advance, hence they are specific to the number of speakers. By contrast, a more realistic and challenging task is to separate a mixture in which…

Sound · Computer Science 2022-03-31 Zhenhao Jin , Xiang Hao , Xiangdong Su

Knowledge-based question answering relies on the availability of facts, the majority of which cannot be found in structured sources (e.g. Wikipedia info-boxes, Wikidata). One of the major components of extracting facts from unstructured…

Computation and Language · Computer Science 2018-03-28 Christos Christodoulopoulos , Arpit Mittal