English
Related papers

Related papers: Robust Domain Adaptation for Machine Reading Compr…

200 papers

Self-supervised learning (SSL) in the pretraining stage using un-annotated speech data has been successful in low-resource automatic speech recognition (ASR) tasks. However, models trained through SSL are biased to the pretraining data…

Audio and Speech Processing · Electrical Eng. & Systems 2022-06-17 Ruchao Fan , Abeer Alwan

We introduce DAS (Domain Adaptation with Synthetic data), a novel domain adaptation framework for pre-trained ASR model, designed to efficiently adapt to various language-defined domains without requiring any real data. In particular, DAS…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-23 Minh Tran , Yutong Pang , Debjyoti Paul , Laxmi Pandey , Kevin Jiang , Jinxi Guo , Ke Li , Shun Zhang , Xuedong Zhang , Xin Lei

\textbf{RE}trieval-\textbf{A}ugmented \textbf{L}LM-based \textbf{M}achine \textbf{T}ranslation (REAL-MT) shows promise for knowledge-intensive tasks like idiomatic translation, but its reliability under noisy retrieval contexts remains…

Computation and Language · Computer Science 2025-11-18 Yanming Sun , Runzhe Zhan , Chi Seng Cheang , Han Wu , Xuebo Liu , Yuyao Niu , Fengying Ye , Kaixin Lan , Lidia S. Chao , Derek F. Wong

Large Language Models (LLMs) excel in language tasks but are prone to hallucinations and outdated knowledge. Retrieval-Augmented Generation (RAG) mitigates these by grounding LLMs in external knowledge. However, in complex domains involving…

Computation and Language · Computer Science 2025-08-28 Peiran Zhou , Junnan Zhu , Yichen Shen , Ruoxi Yu

Reading comprehension models often overfit to nuances of training datasets and fail at adversarial evaluation. Training with adversarially augmented dataset improves robustness against those adversarial attacks but hurts generalization of…

Computation and Language · Computer Science 2020-11-18 Adyasha Maharana , Mohit Bansal

Retrieval-Augmented Generation (RAG) combines the language understanding and reasoning power of large language models (LLMs) with external retrieval to enable domain-grounded responses. Effectively adapting RAG systems to domain-specific…

Computation and Language · Computer Science 2026-04-14 Chris Xing Tian , Weihao Xie , Zhen Chen , Zhengyuan Yi , Hui Liu , Haoliang Li , Shiqi Wang , Siwei Ma

Current methods in open-domain question answering (QA) usually employ a pipeline of first retrieving relevant documents, then applying strong reading comprehension (RC) models to that retrieved text. However, modern RC models are complex…

Computation and Language · Computer Science 2020-09-22 Shih-Ting Lin , Greg Durrett

In spite of great advancements of machine reading comprehension (RC), existing RC models are still vulnerable and not robust to different types of adversarial examples. Neural models over-confidently predict wrong answers to semantic…

Computation and Language · Computer Science 2019-11-19 Mantong Zhou , Minlie Huang , Xiaoyan Zhu

In this paper, we study machine reading comprehension (MRC) on long texts, where a model takes as inputs a lengthy document and a question and then extracts a text span from the document as an answer. State-of-the-art models tend to use a…

Computation and Language · Computer Science 2020-05-20 Hongyu Gong , Yelong Shen , Dian Yu , Jianshu Chen , Dong Yu

Building codes are regulations that establish standards for the design, construction, and safety of buildings to ensure structural integrity, fire protection, and accessibility. They are often extensive, complex, and subject to frequent…

Computation and Language · Computer Science 2025-05-09 Mohammad Aqib , Mohd Hamza , Qipei Mei , Ying Hei Chui

While recent automatic speech recognition systems achieve remarkable performance when large amounts of adequate, high quality annotated speech data is used for training, the same systems often only achieve an unsatisfactory result for tasks…

Audio and Speech Processing · Electrical Eng. & Systems 2022-01-19 Michael Gref , Oliver Walter , Christoph Schmidt , Sven Behnke , Joachim Köhler

The recent success of neural machine translation models relies on the availability of high quality, in-domain data. Domain adaptation is required when domain-specific data is scarce or nonexistent. Previous unsupervised domain adaptation…

Computation and Language · Computer Science 2019-08-29 Zi-Yi Dou , Junjie Hu , Antonios Anastasopoulos , Graham Neubig

Existing machine reading comprehension (MRC) models do not scale effectively to real-world applications like web-level information retrieval and question answering (QA). We argue that this stems from the nature of MRC datasets: most of…

Computation and Language · Computer Science 2020-04-17 Xingdi Yuan , Jie Fu , Marc-Alexandre Cote , Yi Tay , Christopher Pal , Adam Trischler

We present a noise-robust adaptation control strategy for block-online supervised acoustic system identification by exploiting a noise dictionary. The proposed algorithm takes advantage of the pronounced spectral structure which…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-04 Thomas Haubner , Andreas Brendel , Mohamed Elminshawi , Walter Kellermann

Most dense retrieval models contain an implicit assumption: the training query-document pairs are exactly matched. Since it is expensive to annotate the corpus manually, training pairs in real-world applications are usually collected…

Computation and Language · Computer Science 2023-11-08 Hang Zhang , Yeyun Gong , Xingwei He , Dayiheng Liu , Daya Guo , Jiancheng Lv , Jian Guo

Conversational Machine Comprehension (CMC), a research track in conversational AI, expects the machine to understand an open-domain natural language text and thereafter engage in a multi-turn conversation to answer questions related to the…

Computation and Language · Computer Science 2021-02-09 Somil Gupta , Bhanu Pratap Singh Rawat , Hong Yu

Large-scale digitization initiatives have unlocked massive collections of historical newspapers, yet effective computational access remains hindered by OCR corruption, multilingual orthographic variation, and temporal language drift. We…

Digital Libraries · Computer Science 2025-12-16 Anthony Mudet , Souhail Bakkali

Reading comprehension (RC) has been studied in a variety of datasets with the boosted performance brought by deep neural networks. However, the generalization capability of these models across different domains remains unclear. To alleviate…

Computation and Language · Computer Science 2020-07-28 Yu Cao , Meng Fang , Baosheng Yu , Joey Tianyi Zhou

Off-the-shelf pre-trained Automatic Speech Recognition (ASR) systems are an increasingly viable service for companies of any size building speech-based products. While these ASR systems are trained on large amounts of data, domain mismatch…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-18 Anirudh Mani , Shruti Palaskar , Nimshi Venkat Meripo , Sandeep Konam , Florian Metze

This paper presents a novel neural model - Dynamic Fusion Network (DFN), for machine reading comprehension (MRC). DFNs differ from most state-of-the-art models in their use of a dynamic multi-strategy attention process, in which passages,…

Computation and Language · Computer Science 2018-02-28 Yichong Xu , Jingjing Liu , Jianfeng Gao , Yelong Shen , Xiaodong Liu