English
Related papers

Related papers: Disfl-QA: A Benchmark Dataset for Understanding Di…

200 papers

Strong presentation skills are valuable and sought-after in workplace and classroom environments alike. Of the possible improvements to vocal presentations, disfluencies and stutters in particular remain one of the most common and prominent…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-25 Tedd Kourkounakis , Amirhossein Hajavi , Ali Etemad

Disfluency detection is a critical task in real-time dialogue systems. However, despite its importance, it remains a relatively unexplored field, mainly due to the lack of appropriate datasets. At the same time, existing datasets suffer…

Computation and Language · Computer Science 2022-05-04 T. Passali , T. Mavropoulos , G. Tsoumakas , G. Meditskos , S. Vrochidis

Answers to the same question may change depending on the extra-linguistic contexts (when and where the question was asked). To study this challenge, we introduce SituatedQA, an open-retrieval QA dataset where systems must produce the…

Computation and Language · Computer Science 2021-09-14 Michael J. Q. Zhang , Eunsol Choi

In spoken question answering, QA systems are designed to answer questions from contiguous text spans within the related speech transcripts. However, the most natural way that human seek or test their knowledge is via human conversations.…

Computation and Language · Computer Science 2020-10-20 Chenyu You , Nuo Chen , Fenglin Liu , Dongchao Yang , Yuexian Zou

We investigate how encoder-decoder models trained on a synthetic dataset of task-oriented dialogues process disfluencies, such as hesitations and self-corrections. We find that, contrary to earlier results, disfluencies have very little…

Computation and Language · Computer Science 2018-08-29 Dieuwke Hupkes , Sanne Bouwmeester , Raquel Fernández

Deep learning underpins most of the currently advanced natural language processing (NLP) tasks such as textual classification, neural machine translation (NMT), abstractive summarization and question-answering (QA). However, the robustness…

Computation and Language · Computer Science 2024-11-14 Jiyao Li , Mingze Ni , Yongshun Gong , Wei Liu

Conversational machine comprehension requires the understanding of the conversation history, such as previous question/answer pairs, the document context, and the current question. To enable traditional, single-turn models to encode the…

Computation and Language · Computer Science 2019-04-17 Hsin-Yuan Huang , Eunsol Choi , Wen-tau Yih

Readers of academic research papers often read with the goal of answering specific questions. Question Answering systems that can answer those questions can make consumption of the content much more efficient. However, building such tools…

Computation and Language · Computer Science 2021-05-10 Pradeep Dasigi , Kyle Lo , Iz Beltagy , Arman Cohan , Noah A. Smith , Matt Gardner

Despite the evolution of language models, they continue to portray harmful societal biases and stereotypes inadvertently learned from training data. These inherent biases often result in detrimental effects in various applications.…

Computation and Language · Computer Science 2024-07-24 Ewoenam Kwaku Tokpo , Toon Calders

Knowledge and language understanding of models evaluated through question answering (QA) has been usually studied on static snapshots of knowledge, like Wikipedia. However, our world is dynamic, evolves over time, and our models' knowledge…

Datasets extracted from social networks and online forums are often prone to the pitfalls of natural language, namely the presence of unstructured and noisy data. In this work, we seek to enable the collection of high-quality…

Computation and Language · Computer Science 2020-11-11 Rachel Gardner , Maya Varma , Clare Zhu , Ranjay Krishna

Document-grounded dialogue systems aim to answer user queries by leveraging external information. Previous studies have mainly focused on handling free-form documents, often overlooking structured data such as lists, which can represent a…

Computation and Language · Computer Science 2024-10-08 Mujeen Sung , Song Feng , James Gung , Raphael Shu , Yi Zhang , Saab Mansour

While diverse question answering (QA) datasets have been proposed and contributed significantly to the development of deep learning models for QA tasks, the existing datasets fall short in two aspects. First, we lack QA datasets covering…

Computation and Language · Computer Science 2021-10-15 Qiyuan Zhang , Lei Wang , Sicheng Yu , Shuohang Wang , Yang Wang , Jing Jiang , Ee-Peng Lim

Despite the advances in large language models (LLMs), how they use their knowledge for reasoning is not yet well understood. In this study, we propose a method that deconstructs complex real-world questions into a graph, representing each…

Computation and Language · Computer Science 2024-10-07 Miyoung Ko , Sue Hyun Park , Joonsuk Park , Minjoon Seo

Despite extensive research on a wide range of question answering (QA) systems, most existing work focuses on answer containment-i.e., assuming that answers can be directly extracted and/or generated from documents in the corpus. However,…

Computation and Language · Computer Science 2026-02-03 Jamshid Mozafari , Hamed Zamani , Guido Zuccon , Adam Jatowt

The financial domain frequently deals with large numbers of long documents that are essential for daily operations. Significant effort is put towards automating financial data analysis. However, a persistent challenge, not limited to the…

Computation and Language · Computer Science 2024-06-21 Viet Dac Lai , Michael Krumdick , Charles Lovering , Varshini Reddy , Craig Schmidt , Chris Tanner

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

Computation and Language · Computer Science 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Current disfluency detection methods heavily rely on costly and scarce human-annotated data. To tackle this issue, some approaches employ heuristic or statistical features to generate disfluent sentences, partially improving detection…

Computation and Language · Computer Science 2024-08-07 Zhenrong Cheng , Jiayan Guo , Hao Sun , Yan Zhang

Has there been real progress in multi-hop question-answering? Models often exploit dataset artifacts to produce correct answers, without connecting information across multiple supporting facts. This limits our ability to measure true…

Computation and Language · Computer Science 2020-11-18 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

Current disfluency detection models focus on individual utterances each from a single speaker. However, numerous discontinuity phenomena in spoken conversational transcripts occur across multiple turns, hampering human readability and the…

Computation and Language · Computer Science 2023-10-30 Hua Shen , Vicky Zayats , Johann C. Rocholl , Daniel D. Walker , Dirk Padfield