English
Related papers

Related papers: CCQA: A New Web-Scale Question Answering Dataset f…

200 papers

In very recent years more attention has been placed on probing the role of pre-training data in Large Language Models (LLMs) downstream behaviour. Despite the importance, there is no public tool that supports such analysis of pre-training…

Computation and Language · Computer Science 2023-03-28 Thuy-Trang Vu , Xuanli He , Gholamreza Haffari , Ehsan Shareghi

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

Computation and Language · Computer Science 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Although counterfactual reasoning is a fundamental aspect of intelligence, the lack of large-scale counterfactual open-domain question-answering (QA) benchmarks makes it difficult to evaluate and improve models on this ability. To address…

Computation and Language · Computer Science 2023-05-24 Wenhao Yu , Meng Jiang , Peter Clark , Ashish Sabharwal

The retriever-reader framework is popular for open-domain question answering (ODQA) due to its ability to use explicit knowledge. Although prior work has sought to increase the knowledge coverage by incorporating structured knowledge beyond…

Computation and Language · Computer Science 2022-03-22 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

We introduce KazQAD -- a Kazakh open-domain question answering (ODQA) dataset -- that can be used in both reading comprehension and full ODQA settings, as well as for information retrieval experiments. KazQAD contains just under 6,000…

Computation and Language · Computer Science 2024-04-09 Rustem Yeshpanov , Pavel Efimov , Leonid Boytsov , Ardak Shalkarbayuli , Pavel Braslavski

Recent deployments of large language models (LLMs) as autonomous trading agents raise questions about whether financial decision-making competence generalizes beyond specific market patterns and how it should be trained and evaluated in…

Machine Learning · Computer Science 2026-04-21 Yuchen Pan , Soung Chang Liew

Open-domain conversational question answering can be viewed as two tasks: passage retrieval and conversational question answering, where the former relies on selecting candidate passages from a large corpus and the latter requires better…

Computation and Language · Computer Science 2022-11-18 Hung-Chieh Fang , Kuo-Han Hung , Chao-Wei Huang , Yun-Nung Chen

How to better evaluate the capabilities of Large Language Models (LLMs) is the focal point and hot topic in current LLMs research. Previous work has noted that due to the extremely high cost of iterative updates of LLMs, they are often…

Computation and Language · Computer Science 2024-03-05 Zhikun Xu , Yinghui Li , Ruixue Ding , Xinyu Wang , Boli Chen , Yong Jiang , Hai-Tao Zheng , Wenlian Lu , Pengjun Xie , Fei Huang

While large language models exhibit remarkable performance in the Question Answering task, they are susceptible to hallucinations. Challenges arise when these models grapple with understanding multi-hop relations in complex questions or…

Computation and Language · Computer Science 2023-11-14 Hejing Cao , Zhenwei An , Jiazhan Feng , Kun Xu , Liwei Chen , Dongyan Zhao

Dense retrievers for open-domain question answering (ODQA) have been shown to achieve impressive performance by training on large datasets of question-passage pairs. In this work we ask whether this dependence on labeled data can be reduced…

Computation and Language · Computer Science 2022-05-18 Ori Ram , Gal Shachaf , Omer Levy , Jonathan Berant , Amir Globerson

Recently several datasets have been proposed to encourage research in Question Answering domains where commonsense knowledge is expected to play an important role. Recent language models such as ROBERTA, BERT and GPT that have been…

Computation and Language · Computer Science 2020-04-20 Arindam Mitra , Pratyay Banerjee , Kuntal Kumar Pal , Swaroop Mishra , Chitta Baral

The domain of Natural Language Processing (NLP) has experienced notable progress in the evolution of Bangla Question Answering (QA) systems. This paper presents a comprehensive review of seven research articles that contribute to the…

Computation and Language · Computer Science 2024-12-17 Md Iftekhar Islam Tashik , Abdullah Khondoker , Enam Ahmed Taufik , Antara Firoz Parsa , S M Ishtiak Mahmud

Open-domain complex Question Answering (QA) is a difficult task with challenges in evidence retrieval and reasoning. The complexity of such questions could stem from questions being compositional, hybrid evidence, or ambiguity in questions.…

Computation and Language · Computer Science 2024-06-26 Venktesh V. Deepali Prabhu , Avishek Anand

We present CovidQA, the beginnings of a question answering dataset specifically designed for COVID-19, built by hand from knowledge gathered from Kaggle's COVID-19 Open Research Dataset Challenge. To our knowledge, this is the first…

Computation and Language · Computer Science 2020-04-24 Raphael Tang , Rodrigo Nogueira , Edwin Zhang , Nikhil Gupta , Phuong Cam , Kyunghyun Cho , Jimmy Lin

The task of Question Answering has gained prominence in the past few decades for testing the ability of machines to understand natural language. Large datasets for Machine Reading have led to the development of neural models that cater to…

Computation and Language · Computer Science 2018-06-20 Soumya Wadhwa , Khyathi Raghavi Chandu , Eric Nyberg

Complex question-answering (CQA) involves answering complex natural-language questions on a knowledge base (KB). However, the conventional neural program induction (NPI) approach exhibits uneven performance when the questions have different…

Computation and Language · Computer Science 2020-11-02 Yuncheng Hua , Yuan-Fang Li , Gholamreza Haffari , Guilin Qi , Tongtong Wu

We study a new problem setting of question answering (QA), referred to as DocTabQA. Within this setting, given a long document, the goal is to respond to questions by organizing the answers into structured tables derived directly from the…

Computation and Language · Computer Science 2024-08-22 Haochen Wang , Kai Hu , Haoyu Dong , Liangcai Gao

Textbook Question Answering (TQA) is a complex multimodal task to infer answers given large context descriptions and abundant diagrams. Compared with Visual Question Answering (VQA), TQA contains a large number of uncommon terminologies and…

Multimedia · Computer Science 2021-12-07 Fangzhi Xu , Qika Lin , Jun Liu , Lingling Zhang , Tianzhe Zhao , Qi Chai , Yudai Pan

Large pre-trained multimodal models have demonstrated significant success in a range of downstream tasks, including image captioning, image-text retrieval, visual question answering (VQA), etc. However, many of these methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Zikang Liu , Sihan Chen , Longteng Guo , Handong Li , Xingjian He , Jing Liu

Charts are very popular to analyze data and convey important insights. People often analyze visualizations to answer open-ended questions that require explanatory answers. Answering such questions are often difficult and time-consuming as…

Machine Learning · Computer Science 2022-10-14 Shankar Kantharaj , Xuan Long Do , Rixie Tiffany Ko Leong , Jia Qing Tan , Enamul Hoque , Shafiq Joty