English
Related papers

Related papers: UnifiedQA: Crossing Format Boundaries With a Singl…

200 papers

Fact-centric question answering (QA) often requires access to multiple, heterogeneous, information sources. By jointly considering several sources like a knowledge base (KB), a text collection, and tables from the web, QA systems can…

Information Retrieval · Computer Science 2023-08-22 Philipp Christmann , Rishiraj Saha Roy , Gerhard Weikum

Domain-specific quantitative reasoning remains a major challenge for large language models (LLMs), especially in fields requiring expert knowledge and complex question answering (QA). In this work, we propose Expert Question Decomposition…

Computation and Language · Computer Science 2025-10-03 Mengyu Wang , Sotirios Sabanis , Miguel de Carvalho , Shay B. Cohen , Tiejun Ma

A persistent challenge to table question answering (TableQA) by generating executable programs has been adapting to varied table structures, typically requiring domain-specific logical forms. In response, this paper introduces a unified…

Computation and Language · Computer Science 2025-03-13 Yihan Cao , Shuyi Chen , Ryan Liu , Zhiruo Wang , Daniel Fried

Numerical reasoning is often important to accurately understand the world. Recently, several format-specific datasets have been proposed, such as numerical reasoning in the settings of Natural Language Inference (NLI), Reading Comprehension…

Computation and Language · Computer Science 2020-05-19 Swaroop Mishra , Arindam Mitra , Neeraj Varshney , Bhavdeep Sachdeva , Chitta Baral

Large language models (LLMs) have grown in popularity due to their natural language interface and pre trained knowledge, leading to rapidly increasing success in question-answering (QA) tasks. More recently, multi-agent systems with…

Machine Learning · Computer Science 2024-10-21 Bhrij Patel , Vishnu Sashank Dorbala , Amrit Singh Bedi , Dinesh Manocha

Visual Question Answering (VQA) models are prone to learn the shortcut solution formed by dataset biases rather than the intended solution. To evaluate the VQA models' reasoning ability beyond shortcut learning, the VQA-CP v2 dataset…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Qingyi Si , Fandong Meng , Mingyu Zheng , Zheng Lin , Yuanxin Liu , Peng Fu , Yanan Cao , Weiping Wang , Jie Zhou

Scaling Visual Question Answering (VQA) to the open-domain and multi-hop nature of web searches, requires fundamental advances in visual representation learning, knowledge aggregation, and language generation. In this work, we introduce…

Computation and Language · Computer Science 2022-03-29 Yingshan Chang , Mridu Narang , Hisami Suzuki , Guihong Cao , Jianfeng Gao , Yonatan Bisk

Multimodal systems have great potential to assist humans in procedural activities, where people follow instructions to achieve their goals. Despite diverse application scenarios, systems are typically evaluated on traditional classification…

Computation and Language · Computer Science 2025-11-05 Kimihiro Hasegawa , Wiradee Imrattanatrai , Zhi-Qi Cheng , Masaki Asada , Susan Holm , Yuran Wang , Ken Fukuda , Teruko Mitamura

Unified multimodal models aim to jointly enable visual understanding and generation, yet current benchmarks rarely examine their true integration. Existing evaluations either treat the two abilities in isolation or overlook tasks that…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Kai Zou , Ziqi Huang , Yuhao Dong , Shulin Tian , Dian Zheng , Hongbo Liu , Jingwen He , Bin Liu , Yu Qiao , Ziwei Liu

Retriever-augmented instruction-following models are attractive alternatives to fine-tuned approaches for information-seeking tasks such as question answering (QA). By simply prepending retrieved documents in its input along with an…

Computation and Language · Computer Science 2024-04-18 Vaibhav Adlakha , Parishad BehnamGhader , Xing Han Lu , Nicholas Meade , Siva Reddy

Recent advances in multimodal vision and language modeling have predominantly focused on the English language, mostly due to the lack of multilingual multimodal datasets to steer modeling efforts. In this work, we address this gap and…

Computation and Language · Computer Science 2022-03-18 Jonas Pfeiffer , Gregor Geigle , Aishwarya Kamath , Jan-Martin O. Steitz , Stefan Roth , Ivan Vulić , Iryna Gurevych

Video Question Answering (VideoQA) aims to answer natural language questions according to the given videos. It has earned increasing attention with recent research trends in joint vision and language understanding. Yet, compared with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Yaoyao Zhong , Junbin Xiao , Wei Ji , Yicong Li , Weihong Deng , Tat-Seng Chua

The task of learning from only a few examples (called a few-shot setting) is of key importance and relevance to a real-world setting. For question answering (QA), the current state-of-the-art pre-trained models typically need fine-tuning on…

Computation and Language · Computer Science 2021-10-13 Rakesh Chada , Pradeep Natarajan

Building a deep learning model for a Question-Answering (QA) task requires a lot of human effort, it may need several months to carefully tune various model architectures and find a best one. It's even harder to find different excellent…

Computation and Language · Computer Science 2022-01-27 Sinan Tan , Hui Xue , Qiyu Ren , Huaping Liu , Jing Bai

In recent years, there has been a growing emphasis on the intersection of audio, vision, and text modalities, driving forward the advancements in multimodal research. However, strong bias that exists in any modality can lead to the model…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Xiulong Liu , Zhikang Dong , Peng Zhang

Multilingual language models often perform unevenly across different languages due to limited generalization capabilities for some languages. This issue is significant because of the growing interest in making universal language models that…

Computation and Language · Computer Science 2024-10-11 Gürkan Soykan , Gözde Gül Şahin

Multiple-choice question answering (MCQA) is a key competence of performant transformer language models that is tested by mainstream benchmarks. However, recent evidence shows that models can have quite a range of performance, particularly…

Computation and Language · Computer Science 2025-03-11 Sarah Wiegreffe , Oyvind Tafjord , Yonatan Belinkov , Hannaneh Hajishirzi , Ashish Sabharwal

Embodied Question Answering (EQA) is a recently proposed task, where an agent is placed in a rich 3D environment and must act based solely on its egocentric input to answer a given question. The desired outcome is that the agent learns to…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Cătălina Cangea , Eugene Belilovsky , Pietro Liò , Aaron Courville

Question Answering (QA) is a growing area of research, often used to facilitate the extraction of information from within documents. State-of-the-art QA models are usually pre-trained on domain-general corpora like Wikipedia and thus tend…

Computation and Language · Computer Science 2022-12-01 Matthew Maufe , James Ravenscroft , Rob Procter , Maria Liakata