English
Related papers

Related papers: ODUTQA-MDC: A Task for Open-Domain Underspecified …

200 papers

Recent advancements in open-domain question answering (ODQA), i.e., finding answers from large open-domain corpus like Wikipedia, have led to human-level performance on many datasets. However, progress in QA over book stories (Book QA) lags…

Computation and Language · Computer Science 2021-06-08 Xiangyang Mou , Chenghao Yang , Mo Yu , Bingsheng Yao , Xiaoxiao Guo , Saloni Potdar , Hui Su

Large language models (LLMs) have excelled in various natural language processing tasks, but challenges in interpretability and trustworthiness persist, limiting their use in high-stakes fields. Causal discovery offers a promising approach…

Artificial Intelligence · Computer Science 2024-06-10 Wei Zhou , Hong Huang , Guowen Zhang , Ruize Shi , Kehan Yin , Yuanyuan Lin , Bang Liu

In open question answering (QA), the answer to a question is produced by retrieving and then analyzing documents that might contain answers to the question. Most open QA systems have considered only retrieving information from unstructured…

Computation and Language · Computer Science 2021-02-11 Wenhu Chen , Ming-Wei Chang , Eva Schlinger , William Wang , William W. Cohen

Large language models (LLMs) show promise for clinical use. They are often evaluated using datasets such as MedQA. However, Many medical datasets, such as MedQA, rely on simplified Question-Answering (Q\A) that underrepresents real-world…

Computation and Language · Computer Science 2025-10-24 Yunpeng Xiao , Carl Yang , Mark Mai , Xiao Hu , Kai Shu

Recent advances in multimodal question answering have primarily focused on combining heterogeneous modalities or fine-tuning multimodal large language models. While these approaches have shown strong performance, they often rely on a…

Computation and Language · Computer Science 2026-04-22 Krishna Singh Rajput , Tejas Anvekar , Chitta Baral , Vivek Gupta

Recent studies have shown that large language models (LLMs), when customized with post-training on tabular data, can acquire general tabular in-context learning (TabICL) capabilities. These models are able to transfer effectively across…

Computation and Language · Computer Science 2025-02-06 Xumeng Wen , Shun Zheng , Zhen Xu , Yiming Sun , Jiang Bian

Question answering systems are typically evaluated on factual correctness, yet many real-world applications-such as education and career guidance-require mentorship: responses that provide reflection and guidance. Existing QA benchmarks…

Computation and Language · Computer Science 2026-01-27 Parth Bhalerao , Diola Dsouza , Ruiwen Guan , Oana Ignat

Image Quality Assessment (IQA) has progressed from scalar quality prediction to more interpretable, human-aligned evaluation paradigms. In this work, we address the emerging challenge of detailed and explainable IQA by proposing iDETEX-a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Zhaoran Zhao , Xinli Yue , Jianhui Sun , Yuhao Xie , Tao Shao , Liangchao Yao , Fan Xia , Yuetang Deng

Temporal tabular question answering presents a significant challenge for Large Language Models (LLMs), requiring robust reasoning over structured data, which is a task where traditional prompting methods often fall short. These methods face…

Computation and Language · Computer Science 2025-06-09 Atharv Kulkarni , Kushagra Dixit , Vivek Srikumar , Dan Roth , Vivek Gupta

Retrieval-augmented Large Language Models (LLMs) have reshaped traditional query-answering systems, offering unparalleled user experiences. However, existing retrieval techniques often struggle to handle multi-modal query contexts. In this…

Databases · Computer Science 2024-07-08 Mengzhao Wang , Haotian Wu , Xiangyu Ke , Yunjun Gao , Xiaoliang Xu , Lu Chen

Open-ended question answering requires models to find appropriate evidence to form wellreasoned, comprehensive and helpful answers. In practical applications, models also need to engage in extended discussions on potential scenarios closely…

Computation and Language · Computer Science 2024-12-17 Mingxu Tao , Dongyan Zhao , Yansong Feng

Recent advancements in multimodal large language models (MLLMs) have driven researchers to explore how well these models read data visualizations, e.g., bar charts, scatter plots. More recently, attention has shifted to visual question…

Computation and Language · Computer Science 2025-10-07 Varun Srivastava , Fan Lei , Srija Mukhopadhyay , Vivek Gupta , Ross Maciejewski

Non-task oriented dialogue systems have achieved great success in recent years due to largely accessible conversation data and the development of deep learning techniques. Given a context, current systems are able to yield a relevant and…

Computation and Language · Computer Science 2020-04-10 Leyang Cui , Yu Wu , Shujie Liu , Yue Zhang , Ming Zhou

Recent advancements in Large Language Models (LLMs) and Large Multi-modal Models (LMMs) have shown potential in various medical applications, such as Intelligent Medical Diagnosis. Although impressive results have been achieved, we find…

Large Language Models (LLMs), despite their advancements, are fundamentally limited by their static parametric knowledge, hindering performance on tasks requiring open-domain up-to-date information. While enabling LLMs to interact with…

Computation and Language · Computer Science 2025-05-27 Jianbiao Mei , Tao Hu , Daocheng Fu , Licheng Wen , Xuemeng Yang , Rong Wu , Pinlong Cai , Xinyu Cai , Xing Gao , Yu Yang , Chengjun Xie , Botian Shi , Yong Liu , Yu Qiao

Although great progress has been made by previous table understanding methods including recent approaches based on large language models (LLMs), they rely heavily on the premise that given tables must be converted into a certain text…

Computation and Language · Computer Science 2024-06-13 Mingyu Zheng , Xinwei Feng , Qingyi Si , Qiaoqiao She , Zheng Lin , Wenbin Jiang , Weiping Wang

In this paper, we introduce FAMMA, an open-source benchmark for \underline{f}in\underline{a}ncial \underline{m}ultilingual \underline{m}ultimodal question \underline{a}nswering (QA). Our benchmark aims to evaluate the abilities of large…

Computation and Language · Computer Science 2025-05-16 Siqiao Xue , Xiaojing Li , Fan Zhou , Qingyang Dai , Zhixuan Chu , Hongyuan Mei

This study delves into the capabilities and limitations of Large Language Models (LLMs) in the challenging domain of conditional question-answering. Utilizing the Conditional Question Answering (CQA) dataset and focusing on generative…

Computation and Language · Computer Science 2023-12-05 Syed-Amad Hussain , Parag Pravin Dakle , SaiKrishna Rallabandi , Preethi Raghavan

Large language models (LLMs) demonstrate remarkable performance across various tasks, prompting researchers to develop diverse evaluation benchmarks. However, most benchmarks typically measure the ability of LLMs to respond to individual…

Computation and Language · Computer Science 2026-01-30 Yutao Hou , Yajing Luo , Zhiwen Ruan , Hongru Wang , Weifeng Ge , Yun Chen , Guanhua Chen

Large language models (LLMs) are becoming attractive as few-shot reasoners to solve Natural Language (NL)-related tasks. However, the understanding of their capability to process structured data like tables remains an under-explored area.…

Computation and Language · Computer Science 2024-07-18 Yuan Sui , Mengyu Zhou , Mingjie Zhou , Shi Han , Dongmei Zhang