English
Related papers

Related papers: An Interactive Multi-modal Query Answering System …

200 papers

With the rise of multimodal learning, image retrieval plays a crucial role in connecting visual information with natural language queries. Existing image retrievers struggle with processing long texts and handling unclear user expressions.…

Information Retrieval · Computer Science 2026-03-31 Yuan Hu , ZhiYu Cao , PeiFeng Li , QiaoMing Zhu

Question-answering (QA) that comes naturally to humans is a critical component in seamless human-computer interaction. It has emerged as one of the most convenient and natural methods to interact with the web and is especially desirable in…

Computation and Language · Computer Science 2022-11-15 Deepak Gupta

Large Language Models (LLMs) have shown versatility in various Natural Language Processing (NLP) tasks, including their potential as effective question-answering systems. However, to provide precise and relevant information in response to…

Computation and Language · Computer Science 2024-09-09 Sriram Veturi , Saurabh Vaichal , Reshma Lal Jagadheesh , Nafis Irtiza Tripto , Nian Yan

This study addresses the challenge of ambiguity in knowledge graph question answering (KGQA). While recent KGQA systems have made significant progress, particularly with the integration of large language models (LLMs), they typically assume…

Computation and Language · Computer Science 2025-04-15 Liqiang Wen , Guanming Xiong , Tong Mo , Bing Li , Weiping Li , Wen Zhao

Large Language Models (LLMs) have excelled in multi-hop question-answering (M-QA) due to their advanced reasoning abilities. However, the impact of the inherent reasoning structures on LLM M-QA performance remains unclear, largely due to…

Visual Question Answering (VQA) is an evolving research field aimed at enabling machines to answer questions about visual content by integrating image and language processing techniques such as feature extraction, object detection, text…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Ngoc Dung Huynh , Mohamed Reda Bouadjenek , Sunil Aryal , Imran Razzak , Hakim Hacid

Medical Visual Question Answering (MedVQA) enables natural language queries over medical images to support clinical decision-making and patient care. The MEDIQA-WV 2025 shared task addressed wound-care VQA, requiring systems to generate…

Computation and Language · Computer Science 2025-10-17 A H M Rezaul Karim , Ozlem Uzuner

Multimodal large language models (MLLMs), such as GPT-4o, Gemini, LLaVA, and Flamingo, have made significant progress in integrating visual and textual modalities, excelling in tasks like visual question answering (VQA), image captioning,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Junxiao Xue , Quan Deng , Fei Yu , Yanhao Wang , Jun Wang , Yuehua Li

In this paper, we propose a novel end-to-end trainable Video Question Answering (VideoQA) framework with three major components: 1) a new heterogeneous memory which can effectively learn global context information from appearance and motion…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Chenyou Fan , Xiaofan Zhang , Shu Zhang , Wensheng Wang , Chi Zhang , Heng Huang

Despite the recent broad adoption of Large Language Models (LLMs) across various domains, their potential for enriching information systems in extracting and exploring Linked Data (LD) and Resource Description Framework (RDF) triplestores…

Information Retrieval · Computer Science 2024-09-25 Omar Mussa , Omer Rana , Benoît Goossens , Pablo Orozco-Terwengel , Charith Perera

This paper introduces a scholarly Question Answering (QA) system on top of the NFDI4DataScience Gateway, employing a Retrieval Augmented Generation-based (RAG) approach. The NFDI4DS Gateway, as a foundational framework, offers a unified and…

Computation and Language · Computer Science 2024-06-12 Hamed Babaei Giglou , Tilahun Abedissa Taffa , Rana Abdullah , Aida Usmanova , Ricardo Usbeck , Jennifer D'Souza , Sören Auer

Query Optimization (QO) has become essential for enhancing Large Language Model (LLM) effectiveness, particularly in Retrieval-Augmented Generation (RAG) systems where query quality directly determines retrieval and response performance.…

Computation and Language · Computer Science 2026-03-04 Mingyang Song , Mao Zheng

Retrieval plays a central role in multi-hop question answering (QA), where answering complex questions requires gathering multiple pieces of evidence. We introduce an Agentic Retrieval System that leverages large language models (LLMs) in a…

Computation and Language · Computer Science 2025-10-17 Md Mahadi Hasan Nahid , Davood Rafiei

Retrieval Augmented Generation (RAG) enables Large Language Models (LLMs) to generalize to new information by decoupling reasoning capabilities from static knowledge bases. Traditional RAG enhancements have explored vertical…

Software Engineering · Computer Science 2025-04-30 Michael Iannelli , Sneha Kuchipudi , Vera Dvorak

Multi-entity question answering (MEQA) represents significant challenges for large language models (LLM) and retrieval-augmented generation (RAG) systems, which frequently struggle to consolidate scattered information across diverse…

Computation and Language · Computer Science 2025-09-25 Teng Lin , Yuyu Luo , Honglin Zhang , Jicheng Zhang , Chunlin Liu , Kaishun Wu , Nan Tang

While Retrieval-Augmented Generation (RAG) augments Large Language Models (LLMs) with external knowledge, conventional single-agent RAG remains fundamentally limited in resolving complex queries demanding coordinated reasoning across…

Computation and Language · Computer Science 2025-04-18 Pei Liu , Xin Liu , Ruoyu Yao , Junming Liu , Siyuan Meng , Ding Wang , Jun Ma

Video question answering (VideoQA) is challenging given its multimodal combination of visual understanding and natural language processing. While most existing approaches ignore the visual appearance-motion information at different temporal…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Min Peng , Chongyang Wang , Yuan Gao , Yu Shi , Xiang-Dong Zhou

The Retrieval Question Answering (ReQA) task employs the retrieval-augmented framework, composed of a retriever and generator. The generator formulates the answer based on the documents retrieved by the retriever. Incorporating Large…

Computation and Language · Computer Science 2023-10-31 Haoyan Yang , Zhitao Li , Yong Zhang , Jianzong Wang , Ning Cheng , Ming Li , Jing Xiao

This paper presents MobQA, a benchmark dataset designed to evaluate the semantic understanding capabilities of large language models (LLMs) for human mobility data through natural language question answering. While existing models excel at…

Computation and Language · Computer Science 2025-08-18 Hikaru Asano , Hiroki Ouchi , Akira Kasuga , Ryo Yonetani

To evaluate Large Language Models (LLMs) for question answering (QA), traditional methods typically focus on assessing single-turn responses to given questions. However, this approach doesn't capture the dynamic nature of human-AI…

Computation and Language · Computer Science 2024-11-19 Ruosen Li , Ruochen Li , Barry Wang , Xinya Du