中文
相关论文

相关论文: MoqaGPT : Zero-Shot Multi-modal Open-domain Questi…

200 篇论文

Recent advancements in Video Question Answering (VideoQA) have introduced LLM-based agents, modular frameworks, and procedural solutions, yielding promising results. These systems use dynamic agents and memory-based mechanisms to break down…

计算机视觉与模式识别 · 计算机科学 2025-05-23 Tony Montes , Fernando Lozano

This paper introduces our proposed system for the MIA Shared Task on Cross-lingual Open-retrieval Question Answering (COQA). In this challenging scenario, given an input question the system has to gather evidence documents from a…

Chart question answering (ChartQA) tasks play a critical role in interpreting and extracting insights from visualization charts. While recent advancements in multimodal large language models (MLLMs) like GPT-4o have shown promise in…

计算与语言 · 计算机科学 2024-11-07 Yifan Wu , Lutao Yan , Leixian Shen , Yunhai Wang , Nan Tang , Yuyu Luo

Large-scale pre-trained models (PTMs) show great zero-shot capabilities. In this paper, we study how to leverage them for zero-shot visual question answering (VQA). Our approach is motivated by a few observations. First, VQA questions often…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Rui Cao , Jing Jiang

In this paper, we introduce SecQA, a novel dataset tailored for evaluating the performance of Large Language Models (LLMs) in the domain of computer security. Utilizing multiple-choice questions generated by GPT-4 based on the "Computer…

计算与语言 · 计算机科学 2023-12-27 Zefang Liu

Molecular property prediction (MPP) is a fundamental and crucial task in drug discovery. However, prior methods are limited by the requirement for a large number of labeled molecules and their restricted ability to generalize for unseen and…

定量方法 · 定量生物学 2024-10-21 Yuyan Liu , Sirui Ding , Sheng Zhou , Wenqi Fan , Qiaoyu Tan

Document Question Answering (DocQA) is a very common task. Existing methods using Large Language Models (LLMs) or Large Vision Language Models (LVLMs) and Retrieval Augmented Generation (RAG) often prioritize information from a single…

机器学习 · 计算机科学 2025-03-19 Siwei Han , Peng Xia , Ruiyi Zhang , Tong Sun , Yun Li , Hongtu Zhu , Huaxiu Yao

Large Language Models (LLMs) are advanced deep-learning models designed to understand and generate human language. They work together with models that process data like images, enabling cross-modal understanding. However, existing…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Shreya Singh

Face Recognition Systems (FRS) are increasingly vulnerable to face-morphing attacks, prompting the development of Morphing Attack Detection (MAD) algorithms. However, a key challenge in MAD lies in its limited generalizability to unseen…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Haoyu Zhang , Raghavendra Ramachandra , Kiran Raja , Christoph Busch

Advances in automated essay scoring (AES) have traditionally relied on labeled essays, requiring tremendous cost and expertise for their acquisition. Recently, large language models (LLMs) have achieved great success in various tasks, but…

计算与语言 · 计算机科学 2024-10-07 Sanwoo Lee , Yida Cai , Desong Meng , Ziyang Wang , Yunfang Wu

Relation extraction (RE) consistently involves a certain degree of labeled or unlabeled data even if under zero-shot setting. Recent studies have shown that large language models (LLMs) transfer well to new tasks out-of-the-box simply given…

人工智能 · 计算机科学 2023-11-27 Guozheng Li , Peng Wang , Wenjun Ke

Large language models (LLMs) have shown impressive ability for open-domain NLP tasks. However, LLMs are sometimes too footloose for natural language understanding (NLU) tasks which always have restricted output and input format. Their…

With the rise of large-scale pre-trained language models, open-domain question-answering (ODQA) has become an important research topic in NLP. Based on the popular pre-training fine-tuning approach, we posit that an additional in-domain…

计算与语言 · 计算机科学 2022-05-03 Patrick Huber , Armen Aghajanyan , Barlas Oğuz , Dmytro Okhonko , Wen-tau Yih , Sonal Gupta , Xilun Chen

Large Language Models (LLMs), primarily trained on text-based datasets, exhibit exceptional proficiencies in understanding and executing complex linguistic instructions via text outputs. However, they falter when requests to generate…

计算机视觉与模式识别 · 计算机科学 2023-09-15 Xinyu Wang , Bohan Zhuang , Qi Wu

Large language models (LLMs) have garnered significant attention, but the definition of "large" lacks clarity. This paper focuses on medium-sized language models (MLMs), defined as having at least six billion parameters but less than 100…

计算与语言 · 计算机科学 2023-07-06 René Peinl , Johannes Wirth

We explore Multimodal Large Language Models (MLLMs), which integrate LLMs like GPT-4 to handle multimodal data, including text, images, audio, and more. MLLMs demonstrate capabilities such as generating image captions and answering…

计算与语言 · 计算机科学 2025-01-09 Shezheng Song , Xiaopeng Li , Shasha Li , Shan Zhao , Jie Yu , Jun Ma , Xiaoguang Mao , Weimin Zhang

We introduce KG-MuLQA (Knowledge-Graph-based Multi-Level Question-Answer Extraction): a framework that (1) extracts QA pairs at multiple complexity levels (2) along three key dimensions -- multi-hop retrieval, set operations, and answer…

Large Language Models (LLMs) have been showing promising results for various NLP-tasks without the explicit need to be trained for these tasks by using few-shot or zero-shot prompting techniques. A common NLP-task is question-answering…

计算与语言 · 计算机科学 2024-12-18 Kevin Fischer , Darren Fürst , Sebastian Steindl , Jakob Lindner , Ulrich Schäfer

Generative question answering (QA) models generate answers to questions either solely based on the parameters of the model (the closed-book setting) or additionally retrieving relevant evidence (the open-book setting). Generative QA models…

计算与语言 · 计算机科学 2022-10-11 Zhengbao Jiang , Jun Araki , Haibo Ding , Graham Neubig

Recent studies report that autoregressive language models can successfully solve many NLP tasks via zero- and few-shot learning paradigms, which opens up new possibilities for using the pre-trained language models. This paper introduces two…