中文
相关论文

相关论文: Large-Scale Answerer in Questioner's Mind for Visu…

200 篇论文

We introduce the new task of Acoustic Question Answering (AQA) to promote research in acoustic reasoning. The AQA task consists of analyzing an acoustic scene composed by a combination of elementary sounds and answering questions that…

机器学习 · 计算机科学 2019-03-01 Jerome Abdelnour , Giampiero Salvi , Jean Rouat

Multi-modal Large Language Models (MLLMs) have introduced a novel dimension to document understanding, i.e., they endow large language models with visual comprehension capabilities; however, how to design a suitable image-text pre-training…

计算机视觉与模式识别 · 计算机科学 2025-03-19 Zining Wang , Tongkun Guan , Pei Fu , Chen Duan , Qianyi Jiang , Zhentao Guo , Shan Guo , Junfeng Luo , Wei Shen , Xiaokang Yang

In traditional Visual Question Generation (VQG), most images have multiple concepts (e.g. objects and categories) for which a question could be generated, but models are trained to mimic an arbitrary choice of concept as given in their…

机器学习 · 计算机科学 2022-07-27 Nihir Vedd , Zixu Wang , Marek Rei , Yishu Miao , Lucia Specia

Visual Question Answering (VQA) is the task of answering a question about an image and requires processing multimodal input and reasoning to obtain the answer. Modular solutions that use declarative representations within the reasoning…

人工智能 · 计算机科学 2024-10-15 Thomas Eiter , Jan Hadl , Nelson Higuera , Johannes Oetsch

Recent advancements in dialogue systems have highlighted the significance of integrating multimodal responses, which enable conveying ideas through diverse modalities rather than solely relying on text-based interactions. This enrichment…

计算与语言 · 计算机科学 2024-07-08 Chang-Sheng Kao , Yun-Nung Chen

Most existing approaches to Visual Question Answering (VQA) answer questions directly, however, people usually decompose a complex question into a sequence of simple sub questions and finally obtain the answer to the original question after…

计算与语言 · 计算机科学 2022-04-05 Ruonan Wang , Yuxi Qian , Fangxiang Feng , Xiaojie Wang , Huixing Jiang

While large language models (LLMs) have shown promise in the table question answering (TQA) task through prompt engineering, they face challenges in industrial applications, including structural heterogeneity, difficulties in target data…

计算与语言 · 计算机科学 2025-09-03 Sishi Xiong , Ziyang He , Zhongjiang He , Yu Zhao , Changzai Pan , Jie Zhang , Zhenhe Wu , Shuangyong Song , Yongxiang Li

Conversational question answering systems often rely on semantic parsing to enable interactive information retrieval, which involves the generation of structured database queries from a natural language input. For information-seeking…

计算与语言 · 计算机科学 2024-01-04 Phillip Schneider , Manuel Klettner , Kristiina Jokinen , Elena Simperl , Florian Matthes

Asking good questions is an essential ability for both human and machine intelligence. However, existing neural question generation approaches mainly focus on the short factoid type of answers. In this paper, we propose a neural question…

计算与语言 · 计算机科学 2022-06-01 Lidiya Murakhovs'ka , Chien-Sheng Wu , Philippe Laban , Tong Niu , Wenhao Liu , Caiming Xiong

Responses generated by neural conversational models tend to lack informativeness and diversity. We present Adversarial Information Maximization (AIM), an adversarial learning strategy that addresses these two related but distinct problems.…

计算与语言 · 计算机科学 2018-11-08 Yizhe Zhang , Michel Galley , Jianfeng Gao , Zhe Gan , Xiujun Li , Chris Brockett , Bill Dolan

This study explores innovative methods for improving Visual Question Answering (VQA) using Generative Adversarial Networks (GANs), autoencoders, and attention mechanisms. Leveraging a balanced VQA dataset, we investigate three distinct…

计算机视觉与模式识别 · 计算机科学 2024-11-13 Panfeng Li , Qikai Yang , Xieming Geng , Wenjing Zhou , Zhicheng Ding , Yi Nian

Recent advancements of large language models (LLMs) have led to claims of AI surpassing humans in natural language processing (NLP) tasks such as textual understanding and reasoning. This work investigates these assertions by introducing…

计算与语言 · 计算机科学 2024-10-10 Maharshi Gor , Hal Daumé , Tianyi Zhou , Jordan Boyd-Graber

We consider the problem of Visual Question Answering (VQA). Given an image and a free-form, open-ended, question, expressed in natural language, the goal of VQA system is to provide accurate answer to this question with respect to the…

计算机视觉与模式识别 · 计算机科学 2021-06-07 Tanzila Rahman , Shih-Han Chou , Leonid Sigal , Giuseppe Carenini

Visual Question Answering (VQA) is a challenging task that has received increasing attention from both the computer vision and the natural language processing communities. Given an image and a question in natural language, it requires…

计算机视觉与模式识别 · 计算机科学 2016-07-21 Qi Wu , Damien Teney , Peng Wang , Chunhua Shen , Anthony Dick , Anton van den Hengel

In this paper, we exploit a memory-augmented neural network to predict accurate answers to visual questions, even when those answers occur rarely in the training set. The memory network incorporates both internal and external memory blocks…

计算机视觉与模式识别 · 计算机科学 2018-03-28 Chao Ma , Chunhua Shen , Anthony Dick , Qi Wu , Peng Wang , Anton van den Hengel , Ian Reid

We present Answer-Me, a task-aware multi-task framework which unifies a variety of question answering tasks, such as, visual question answering, visual entailment, visual reasoning. In contrast to previous works using contrastive or…

计算机视觉与模式识别 · 计算机科学 2022-12-02 AJ Piergiovanni , Wei Li , Weicheng Kuo , Mohammad Saffar , Fred Bertsch , Anelia Angelova

Resolving knowledge conflicts is a crucial challenge in Question Answering (QA) tasks, as the internet contains numerous conflicting facts and opinions. While some research has made progress in tackling ambiguous settings where multiple…

计算与语言 · 计算机科学 2024-10-30 Sagi Shaier , Ari Kobren , Philip Ogren

Conversational question-answering (CQA) systems aim to create interactive search systems that effectively retrieve information by interacting with users. To replicate human-to-human conversations, existing work uses human annotators to play…

计算与语言 · 计算机科学 2023-12-06 Zahra Abbasiantaeb , Yifei Yuan , Evangelos Kanoulas , Mohammad Aliannejadi

AI systems' ability to explain their reasoning is critical to their utility and trustworthiness. Deep neural networks have enabled significant progress on many challenging problems such as visual question answering (VQA). However, most of…

计算与语言 · 计算机科学 2019-06-05 Jialin Wu , Raymond J. Mooney

The rapid advancement of large multimodal models (LMMs) has led to the rapid expansion of artificial intelligence generated videos (AIGVs), which highlights the pressing need for effective video quality assessment (VQA) models designed…

计算机视觉与模式识别 · 计算机科学 2024-11-27 Jiarui Wang , Huiyu Duan , Guangtao Zhai , Juntong Wang , Xiongkuo Min