English
Related papers

Related papers: Seeing is Knowing! Fact-based Visual Question Answ…

200 papers

Knowledge Graphs (KGs) and their machine learning counterpart, Knowledge Graph Embedding Models (KGEMs), have seen ever-increasing use in a wide variety of academic and applied settings. In particular, KGEMs are typically applied to KGs to…

Machine Learning · Computer Science 2024-12-16 Jeffrey Sardina , John D. Kelleher , Declan O'Sullivan

Fact-checking is a crucial task as it ensures the prevention of misinformation. However, manual fact-checking cannot keep up with the rate at which false information is generated and disseminated online. Automated fact-checking by machines…

Artificial Intelligence · Computer Science 2023-10-12 Gustav Nikopensius , Mohit Mayank , Orchid Chetia Phukan , Rajesh Sharma

We propose the task of free-form and open-ended Visual Question Answering (VQA). Given an image and a natural language question about the image, the task is to provide an accurate natural language answer. Mirroring real-world scenarios,…

Computation and Language · Computer Science 2016-10-28 Aishwarya Agrawal , Jiasen Lu , Stanislaw Antol , Margaret Mitchell , C. Lawrence Zitnick , Dhruv Batra , Devi Parikh

Knowledge Graphs (KGs) store structured factual knowledge by linking entities through relationships, crucial for many applications. These applications depend on the KG's factual accuracy, so verifying facts is essential, yet challenging.…

Databases · Computer Science 2026-02-12 Farzad Shami , Stefano Marchesin , Gianmaria Silvello

The multi-relational Knowledge Base Question Answering (KBQA) system performs multi-hop reasoning over the knowledge graph (KG) to achieve the answer. Recent approaches attempt to introduce the knowledge graph embedding (KGE) technique to…

Computation and Language · Computer Science 2021-11-01 Guanglin Niu , Yang Li , Chengguang Tang , Zhongkai Hu , Shibin Yang , Peng Li , Chengyu Wang , Hao Wang , Jian Sun

Visual Question Answering (VQA) has been a popular task that combines vision and language, with numerous relevant implementations in literature. Even though there are some attempts that approach explainability and robustness issues in VQA…

Computation and Language · Computer Science 2024-05-06 Theodoti Stoikou , Maria Lymperaiou , Giorgos Stamou

In Knowledge Graphs (KGs), where the schema of the data is usually defined by particular ontologies, reasoning is a necessity to perform a range of tasks, such as retrieval of information, question answering, and the derivation of new…

Artificial Intelligence · Computer Science 2025-02-27 Anastasios Nentidis , Charilaos Akasiadis , Angelos Charalambidis , Alexander Artikis

Biomedical knowledge graphs (KG) are heterogenous networks consisting of biological entities as nodes and relations between them as edges. These entities and relations are extracted from millions of research papers and unified in a single…

Artificial Intelligence · Computer Science 2022-11-11 Dattaraj J. Rao , Shraddha S. Mane , Mukta A. Paliwal

Medical visual question answering (Med-VQA) is a crucial multimodal task in clinical decision support and telemedicine. Recent methods fail to fully leverage domain-specific medical knowledge, making it difficult to accurately associate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Xianyao Zheng , Hong Yu , Hui Cui , Changming Sun , Xiangyu Li , Ran Su , Leyi Wei , Jia Zhou , Junbo Wang , Qiangguo Jin

Recent advances in information extraction have motivated the automatic construction of huge Knowledge Graphs (KGs) by mining from large-scale text corpus. However, noisy facts are unavoidably introduced into KGs that could be caused by…

Computation and Language · Computer Science 2020-08-18 Yaqing Wang , Fenglong Ma , Jing Gao

Visual Question Answering (VQA) is a complex semantic task requiring both natural language processing and visual recognition. In this paper, we explore whether VQA is solvable when images are captured in a sub-Nyquist compressive paradigm.…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Li-Chi Huang , Kuldeep Kulkarni , Anik Jha , Suhas Lohit , Suren Jayasuriya , Pavan Turaga

Knowledge graph question answering (KGQA) based on information retrieval aims to answer a question by retrieving answer from a large-scale knowledge graph. Most existing methods first roughly retrieve the knowledge subgraphs (KSG) that may…

Computation and Language · Computer Science 2022-10-06 Hanning Gao , Lingfei Wu , Po Hu , Zhihua Wei , Fangli Xu , Bo Long

Knowledge Graphs (KGs) have gained considerable attention recently from both academia and industry. In fact, incorporating graph technology and the copious of various graph datasets have led the research community to build sophisticated…

Artificial Intelligence · Computer Science 2020-06-03 Bilal Abu-Salih , Marwan Al-Tawil , Ibrahim Aljarah , Hossam Faris , Pornpit Wongthongtham

Incorporating multiple knowledge sources is proven to be beneficial for answering complex factoid questions. To utilize multiple knowledge bases (KB), previous works merge all KBs into a single graph via entity alignment and reduce the…

Computation and Language · Computer Science 2023-09-12 Minhao Zhang , Yongliang Ma , Yanzeng Li , Ruoyu Zhang , Lei Zou , Ming Zhou

Previous studies such as VizWiz find that Visual Question Answering (VQA) systems that can read and reason about text in images are useful in application areas such as assisting visually-impaired people. TextVQA is a VQA dataset geared…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Michael Yang , Aditya Anantharaman , Zachary Kitowski , Derik Clive Robert

Open Domain Question Answering (QA) is evolving from complex pipelined systems to end-to-end deep neural networks. Specialized neural models have been developed for extracting answers from either text alone or Knowledge Bases (KBs) alone.…

Computation and Language · Computer Science 2018-09-05 Haitian Sun , Bhuwan Dhingra , Manzil Zaheer , Kathryn Mazaitis , Ruslan Salakhutdinov , William W. Cohen

Knowledge-based visual question answering (QA) aims to answer a question which requires visually-grounded external knowledge beyond image content itself. Answering complex questions that require multi-hop reasoning under weak supervision is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-25 Yu-Jung Heo , Eun-Sol Kim , Woo Suk Choi , Byoung-Tak Zhang

Knowledge graphs (KGs) have shown to be an important asset of large companies like Google and Microsoft. KGs play an important role in providing structured and semantically rich information, making them available to people and machines, and…

Databases · Computer Science 2020-05-05 Elwin Huaman , Elias Kärle , Dieter Fensel

Knowledge Graph (KG) powered question answering (QA) performs complex reasoning over language semantics as well as knowledge facts. Graph Neural Networks (GNNs) learn to aggregate information from the underlying KG, which is combined with…

Computation and Language · Computer Science 2024-02-07 Costas Mavromatis , Petros Karypis , George Karypis

The predominant approach to Visual Question Answering (VQA) demands that the model represents within its weights all of the information required to answer any question about any image. Learning this information from any real training set…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Damien Teney , Anton van den Hengel