English
Related papers

Related papers: Learning Sparse Mixture of Experts for Visual Ques…

200 papers

Convolutional Neural Networks have played a significant role in various medical imaging tasks like classification and segmentation. They provide state-of-the-art performance compared to classical image processing algorithms. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Rakshith Sathish , Swanand Khare , Debdoot Sheet

Visual Question Answering (VQA) is an extremely stimulating and challenging research area where Computer Vision (CV) and Natural Language Processig (NLP) have recently met. In image captioning and video summarization, the semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Silvio Barra , Carmen Bisogni , Maria De Marsico , Stefano Ricciardi

Medical visual question answering (Med-VQA) is a machine learning task that aims to create a system that can answer natural language questions based on given medical images. Although there has been rapid progress on the general VQA task,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Louisa Canepa , Sonit Singh , Arcot Sowmya

A number of recent works have proposed attention models for Visual Question Answering (VQA) that generate spatial maps highlighting image regions relevant to answering the question. In this paper, we argue that in addition to modeling…

Computer Vision and Pattern Recognition · Computer Science 2017-01-20 Jiasen Lu , Jianwei Yang , Dhruv Batra , Devi Parikh

Visual Question Answering (VQA) is a complex task requiring large datasets and expensive training. Neural Module Networks (NMN) first translate the question to a reasoning path, then follow that path to analyze the image and provide an…

Computation and Language · Computer Science 2023-03-28 Wafa Aissa , Marin Ferecatu , Michel Crucianu

Visual Question Answering (VQA) has recently emerged as a potential research domain, captivating the interest of many in the field of artificial intelligence and computer vision. Despite the prevalence of approaches in English, there is a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-01 Ngoc Son Nguyen , Van Son Nguyen , Tung Le

Convolutional neural networks (CNNs) have been tremendously successful in solving imaging inverse problems. To understand their success, an effective strategy is to construct simpler and mathematically more tractable convolutional sparse…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Tianlin Liu , Anadi Chaman , David Belius , Ivan Dokmanić

In the context of fine-grained visual categorization, the ability to interpret models as human-understandable visual manuals is sometimes as important as achieving high classification accuracy. In this paper, we propose a novel Part-Stacked…

Computer Vision and Pattern Recognition · Computer Science 2019-08-17 Shaoli Huang , Zhe Xu , Dacheng Tao , Ya Zhang

In this paper, we propose a novel Question-Guided Hybrid Convolution (QGHC) network for Visual Question Answering (VQA). Most state-of-the-art VQA methods fuse the high-level textual and visual features from the neural network and abandon…

Computer Vision and Pattern Recognition · Computer Science 2018-08-09 Peng Gao , Pan Lu , Hongsheng Li , Shuang Li , Yikang Li , Steven Hoi , Xiaogang Wang

Photoacoustic microscopy (PAM) has been a promising biomedical imaging technology in recent years. However, the point-by-point scanning mechanism results in low-speed imaging, which limits the application of PAM. Reducing sampling density…

Image and Video Processing · Electrical Eng. & Systems 2020-06-09 Jiasheng Zhou , Da He , Xiaoyu Shang , Zhendong Guo , Sung-liang Chen , Jiajia Luo

In this work, we propose a deep neural architecture that uses an attention mechanism which utilizes region based image features, the natural language question asked, and semantic knowledge extracted from the regions of an image to produce…

Computation and Language · Computer Science 2021-04-06 Tasmia Tasrin , Md Sultan Al Nahian , Brent Harrison

The deployment of deep convolutional neural networks (CNNs) in many real world applications is largely hindered by their high computational cost. In this paper, we propose a novel learning scheme for CNNs to simultaneously 1) reduce the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-23 Zhuang Liu , Jianguo Li , Zhiqiang Shen , Gao Huang , Shoumeng Yan , Changshui Zhang

This paper studies the task of Visual Question Answering (VQA), which is topical in Multimedia community recently. Particularly, we explore two critical research problems existed in VQA: (1) efficiently fusing the visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Yanze Wu , Qiang Sun , Jianqi Ma , Bin Li , Yanwei Fu , Yao Peng , Xiangyang Xue

Convolutional Neural Networks (CNNs) have achieved remarkable success in various computer vision tasks but rely on tremendous computational cost. To solve this problem, existing approaches either compress well-trained large-scale models or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Chen Zhang , Yinghao Xu , Yujun Shen

Visual Question Answering (VQA) concerns providing answers to Natural Language questions about images. Several deep neural network approaches have been proposed to model the task in an end-to-end fashion. Whereas the task is grounded in…

Artificial Intelligence · Computer Science 2020-02-03 Mehrdad Alizadeh , Barbara Di Eugenio

Object detection is a challenging task in visual understanding domain, and even more so if the supervision is to be weak. Recently, few efforts to handle the task without expensive human annotations is established by promising deep neural…

Computer Vision and Pattern Recognition · Computer Science 2016-11-28 Ali Diba , Vivek Sharma , Ali Pazandeh , Hamed Pirsiavash , Luc Van Gool

Convolutional Neural Networks (CNNs) are widely used in deep learning applications, e.g. visual systems, robotics etc. However, existing software solutions are not efficient. Therefore, many hardware accelerators have been proposed…

Machine Learning · Computer Science 2021-09-08 Sasindu Wijeratne , Sandaruwan Jayaweera , Mahesh Dananjaya , Ajith Pasqual

A key solution to visual question answering (VQA) exists in how to fuse visual and language features extracted from an input image and question. We show that an attention mechanism that enables dense, bi-directional interactions between the…

Computer Vision and Pattern Recognition · Computer Science 2018-12-04 Duy-Kien Nguyen , Takayuki Okatani

Convolutional neural network inference on video data requires powerful hardware for real-time processing. Given the inherent coherence across consecutive frames, large parts of a video typically change little. By skipping identical image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Mathias Parger , Chengcheng Tang , Christopher D. Twigg , Cem Keskin , Robert Wang , Markus Steinberger

Recent advancements in machine learning-based signal analysis, coupled with open data initiatives, have fuelled efforts in automatic sleep stage classification. Despite the proliferation of classification models, few have prioritised…

Machine Learning · Computer Science 2026-03-25 Stephan Goerttler , Yucheng Wang , Emadeldeen Eldele , Min Wu , Fei He