English
Related papers

Related papers: Transformer Module Networks for Systematic General…

200 papers

Neural Module Networks (NMNs) aim at Visual Question Answering (VQA) via composition of modules that tackle a sub-task. NMNs are a promising strategy to achieve systematic generalization, i.e., overcoming biasing factors in the training…

Machine Learning · Computer Science 2022-01-19 Vanessa D'Amario , Tomotake Sasaki , Xavier Boix

Neural Module Networks (NMN) are a compelling method for visual question answering, enabling the translation of a question into a program consisting of a series of reasoning sub-tasks that are sequentially executed on the image to produce…

Computation and Language · Computer Science 2023-10-25 Wafa Aissa , Marin Ferecatu , Michel Crucianu

We propose a general framework called Text Modular Networks(TMNs) for building interpretable systems that learn to solve complex tasks by decomposing them into simpler ones solvable by existing models. To ensure solvability of simpler…

Computation and Language · Computer Science 2021-04-14 Tushar Khot , Daniel Khashabi , Kyle Richardson , Peter Clark , Ashish Sabharwal

Neural Module Network (NMN) exhibits strong interpretability and compositionality thanks to its handcrafted neural modules with explicit multi-hop reasoning capability. However, most NMNs suffer from two critical drawbacks: 1) scalability:…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Wenhu Chen , Zhe Gan , Linjie Li , Yu Cheng , William Wang , Jingjing Liu

Natural language questions are inherently compositional, and many are most easily answered by reasoning about their decomposition into modular sub-problems. For example, to answer "is there an equal number of balls and boxes?" we can look…

Computer Vision and Pattern Recognition · Computer Science 2017-09-13 Ronghang Hu , Jacob Andreas , Marcus Rohrbach , Trevor Darrell , Kate Saenko

The compositional generalization abilities of neural models have been sought after for human-like linguistic competence. The popular method to evaluate such abilities is to assess the models' input-output behavior. However, that does not…

Computation and Language · Computer Science 2025-02-24 Ryoma Kumon , Hitomi Yanaka

Neural module networks (NMN) have achieved success in image-grounded tasks such as Visual Question Answering (VQA) on synthetic images. However, very limited work on NMN has been studied in the video-grounded dialogue tasks. These tasks…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Hung Le , Nancy F. Chen , Steven C. H. Hoi

Answering compositional questions that require multiple steps of reasoning against text is challenging, especially when they involve discrete, symbolic operations. Neural module networks (NMNs) learn to parse such questions as executable…

Computation and Language · Computer Science 2020-02-18 Nitish Gupta , Kevin Lin , Dan Roth , Sameer Singh , Matt Gardner

Visual Question Answering (VQA) is fundamentally compositional in nature, and many questions are simply answered by decomposing them into modular sub-problems. The recent proposed Neural Module Network (NMN) employ this strategy to question…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Yudong Han , Jianhua Yin , Jianlong Wu , Yinwei Wei , Liqiang Nie

Modular neural networks outperform nonmodular neural networks on tasks ranging from visual question answering to robotics. These performance improvements are thought to be due to modular networks' superior ability to model the compositional…

Machine Learning · Computer Science 2025-03-12 Akhilan Boopathy , Sunshine Jiang , William Yue , Jaedong Hwang , Abhiram Iyer , Ila Fiete

Numerical reasoning skills are essential for complex question answering (CQA) over text. It requires opertaions including counting, comparison, addition and subtraction. A successful approach to CQA on text, Neural Module Networks (NMNs),…

Computation and Language · Computer Science 2021-09-07 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

Visual Question Answering (VQA) models have achieved significant success in recent times. Despite the success of VQA models, they are mostly black-box models providing no reasoning about the predicted answer, thus raising questions for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Nihar Bendre , Kevin Desai , Peyman Najafirad

This paper studies the task of Visual Question Answering (VQA), which is topical in Multimedia community recently. Particularly, we explore two critical research problems existed in VQA: (1) efficiently fusing the visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Yanze Wu , Qiang Sun , Jianqi Ma , Bin Li , Yanwei Fu , Yao Peng , Xiangyang Xue

Neural module networks (NMNs) are a popular approach for modeling compositionality: they achieve high accuracy when applied to problems in language and vision, while reflecting the compositional structure of the problem in the network…

Computation and Language · Computer Science 2020-09-09 Sanjay Subramanian , Ben Bogin , Nitish Gupta , Tomer Wolfson , Sameer Singh , Jonathan Berant , Matt Gardner

Neural networks (NNs) whose subnetworks implement reusable functions are expected to offer numerous advantages, including compositionality through efficient recombination of functional building blocks, interpretability, preventing…

Neural and Evolutionary Computing · Computer Science 2021-03-09 Róbert Csordás , Sjoerd van Steenkiste , Jürgen Schmidhuber

Answering complex questions that require multi-step multi-type reasoning over raw text is challenging, especially when conducting numerical reasoning. Neural Module Networks(NMNs), follow the programmer-interpreter framework and design…

Computation and Language · Computer Science 2022-10-07 Jiayi Chen , Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

A number of machine learning models have been proposed with the goal of achieving systematic generalization: the ability to reason about new situations by combining aspects of previous experiences. These models leverage compositional…

Machine Learning · Computer Science 2024-09-24 Devon Jarvis , Richard Klein , Benjamin Rosman , Andrew M. Saxe

Transformers have achieved remarkable success across diverse domains, but their monolithic architecture presents challenges in interpretability, adaptability, and scalability. This paper introduces a novel modular Transformer architecture…

Machine Learning · Computer Science 2025-01-07 Zhenyu Guo , Wenguang Chen

Modern neural machine translation (NMT) models have achieved competitive performance in standard benchmarks. However, they have recently been shown to suffer limitation in compositional generalization, failing to effectively learn the…

Computation and Language · Computer Science 2022-10-14 Yongjing Yin , Yafu Li , Fandong Meng , Jie Zhou , Yue Zhang

Astounding results from Transformer models on natural language tasks have intrigued the vision community to study their application to computer vision problems. Among their salient benefits, Transformers enable modeling long dependencies…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Salman Khan , Muzammal Naseer , Munawar Hayat , Syed Waqas Zamir , Fahad Shahbaz Khan , Mubarak Shah
‹ Prev 1 2 3 10 Next ›