English
Related papers

Related papers: Challenges in Procedural Multimodal Machine Compre…

200 papers

Multi-hop reading comprehension requires not only the ability to reason over raw text but also the ability to combine multiple evidence. We propose a novel learning approach that helps language models better understand difficult multi-hop…

Computation and Language · Computer Science 2022-11-08 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

Multiclass classification (MCC) is a fundamental machine learning problem of classifying each instance into one of a predefined set of classes. In the deep learning era, extensive efforts have been spent on developing more powerful neural…

Machine Learning · Computer Science 2022-12-22 Nan Wang , Zhen Qin , Le Yan , Honglei Zhuang , Xuanhui Wang , Michael Bendersky , Marc Najork

Sequential recommendation systems aim to predict users' next preferences based on their interaction histories, but existing approaches face critical limitations in efficiency and multi-scale pattern recognition. While Transformer-based…

Information Retrieval · Computer Science 2025-05-08 Qianru Zhang , Liang Qu , Honggang Wen , Dong Huang , Siu-Ming Yiu , Nguyen Quoc Viet Hung , Hongzhi Yin

Due to the severe lack of labeled data, existing methods of medical visual question answering usually rely on transfer learning to obtain effective image feature representation and use cross-modal fusion of visual and linguistic features to…

Multimedia · Computer Science 2021-05-04 Haifan Gong , Guanqi Chen , Sishuo Liu , Yizhou Yu , Guanbin Li

The perception system for autonomous driving generally requires to handle multiple diverse sub-tasks. However, current algorithms typically tackle individual sub-tasks separately, which leads to low efficiency when aiming at obtaining…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xuesong Chen , Shaoshuai Shi , Tao Ma , Jingqiu Zhou , Simon See , Ka Chun Cheung , Hongsheng Li

Large language models perform well on many medical QA benchmarks, but real clinical reasoning often requires integrating evidence across multiple images rather than interpreting a single view. We introduce MedThinkVQA, an expert-annotated…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Zonghai Yao , Benlu Wang , Yifan Zhang , Junda Wang , Iris Xia , Zhipeng Tang , Shuo Han , Feiyun Ouyang , Zhichao Yang , Arman Cohan , Hong Yu

We present an accurate and interpretable method for answer extraction in machine reading comprehension that is reminiscent of case-based reasoning (CBR) from classical AI. Our method (CBR-MRC) builds upon the hypothesis that contextualized…

Computation and Language · Computer Science 2025-11-27 Dung Thai , Dhruv Agarwal , Mudit Chaudhary , Wenlong Zhao , Rajarshi Das , Manzil Zaheer , Jay-Yoon Lee , Hannaneh Hajishirzi , Andrew McCallum

Pre-trained Language Models (PLMs) have achieved great success on Machine Reading Comprehension (MRC) over the past few years. Although the general language representation learned from large-scale corpora does benefit MRC, the poor support…

Computation and Language · Computer Science 2021-05-19 Fangkai Jiao , Yangyang Guo , Yilin Niu , Feng Ji , Feng-Lin Li , Liqiang Nie

Concept Bottleneck Models (CBM) are inherently interpretable models that factor model decisions into human-readable concepts. They allow people to easily understand why a model is failing, a critical feature for high-stakes applications.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Yue Yang , Artemis Panagopoulou , Shenghao Zhou , Daniel Jin , Chris Callison-Burch , Mark Yatskar

Concept Bottleneck Models (CBMs) have become a popular approach to enable interpretability in neural networks by constraining classifier inputs to a set of human-understandable concepts. While effective, current models embed concepts in…

Machine Learning · Computer Science 2026-05-13 Daniel Uyterlinde , Swasti Shreya Mishra , Pascal Mettes

Protein analysis tasks arising in healthcare settings often require accurate reasoning under protein sequence constraints, involving tasks such as functional interpretation of disease-related variants, protein-level analysis for clinical…

Artificial Intelligence · Computer Science 2026-03-03 Congying Liu , Taihao Li , Ming Huang , Xingyuan Wei , Peipei Liu , Yiqing Shen , Yanxu Mao , Tiehan Cui

In this paper, we introduce the Reinforced Mnemonic Reader for machine reading comprehension tasks, which enhances previous attentive readers in two aspects. First, a reattention mechanism is proposed to refine current attentions by…

Computation and Language · Computer Science 2018-06-07 Minghao Hu , Yuxing Peng , Zhen Huang , Xipeng Qiu , Furu Wei , Ming Zhou

Current state-of-the-art reading comprehension models rely heavily on recurrent neural networks. We explored an entirely different approach to question answering: a convolutional model. By their nature, these convolutional models are fast…

Computation and Language · Computer Science 2018-10-23 Tobin Bell , Benjamin Penchas

Many structured prediction tasks in machine vision have a collection of acceptable answers, instead of one definitive ground truth answer. Segmentation of images, for example, is subject to human labeling bias. Similarly, there are multiple…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Michael Firman , Neill D. F. Campbell , Lourdes Agapito , Gabriel J. Brostow

Concept Bottleneck Models (CBMs) ground predictions in human-understandable concepts but face fundamental limitations: the absence of a metric to pre-evaluate concept relevance, the "linearity problem" causing recent CBMs to bypass the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Merve Tapli , Quentin Bouniot , Wolfgang Stammer , Zeynep Akata , Emre Akbas

This work explores the challenge of building ``Machines that Can Remember'', framing long-term memory as the problem of efficient ultra-long context modeling. We argue that this requires three key properties: \textbf{sparsity},…

Computation and Language · Computer Science 2025-12-01 Xiang Hu , Zhanchao Zhou , Ruiqi Liang , Zehuan Li , Wei Wu , Jianguo Li

Machine comprehension of text is an important problem in natural language processing. A recently released dataset, the Stanford Question Answering Dataset (SQuAD), offers a large number of real questions and their answers created by humans…

Computation and Language · Computer Science 2016-11-08 Shuohang Wang , Jing Jiang

Multiple-choice Reading Comprehension (MCRC) models aim to select the correct answer from a set of candidate options for a given question. However, they typically lack the ability to explain the reasoning behind their choices. In this…

Computation and Language · Computer Science 2026-03-02 Trung Tien Cao , Lam Minh Thai , Nghia Hieu Nguyen , Duc-Vu Nguyen , Ngan Luu-Thuy Nguyen

Accurately answering complex questions has consistently been a significant challenge for Large Language Models (LLMs). To address this, this paper proposes a multi-hop question decomposition method for complex questions, building upon…

Computation and Language · Computer Science 2025-09-08 Zucheng Liang , Wenxin Wei , Kaijie Zhang , Hongyi Chen

Multimodal Large Language Models (MLLMs) have achieved remarkable success in open-vocabulary perceptual tasks, yet their ability to solve complex cognitive problems remains limited, especially when visual details are abstract and require…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Boyi Li , Yifan Shen , Yuanzhe Liu , Yifan Xu , Jiateng Liu , Xinzhuo Li , Zhengyuan Li , Jingyuan Zhu , Yunhan Zhong , Fangzhou Lan , Jianguo Cao , James M. Rehg , Heng Ji , Ismini Lourentzou , Xu Cao