English
Related papers

Related papers: Neural Multi-Step Reasoning for Question Answering…

200 papers

Humans intuitively solve complex problems by flexibly shifting among reasoning modes: they plan, execute, revise intermediate goals, resolve ambiguity through associative judgment, and apply formal procedures to well-specified subproblems.…

Creating challenging tabular inference data is essential for learning complex reasoning. Prior work has mostly relied on two data generation strategies. The first is human annotation, which yields linguistically diverse data but is…

Computation and Language · Computer Science 2022-11-24 Aashna Jena , Vivek Gupta , Manish Shrivastava , Julian Martin Eisenschlos

Many vision and language tasks require commonsense reasoning beyond data-driven image and natural language processing. Here we adopt Visual Question Answering (VQA) as an example task, where a system is expected to answer a question in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Somak Aditya , Yezhou Yang , Chitta Baral

This paper presents a study of employing Ranking SVM and Convolutional Neural Network for two missions: legal information retrieval and question answering in the Competition on Legal Information Extraction/Entailment. For the first task,…

Computation and Language · Computer Science 2017-03-17 Phong-Khac Do , Huy-Tien Nguyen , Chien-Xuan Tran , Minh-Tien Nguyen , Minh-Le Nguyen

Text-to-SQL parsing is an essential and challenging task. The goal of text-to-SQL parsing is to convert a natural language (NL) question to its corresponding structured query language (SQL) based on the evidences provided by relational…

Computation and Language · Computer Science 2022-08-30 Bowen Qin , Binyuan Hui , Lihan Wang , Min Yang , Jinyang Li , Binhua Li , Ruiying Geng , Rongyu Cao , Jian Sun , Luo Si , Fei Huang , Yongbin Li

Various human activities can be abstracted into a sequence of actions in natural text, i.e. cooking, repairing, manufacturing, etc. Such action sequences heavily depend on the executing order, while disorder in action sequences leads to…

Computation and Language · Computer Science 2023-06-08 Weizhi Wang , Hong Wang , Xifeng Yan

Current approaches for training Process Reward Models (PRMs) often involve breaking down responses into multiple reasoning steps using rule-based techniques, such as using predefined placeholder tokens or setting the reasoning step's length…

Artificial Intelligence · Computer Science 2025-06-03 Yuliang Liu , Junjie Lu , Zhaoling Chen , Chaofeng Qu , Jason Klein Liu , Chonghan Liu , Zefan Cai , Yunhui Xia , Li Zhao , Jiang Bian , Chuheng Zhang , Wei Shen , Zhouhan Lin

Mathematical reasoning is regarded as a necessary ability for Language Models (LMs). Recent works demonstrate large LMs' impressive performance in solving math problems. The success is attributed to their Chain-of-Thought (CoT) reasoning…

Computation and Language · Computer Science 2023-06-08 Tianduo Wang , Wei Lu

Large language models (LLMs) have shown an impressive ability to perform tasks believed to require thought processes. When the model does not document an explicit thought process, it becomes difficult to understand the processes occurring…

Computation and Language · Computer Science 2024-06-21 Yuval Shalev , Amir Feder , Ariel Goldstein

Recent work in semantic parsing for question answering has focused on long and complicated questions, many of which would seem unnatural if asked in a normal conversation between two humans. In an effort to explore a conversational QA…

Computation and Language · Computer Science 2016-11-07 Mohit Iyyer , Wen-tau Yih , Ming-Wei Chang

A vast majority of computation in the brain is performed by spiking neural networks. Despite the ubiquity of such spiking, we currently lack an understanding of how biological spiking neural circuits learn and compute in-vivo, as well as…

Neurons and Cognition · Quantitative Biology 2018-05-31 Friedemann Zenke , Surya Ganguli

Multi-hop question answering (QA) necessitates multi-step reasoning and retrieval across interconnected subjects, attributes, and relations. Existing retrieval-augmented generation (RAG) methods struggle to capture these structural…

Computation and Language · Computer Science 2026-02-19 Jimeng Shi , Wei Hu , Runchu Tian , Bowen Jin , Wonbin Kweon , SeongKu Kang , Yunfan Kang , Dingqi Ye , Sizhe Zhou , Shaowen Wang , Jiawei Han

This study focuses on Embodied Complex-Question Answering task, which means the embodied robot need to understand human questions with intricate structures and abstract semantics. The core of this task lies in making appropriate plans based…

Robotics · Computer Science 2025-04-02 Ning Lan , Baoshan Ou , Xuemei Xie , Guangming Shi

Recent advances in machine learning have led to a surge in adoption of neural networks for various tasks, but lack of interpretability remains an issue for many others in which an understanding of the features influencing the prediction is…

Deep neural networks have proved to be a very effective way to perform classification tasks. They excel when the input data is high dimensional, the relationship between the input and the output is complicated, and the number of labeled…

Machine Learning · Computer Science 2017-11-28 Nicholas Frosst , Geoffrey Hinton

Neurosymbolic systems promise to combine deep neural network's (DNN) processing of raw sensor inputs with few-shot performance of symbolic artificial intelligence. Two-stage approaches explicitly decouple DNN based perception from…

Machine Learning · Computer Science 2026-05-12 Sparsh Tiwari , Bettina Finzel , Gesina Schwalbe

Large Language Models (LLMs) excel in natural language tasks but still face challenges in Question Answering (QA) tasks requiring complex, multi-step reasoning. We outline the types of reasoning required in some of these tasks, and reframe…

Computation and Language · Computer Science 2025-02-17 Nick Ferguson , Liane Guillou , Alan Bundy , Kwabena Nuamah

Advancements in artificial intelligence for molecular science are necessitating a paradigm shift from purely data-driven predictions to knowledge-guided computational reasoning. Existing molecular models are predominantly proprietary,…

Machine Learning · Computer Science 2026-03-16 Pengfei Liu , Shuang Ge , Jun Tao , Zhixiang Ren

Semi-structured explanation depicts the implicit process of a reasoner with an explicit representation. This explanation highlights how available information in a specific query is utilised and supplemented with information a reasoner…

Computation and Language · Computer Science 2024-01-25 Jiuzhou Han , Wray Buntine , Ehsan Shareghi

Recent years have witnessed the burgeoning of pretrained language models (LMs) for text-based natural language (NL) understanding tasks. Such models are typically trained on free-form NL text, hence may not be suitable for tasks like…

Computation and Language · Computer Science 2020-05-19 Pengcheng Yin , Graham Neubig , Wen-tau Yih , Sebastian Riedel