English
Related papers

Related papers: Semantic Bridge: Universal Multi-Hop Question Gene…

200 papers

Training models on synthetic data has emerged as an increasingly important strategy for improving the performance of generative AI. This approach is particularly helpful for large multimodal models (LMMs) due to the relative scarcity of…

Artificial Intelligence · Computer Science 2026-01-13 Gabriela Ben Melech Stan , Estelle Aflalo , Avinash Madasu , Vasudev Lal , Phillip Howard

Current LLM training positions mathematical reasoning as a core capability. With publicly available sources fully tapped, there is unmet demand for diverse and challenging math questions. Relying solely on human experts is both…

Artificial Intelligence · Computer Science 2025-02-04 Vedant Shah , Dingli Yu , Kaifeng Lyu , Simon Park , Jiatong Yu , Yinghui He , Nan Rosemary Ke , Michael Mozer , Yoshua Bengio , Sanjeev Arora , Anirudh Goyal

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge. Current hybrid RAG system retrieves evidence from both knowledge graphs (KGs) and text documents to support LLM reasoning.…

Computation and Language · Computer Science 2025-09-22 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Liming Zhu , Wenjie Zhang

Controllable and transparent text generation has been a long-standing goal in NLP. Almost as long-standing is a general idea for addressing this challenge: Parsing text to a symbolic representation, and generating from it. However, earlier…

Computation and Language · Computer Science 2025-11-25 Hongji Li , Andrianos Michail , Reto Gubelmann , Simon Clematide , Juri Opitz

Cross-modal reasoning (CMR), the intricate process of synthesizing and drawing inferences across divergent sensory modalities, is increasingly recognized as a crucial capability in the progression toward more sophisticated and…

Computation and Language · Computer Science 2024-10-01 Shengsheng Qian , Zuyi Zhou , Dizhan Xue , Bing Wang , Changsheng Xu

Question generation is a conditioned language generation task that consists in generating a context-aware question given a context and the targeted answer. Train language modelling with a mere likelihood maximization has been widely used…

Computation and Language · Computer Science 2021-10-14 Loïc , Kwate Dassi

The success of large language models (LLMs) depends heavily on large-scale, high-quality instruction-following and reinforcement datasets. However, generating such data through human annotation is prohibitively time-consuming particularly…

Computation and Language · Computer Science 2026-02-02 Chenhua Shi , Gregor Macdonald , Bhavika Jalli , Wanlu Lei , John Zou , Mridul Jain , Joji Philip

While Large Language Models (LLMs) demonstrate remarkable proficiency in semantic understanding, they often struggle to ensure structural consistency and reasoning reliability in complex decision-making tasks that demand rigorous logic.…

Artificial Intelligence · Computer Science 2026-01-26 Hongjia Wu , Shuai Zhou , Hongxin Zhang , Wei Chen

In recent years, accurately and quickly deploying medical large language models (LLMs) has become a trend. Among these, retrieval-augmented generation (RAG) has garnered attention due to rapid deployment and privacy protection. However, the…

Computation and Language · Computer Science 2025-08-06 Penglei Sun , Yixiang Chen , Xiang Li , Xiaowen Chu

Retrieval-augmented generation (RAG) has demonstrated its ability to enhance Large Language Models (LLMs) by integrating external knowledge sources. However, multi-hop questions, which require the identification of multiple knowledge…

Machine Learning · Computer Science 2026-04-28 Yuchen Yan , Peiyan Zhang , Zhihua Liu , Hao Wang , Yatao Bian , Weiming Li , Xiaoshuai Hao

Recent advances in Large Language Models have demonstrated their capabilities across a variety of tasks. However, automatically extracting implicit knowledge from natural language remains a significant challenge, as machines lack active…

Artificial Intelligence · Computer Science 2026-03-06 Anna Sofia Lippolis , Andrea Giovanni Nuzzolese , Aldo Gangemi

Long text generation is an important but challenging task.The main problem lies in learning sentence-level semantic dependencies which traditional generative models often suffer from. To address this problem, we propose a Multi-hop…

Computation and Language · Computer Science 2020-09-29 Liang Zhao , Jingjing Xu , Junyang Lin , Yichang Zhang , Hongxia Yang , Xu Sun

This paper proposes a novel semiotic framework for analyzing Large Language Models (LLMs), conceptualizing them as stochastic semiotic engines whose outputs demand active, asymmetric human interpretation. We formalize the trade-off between…

Information Theory · Computer Science 2025-11-26 Davide Picca

Combining large language models with logical reasoning enhances their capacity to address problems in a robust and reliable manner. Nevertheless, the intricate nature of logical reasoning poses challenges when gathering reliable data from…

Large language models (LLMs) perform strongly on many language tasks but still struggle with complex multi-step reasoning across disciplines. Existing reasoning datasets often lack disciplinary breadth, reasoning depth, and diversity, as…

Computation and Language · Computer Science 2026-02-03 Weize Liu , Yongchi Zhao , Yijia Luo , Mingyu Xu , Jiaheng Liu , Yanan Li , Xiguo Hu , Zhiqi Bai , Yuchi Xu , Wenbo Su , Bo Zheng

The proliferation of Large Language Models (LLMs) in medicine has enabled impressive capabilities, yet a critical gap remains in their ability to perform systematic, transparent, and verifiable reasoning, a cornerstone of clinical practice.…

Computation and Language · Computer Science 2025-08-04 Wenxuan Wang , Zizhan Ma , Meidan Ding , Shiyi Zheng , Shengyuan Liu , Jie Liu , Jiaming Ji , Wenting Chen , Xiang Li , Linlin Shen , Yixuan Yuan

Large language models (LLMs) have transformed software development by enabling automated code generation, yet they frequently suffer from systematic errors that limit practical deployment. We identify two critical failure modes:…

Software Engineering · Computer Science 2025-11-12 Wuyang Zhang , Chenkai Zhang , Zhen Luo , Jianming Ma , Wangming Yuan , Chuqiao Gu , Chenwei Feng

Large Language Models (LLMs) are transforming scientific hypothesis generation and validation by enabling information synthesis, latent relationship discovery, and reasoning augmentation. This survey provides a structured overview of…

Retrieval-augmented generation (RAG) is a promising paradigm, yet its trustworthiness remains a critical concern. A major vulnerability arises prior to generation: models often fail to balance parametric (internal) and retrieved (external)…

Computation and Language · Computer Science 2026-01-08 Xinbang Dai , Huikang Hu , Yuncheng Hua , Jiaqi Li , Yongrui Chen , Rihui Jin , Nan Hu , Guilin Qi

Cross-domain scientific synthesis requires connecting mechanistic explanations across fragmented literature, a capability that remains challenging for both retrieval-based systems and unconstrained language models. While recent work has…

Computation and Language · Computer Science 2026-01-16 Sauhard Dubey