English
Related papers

Related papers: OUTLINEFORGE: Hierarchical Reinforcement Learning …

200 papers

Reinforcement Learning with Verifiable Rewards~(RLVR) has become a prominent paradigm to enhance the capabilities (i.e.\ long-context) of Large Language Models~(LLMs). However, it often relies on gold-standard answers or explicit evaluation…

Computation and Language · Computer Science 2026-03-03 Yao Xiao , Lei Wang , Yue Deng , Guanzheng Chen , Ziqi Jin , Jung-jae Kim , Xiaoli Li , Roy Ka-wei Lee , Lidong Bing

We support scientific writers in determining whether a written sentence is scientific, to which section it belongs, and suggest paraphrasings to improve the sentence. Firstly, we propose a regression model trained on a corpus of scientific…

Computation and Language · Computer Science 2023-06-22 Justin Mücke , Daria Waldow , Luise Metzger , Philipp Schauz , Marcel Hoffman , Nicolas Lell , Ansgar Scherp

To take advantage of Large Language Model in theorem formalization and proof, we propose a reinforcement learning framework to iteratively optimize the pretrained LLM by rolling out next tactics and comparing them with the expected ones.…

Artificial Intelligence · Computer Science 2025-02-14 Zhiling Luo

While current large language models (LLMs) demonstrate remarkable linguistic capabilities through training on massive unstructured text corpora, they remain inadequate in leveraging structured scientific data (e.g., chemical molecular…

Machine Learning · Computer Science 2025-04-08 Weichen Dai , Zijie Dai , Zhijie Huang , Yixuan Pan , Xinhe Li , Xi Li , Yi Zhou , Ji Qi , Wu Jiang

Scientific visualization pipelines encode domain-specific procedural knowledge with strict execution dependencies, making their construction sensitive to missing stages, incorrect operator usage, or improper ordering. Thus, generating…

Graphics · Computer Science 2026-03-30 Guanghui Zhao , Zhe Wang , Yu Dong , Guan Li , GuiHua Shan

The automated generation of research workflows is essential for improving the reproducibility of research and accelerating the paradigm of "AI for Science". However, existing methods typically extract merely fragmented procedural components…

Computation and Language · Computer Science 2025-09-24 Heng Zhang , Chengzhi Zhang

Reinforcement learning has proven effective for enhancing multi-step reasoning in large language models (LLMs), yet its benefits have not fully translated to multilingual contexts. Existing methods struggle with a fundamental trade-off:…

Computation and Language · Computer Science 2026-05-22 Yuchun Fan , Bei Li , Peiguang Li , Yilin Wang , Yongyu Mu , Jian Yang , Xin Chen , Rongxiang Weng , Jingang Wang , Xunliang Cai , Jingbo Zhu , Tong Xiao

The scientific literature's exponential growth makes it increasingly challenging to navigate and synthesize knowledge across disciplines. Large language models (LLMs) are powerful tools for understanding scientific text, but they fail to…

Computation and Language · Computer Science 2025-05-30 Abhipsha Das , Nicholas Lourie , Siavash Golkar , Mariel Pettee

The reproducibility of scientific articles is central to the advancement of science. Despite this importance, evaluating reproducibility remains challenging due to the scarcity of ground truth data. Predictive models can address this…

Digital Libraries · Computer Science 2024-10-25 Akhil Pandey Akella , Sagnik Ray Choudhury , David Koop , Hamed Alhoori

LongRecall. The completeness of machine-generated text, ensuring that it captures all relevant information, is crucial in domains such as medicine and law and in tasks like list-based question answering (QA), where omissions can have…

Computation and Language · Computer Science 2025-08-22 MohamamdJavad Ardestani , Ehsan Kamalloo , Davood Rafiei

Creating high-quality figures and visualizations for scientific papers is a time-consuming task that requires both deep domain knowledge and professional design skills. Despite over 2.5 million scientific papers published annually, the…

Artificial Intelligence · Computer Science 2026-01-09 Siyuan Huang , Yutong Gao , Juyang Bai , Yifan Zhou , Zi Yin , Xinxin Liu , Rama Chellappa , Chun Pong Lau , Sayan Nag , Cheng Peng , Shraman Pramanick

Automatic summarization of legal texts is an important and still a challenging task since legal documents are often long and complicated with unusual structures and styles. Recent advances of deep models trained end-to-end with…

Computation and Language · Computer Science 2022-04-14 Duy-Hung Nguyen , Bao-Sinh Nguyen , Nguyen Viet Dung Nghiem , Dung Tien Le , Mim Amina Khatun , Minh-Tien Nguyen , Hung Le

Generating scientific manuscripts requires maintaining alignment between narrative reasoning, experimental evidence, and visual artifacts across the document lifecycle. Existing language-model generation pipelines rely on unconstrained text…

Rigour is crucial for scientific research as it ensures the reproducibility and validity of results and findings. Despite its importance, little work exists on modelling rigour computationally, and there is a lack of analysis on whether…

Computation and Language · Computer Science 2024-11-08 Joseph James , Chenghao Xiao , Yucheng Li , Chenghua Lin

Existing Multimodal Large Language Models (MLLMs) suffer from significant performance degradation on the long document understanding task as document length increases. This stems from two fundamental challenges: 1) a low Signal-to-Noise…

Artificial Intelligence · Computer Science 2026-05-12 Hao Yan , Yuliang Liu , Xingchen Liu , Yuyi Zhang , Minghui Liao , Jihao Wu , Wei Chen , Xiang Bai

We present Team asdfo123's submission to the LLMSR@XLLM25 shared task, which evaluates large language models on producing fine-grained, controllable, and interpretable reasoning processes. Systems must extract all problem conditions,…

Computation and Language · Computer Science 2025-05-20 Xinye Li , Mingqi Wan , Dianbo Sui

Large Language Models (LLMs) have shown strong capabilities through two complementary paradigms: Retrieval-Augmented Generation (RAG) for knowledge grounding and Reinforcement Learning from Verifiable Rewards (RLVR) for complex reasoning.…

Computation and Language · Computer Science 2026-04-27 Weitao Li , Boran Xiang , Xiaolong Wang , Zhinan Gou , Weizhi Ma , Yang Liu

The central challenge of reinforcement learning for reasoning lies not only in the sparsity of outcome-level supervision, but more fundamentally in how to transform feedback provided only at the end of a sequence into fine-grained learning…

Machine Learning · Computer Science 2026-05-26 Fei Ding , Yongkang Zhang , Runhao Liu , Yuhao Liao , Zijian Zeng , Sibo wang , Huiming Yang

Reinforcement Learning (RL) has proven highly effective at enhancing the complex reasoning abilities of Large Language Models (LLMs), yet underlying mechanisms driving this success remain largely opaque. Our analysis reveals that puzzling…

Artificial Intelligence · Computer Science 2025-09-30 Haozhe Wang , Qixin Xu , Che Liu , Junhong Wu , Fangzhen Lin , Wenhu Chen

Despite the rapid growth of context length of large language models (LLMs) , LLMs still perform poorly in long document summarization. An important reason for this is that relevant information about an event is scattered throughout long…

Computation and Language · Computer Science 2025-02-04 Taiji Li , Hao Chen , Fei Yu , Yin Zhang