English
Related papers

Related papers: LongWriter-Zero: Mastering Ultra-Long Text Generat…

200 papers

Large Language Models (LLMs) have demonstrated impressive reasoning capabilities in complex problem-solving tasks, sparking growing interest in their application to preference reasoning in recommendation systems. Existing methods typically…

Artificial Intelligence · Computer Science 2025-10-27 Yang Zhang , Wenxin Xu , Xiaoyan Zhao , Wenjie Wang , Fuli Feng , Xiangnan He , Tat-Seng Chua

Reinforcement learning (RL) has been effective for post-training autoregressive (AR) language models, but extending these methods to diffusion language models (DLMs) is challenging due to intractable sequence-level likelihoods. Existing…

In online advertising, advertising text plays a critical role in attracting user engagement and driving advertiser value. Existing industrial systems typically follow a two-stage paradigm, where candidate texts are first generated and…

Artificial Intelligence · Computer Science 2026-02-13 Jinfang Wang , Jiajie Liu , Jianwei Wu , Ziqin Luo , Zhen Chen , Chunlei Li , Biao Han , Tao Deng , Yi Li , Shuanglong Li , Lin Liu

Recent advancements in large language models (LLMs) demonstrate exceptional Chinese text processing capabilities, particularly in Chinese Spelling Correction (CSC). While LLMs outperform traditional BERT-based models in accuracy and…

Computation and Language · Computer Science 2025-05-15 Sophie Zhang , Zhiming Lin

Designing reward functions is a longstanding challenge in reinforcement learning (RL); it requires specialized knowledge or domain data, leading to high costs for development. To address this, we introduce Text2Reward, a data-free framework…

Machine Learning · Computer Science 2024-05-28 Tianbao Xie , Siheng Zhao , Chen Henry Wu , Yitao Liu , Qian Luo , Victor Zhong , Yanchao Yang , Tao Yu

Program synthesis or code generation aims to generate a program that satisfies a problem specification. Recent approaches using large-scale pretrained language models (LMs) have shown promising results, yet they have some critical…

Machine Learning · Computer Science 2022-11-04 Hung Le , Yue Wang , Akhilesh Deepak Gotmare , Silvio Savarese , Steven C. H. Hoi

Large reasoning models (LRMs) extend large language models by generating explicit chain-of-thought (CoT) reasoning, significantly improving mathematical and logical problem solving. However, this explicit reasoning process also introduces…

Computation and Language · Computer Science 2025-12-02 Jinghan Jia , Nathalie Baracaldo , Sijia Liu

Current Large Language Models (LLMs) exhibit significant limitations, notably in structured, interpretable, and verifiable medical reasoning, alongside practical deployment challenges related to computational resources and data privacy.…

Computation and Language · Computer Science 2025-06-06 Boqin Zhuang , Chenxiao Song , Huitong Lu , Jiacheng Qiao , Mingqian Liu , Mingxing Yu , Ping Hong , Rui Li , Xiaoxia Song , Xiangjun Xu , Xu Chen , Yaoyao Ma , Yujie Gao

While Large Language Models (LLMs) demonstrate exceptional performance in surface-level text generation, their nature in handling complex multi-step reasoning tasks often remains one of ``statistical fitting'' rather than systematic logical…

Machine Learning · Computer Science 2026-01-27 Lianlei Shan , Han Chen , Yixuan Wang , Zhenjie Liu , Wei Li

Research on applications of reinforcement learning (RL) to large language models has mostly been focused on single-turn problems, such as mathematical reasoning or single-shot code generation. While these problems can be viewed as…

Learning to rank (LTR) plays a crucial role in various Information Retrieval (IR) tasks. Although supervised LTR methods based on fine-grained relevance labels (e.g., document-level annotations) have achieved significant success, their…

Information Retrieval · Computer Science 2025-08-21 Yiteng Tu , Zhichao Xu , Tao Yang , Weihang Su , Yujia Zhou , Yiqun Liu , Fen Lin , Qin Liu , Qingyao Ai

Large language models (LLMs) have significantly benefited from training on diverse, high-quality task-specific data, leading to impressive performance across a range of downstream applications. Current methods often rely on human-annotated…

Computation and Language · Computer Science 2024-10-23 Qintong Li , Jiahui Gao , Sheng Wang , Renjie Pi , Xueliang Zhao , Chuan Wu , Xin Jiang , Zhenguo Li , Lingpeng Kong

An AI system for professional floor plan design must precisely control room dimensions and areas while respecting the desired connectivity between rooms and maintaining functional and aesthetic quality. Existing generative approaches focus…

Computation and Language · Computer Science 2026-05-15 Luis Lara , Aristides Milios , Zhi Hao Luo , Aditya Sharma , Ge Ya Luo , Christopher Beckham , Florian Golemo , Christopher Pal

Personalized text generation requires a unique ability of large language models (LLMs) to learn from context that they often do not encounter during their standard training. One way to encourage LLMs to better use personalized context for…

Computation and Language · Computer Science 2025-01-09 Alireza Salemi , Cheng Li , Mingyang Zhang , Qiaozhu Mei , Weize Kong , Tao Chen , Zhuowan Li , Michael Bendersky , Hamed Zamani

The ability of large language models (LLMs) to process and reason over long textual inputs is critical for a wide range of real-world applications. However, progress in this area is significantly constrained by the absence of high-quality,…

Computation and Language · Computer Science 2025-09-05 Seganrasan Subramanian , Abhigya Verma

Reinforcement learning (RL) has recently demonstrated strong potential in enhancing the reasoning capabilities of large language models (LLMs). Particularly, the "Zero" reinforcement learning introduced by Deepseek-R1-Zero, enables direct…

Computation and Language · Computer Science 2025-06-10 Xueguang Ma , Qian Liu , Dongfu Jiang , Ge Zhang , Zejun Ma , Wenhu Chen

Large Language Models (LLMs) are increasingly being explored for building Agents capable of active environmental interaction (e.g., via tool use) to solve complex problems. Reinforcement Learning (RL) is considered a key technology with…

Computation and Language · Computer Science 2025-11-19 Mingyue Cheng , Jie Ouyang , Shuo Yu , Ruiran Yan , Yucong Luo , Zirui Liu , Daoyu Wang , Qi Liu , Enhong Chen

Effective text generation and chat interfaces for low-resource languages (LRLs) remain a challenge for state-of-the-art large language models (LLMs) to support. This is mainly due to the difficulty of curating high-quality instruction…

Machine Learning · Computer Science 2026-02-09 Mamadou K. Keita , Sebastien Diarra , Christopher Homan , Seydou Diallo

Reasoning over long contexts is essential for large language models. While reinforcement learning (RL) enhances short-context reasoning by inducing "Aha" moments in chain-of-thought, the advanced thinking patterns required for long-context…

Computation and Language · Computer Science 2025-10-28 Siyuan Wang , Gaokai Zhang , Li Lyna Zhang , Ning Shang , Fan Yang , Dongyao Chen , Mao Yang

Large language models (LLMs) have demonstrated impressive instruction following capabilities, while still struggling to accurately manage the length of the generated text, which is a fundamental requirement in many real-world applications.…

Computation and Language · Computer Science 2024-12-20 Yuxuan Gu , Wenjie Wang , Xiaocheng Feng , Weihong Zhong , Kun Zhu , Lei Huang , Tat-Seng Chua , Bing Qin