English
Related papers

Related papers: ConvergeWriter: Data-Driven Bottom-Up Article Cons…

200 papers

State-of-the-art large language models (LLMs) exhibit impressive problem-solving capabilities but may struggle with complex reasoning and factual correctness. Existing methods harness the strengths of chain-of-thought and…

Computation and Language · Computer Science 2024-10-03 Xingxuan Li , Weiwen Xu , Ruochen Zhao , Fangkai Jiao , Shafiq Joty , Lidong Bing

Large language models (LLMs) have demonstrated strong capabilities in text understanding and generation. However, they often lack factuality, producing a mixture of true and false information, especially in long-form generation. In this…

Computation and Language · Computer Science 2025-09-26 Lifu Tu , Rui Meng , Shafiq Joty , Yingbo Zhou , Semih Yavuz

In retrieval-augmented generation (RAG) question answering systems, generating citations for large language model (LLM) outputs enhances verifiability and helps users identify potential hallucinations. However, we observe two problems in…

Computation and Language · Computer Science 2025-10-21 Guo Chen , Qiuyuan Li , Qiuxian Li , Hongliang Dai , Xiang Chen , Piji Li

People commonly leverage structured content to accelerate knowledge acquisition and research problem solving. Among these, roadmaps guide researchers through hierarchical subtasks to solve complex research problems step by step. Despite…

Computation and Language · Computer Science 2026-05-01 Jiacheng Liu , Zichen Tang , Zhongjun Yang , Xinyi Hu , Xueyuan Lin , Linwei Jia , Ruofei Bai , Rongjin Li , Shiyao Peng , Haocheng Gao , Haihong E

In enterprise settings, efficiently retrieving relevant information from large and complex knowledge bases is essential for operational productivity and informed decision-making. This research presents a systematic empirical framework for…

Large language models (LLMs) have rapidly evolved from text generators into powerful problem solvers. Yet, many open tasks demand critical thinking, multi-source, and verifiable outputs, which are beyond single-shot prompting or standard…

Large Language Models (LLMs) have the potential to revolutionize data analytics by simplifying tasks such as data discovery and SQL query synthesis through natural language interactions. This work serves as a pivotal first step toward the…

Program synthesis is challenging largely because of the difficulty of search in a large space of programs. Human programmers routinely tackle the task of writing complex programs by writing sub-programs and then analyzing their intermediate…

Programming Languages · Computer Science 2023-10-31 Augustus Odena , Kensen Shi , David Bieber , Rishabh Singh , Charles Sutton , Hanjun Dai

In recent years, Large Language Models (LLMs) have shown remarkable performance in generating human-like text, proving to be a valuable asset across various applications. However, adapting these models to incorporate new, out-of-domain…

The quality of machine learning models depends heavily on their training data. Selecting high-quality, diverse training sets for large language models (LLMs) is a difficult task, due to the lack of cheap and reliable quality metrics. While…

Machine Learning · Computer Science 2026-01-30 Robert Istvan Busa-Fekete , Julian Zimmert , Anne Xiangyi Zheng , Claudio Gentile , Andras Gyorgy

Agent-compiled knowledge bases provide persistent external knowledge for large language model (LLM) agents in open-ended, knowledge-intensive downstream tasks. Yet their quality is systematically limited by \emph{incompleteness},…

Computation and Language · Computer Science 2026-05-12 Haoyu Huang , Jiaxin Bai , Shujie Liu , Yang Wei , Hong Ting Tsang , Yisen Gao , Zhongwei Xie , Yufei Li , Yangqiu Song

We consider the task of data-to-text generation, which aims to create textual output from non-linguistic input. We focus on generating long-form text, i.e., documents with multiple paragraphs, and propose a neural model enhanced with a…

Computation and Language · Computer Science 2022-03-01 Ratish Puduppully , Yao Fu , Mirella Lapata

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li

Synthetic data augmentation via large language models (LLMs) allows researchers to leverage additional training data, thus enhancing the performance of downstream tasks, especially when real-world data is scarce. However, the generated data…

Machine Learning · Computer Science 2025-03-25 Hsun-Yu Kuo , Yin-Hsiang Liao , Yu-Chieh Chao , Wei-Yun Ma , Pu-Jen Cheng

Mathematical reasoning remains challenging for LLMs due to complex logic and the need for precise computation. Existing methods enhance LLM reasoning by synthesizing datasets through problem rephrasing, but face issues with generation…

Computation and Language · Computer Science 2025-06-12 Lei Xu , Sirui Chen , Yuxuan Huang , Chaochao Lu

Generating knowledge-intensive and comprehensive long texts, such as encyclopedia articles, remains significant challenges for Large Language Models. It requires not only the precise integration of facts but also the maintenance of thematic…

Computation and Language · Computer Science 2025-03-04 Hongchao Gu , Dexun Li , Kuicai Dong , Hao Zhang , Hang Lv , Hao Wang , Defu Lian , Yong Liu , Enhong Chen

We address the fundamental task of inferring cross-document coreference and hierarchy in scientific texts, which has important applications in knowledge graph construction, search, recommendation and discovery. Large Language Models (LLMs)…

Computation and Language · Computer Science 2026-02-04 Lior Forer , Tom Hope

Large language models (LLMs) have emerged as a widely-used tool for information seeking, but their generated outputs are prone to hallucination. In this work, our aim is to allow LLMs to generate text with citations, improving their factual…

Computation and Language · Computer Science 2023-11-01 Tianyu Gao , Howard Yen , Jiatong Yu , Danqi Chen

Recent approaches to data-to-text generation have adopted the very successful encoder-decoder architecture or variants thereof. These models generate text which is fluent (but often imprecise) and perform quite poorly at selecting…

Computation and Language · Computer Science 2021-02-05 Ratish Puduppully , Mirella Lapata

Recently, the emergence of large language models (LLMs) has revolutionized the paradigm of information retrieval (IR) applications, especially in web search, by generating vast amounts of human-like texts on the Internet. As a result, IR…

Information Retrieval · Computer Science 2024-08-01 Sunhao Dai , Yuqi Zhou , Liang Pang , Weihao Liu , Xiaolin Hu , Yong Liu , Xiao Zhang , Gang Wang , Jun Xu