English
Related papers

Related papers: What Does LLM Refinement Actually Improve? A Syste…

200 papers

Like humans, large language models (LLMs) do not always generate the best output on their first try. Motivated by how humans refine their written text, we introduce Self-Refine, an approach for improving initial outputs from LLMs through…

Large language model (LLM) agents have emerged as a promising solution to automate the workflow of machine learning, but most existing methods share a common limitation: they attempt to optimize entire pipelines in a single step before…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Eric Xue , Ke Chen , Zeyi Huang , Yuyang Ji , Haohan Wang

Recent large language models (LLM) are leveraging human feedback to improve their generation quality. However, human feedback is costly to obtain, especially during inference. In this work, we propose LLMRefine, an inference time…

Computation and Language · Computer Science 2024-10-28 Wenda Xu , Daniel Deutsch , Mara Finkelstein , Juraj Juraska , Biao Zhang , Zhongtao Liu , William Yang Wang , Lei Li , Markus Freitag

Recent research has shown that large language models (LLMs) can enhance translation quality through self-refinement. In this paper, we build on this idea by extending the refinement from sentence-level to document-level translation,…

Computation and Language · Computer Science 2025-04-09 Yichen Dong , Xinglin Lyu , Junhui Li , Daimeng Wei , Min Zhang , Shimin Tao , Hao Yang

Large Language Models (LLMs) have achieved impressive results in Machine Translation (MT). However, careful evaluations by human reveal that the translations produced by LLMs still contain multiple errors. Importantly, feeding back such…

Computation and Language · Computer Science 2024-06-24 Zhaopeng Feng , Yan Zhang , Hao Li , Bei Wu , Jiayu Liao , Wenqiang Liu , Jun Lang , Yang Feng , Jian Wu , Zuozhu Liu

Can we improve machine translation (MT) with LLMs by rewriting their inputs automatically? Users commonly rely on the intuition that well-written text is easier to translate when using off-the-shelf MT systems. LLMs can rewrite text in many…

Computation and Language · Computer Science 2025-09-03 Dayeon Ki , Marine Carpuat

Large language models (LLMs) have demonstrated remarkable proficiency in machine translation (MT), even without specific training on the languages in question. However, translating rare words in low-resource or domain-specific contexts…

Computation and Language · Computer Science 2024-11-14 Shangfeng Chen , Xiayang Shi , Pu Li , Yinlin Li , Jingjing Liu

In recent years, Large Language Models (LLMs) have demonstrated remarkable generative abilities, but can they judge the quality of their own generations? A popular concept, referred to as self-refinement, postulates that LLMs can detect and…

Computation and Language · Computer Science 2023-11-15 Kumar Shridhar , Koustuv Sinha , Andrew Cohen , Tianlu Wang , Ping Yu , Ram Pasunuru , Mrinmaya Sachan , Jason Weston , Asli Celikyilmaz

In Machine Translation, Large Language Models (LLMs) have generally underperformed compared to conventional encoder-decoder systems and thus see limited adoption. However, LLMs excel at modeling contextual information, making them a natural…

Computation and Language · Computer Science 2026-03-24 Ireh Kim , Tesia Sker , Chanwoo Kim

Large language models (LLMs) have demonstrated the capacity to improve summary quality by mirroring a human-like iterative process of critique and refinement starting from the initial draft. Two strategies are designed to perform this…

Computation and Language · Computer Science 2024-06-04 Shichao Sun , Ruifeng Yuan , Ziqiang Cao , Wenjie Li , Pengfei Liu

Recent advances in large language models (LLMs) have yielded impressive performance on various tasks, yet they often depend on high-quality feedback that can be costly. Self-refinement methods attempt to leverage LLMs' internal evaluation…

Computation and Language · Computer Science 2025-12-01 Hikaru Asano , Tadashi Kozuno , Yukino Baba

We propose iteratively prompting a large language model to self-correct a translation, with inspiration from their strong language understanding and translation capability as well as a human-like translation approach. Interestingly,…

Computation and Language · Computer Science 2024-05-03 Pinzhen Chen , Zhicheng Guo , Barry Haddow , Kenneth Heafield

Recent advancements in large language models (LLMs) have demonstrated their remarkable capabilities across various language tasks. Inspired by the success of text-to-text translation refinement, this paper investigates how LLMs can improve…

Computation and Language · Computer Science 2025-01-28 Huaixia Dou , Xinyu Tian , Xinglin Lyu , Jie Zhu , Junhui Li , Lifan Guo

The fast development of Large Language Models (LLMs) offers growing opportunities to further improve sequential recommendation systems. Yet for some practitioners, integrating LLMs to their existing base recommendation systems raises…

Information Retrieval · Computer Science 2025-04-17 Nanshan Jia , Chenfei Yuan , Yuhang Wu , Zeyu Zheng

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

Computation and Language · Computer Science 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

Fine-tuning large language models (LLMs) for machine translation has shown improvements in overall translation quality. However, it is unclear what is the impact of fine-tuning on desirable LLM behaviors that are not present in neural…

Computation and Language · Computer Science 2024-08-07 David Stap , Eva Hasler , Bill Byrne , Christof Monz , Ke Tran

Motivated by the substantial achievements observed in Large Language Models (LLMs) in the field of natural language processing, recent research has commenced investigations into the application of LLMs for complex, long-horizon sequential…

Robotics · Computer Science 2023-08-29 Zhehua Zhou , Jiayang Song , Kunpeng Yao , Zhan Shu , Lei Ma

Multi-agent collaboration among models has shown promise in reasoning tasks but is underexplored in long-form generation tasks like summarization and question-answering. We extend multi-agent multi-model reasoning to generation,…

Computation and Language · Computer Science 2025-03-20 David Wan , Justin Chih-Yao Chen , Elias Stengel-Eskin , Mohit Bansal

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

Computation and Language · Computer Science 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

Large Language Models' (LLM) reasoning can be improved using test-time aggregation strategies, i.e., generating multiple samples and voting among generated samples. While these improve performance, they often reach a saturation point.…

Computation and Language · Computer Science 2025-09-18 Justin Chih-Yao Chen , Archiki Prasad , Swarnadeep Saha , Elias Stengel-Eskin , Mohit Bansal
‹ Prev 1 2 3 10 Next ›