English
Related papers

Related papers: Process-Supervised LLM Recommenders via Flow-guide…

200 papers

Recent advances in large language models (LLMs) have enabled breakthroughs in many multimodal generation tasks, but a significant performance gap still exists in text-to-motion generation, where LLM-based methods lag far behind non-LLM…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Chuhao Jin , Haosen Li , Bingzi Zhang , Che Liu , Xiting Wang , Ruihua Song , Wenbing Huang , Ying Qin , Fuzheng Zhang , Di Zhang

Instruction fine-tuning (IFT) elicits instruction following capabilities and steers the behavior of large language models (LLMs) via supervised learning. However, existing models trained on open-source IFT datasets only have the ability to…

Computation and Language · Computer Science 2024-09-24 Kuan Wang , Alexander Bukharin , Haoming Jiang , Qingyu Yin , Zhengyang Wang , Tuo Zhao , Jingbo Shang , Chao Zhang , Bing Yin , Xian Li , Jianshu Chen , Shiyang Li

The standard post-training recipe for large multimodal models (LMMs) applies supervised fine-tuning (SFT) on curated demonstrations followed by reinforcement learning with verifiable rewards (RLVR). However, SFT introduces distributional…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Sudong Wang , Weiquan Huang , Xiaomin Yu , Zuhao Yang , Hehai Lin , Keming Wu , Chaojun Xiao , Chen Chen , Wenxuan Wang , Beier Zhu , Yunjian Zhang , Chengwei Qin

Instruction fine-tuned large language models (LLMs) enable a simple zero-shot or few-shot prompting paradigm, also known as in-context learning, for building prediction models. This convenience, combined with continued advances in LLM…

Machine Learning · Computer Science 2025-08-18 Ruicheng Xian , Yuxuan Wan , Han Zhao

Unitary Synthesis, the decomposition of a unitary matrix into a sequence of quantum gates, is a fundamental challenge in quantum compilation. Prevailing reinforcement learning (RL) approaches are often hampered by sparse reward signals,…

Quantum Physics · Physics 2026-03-05 Inhoe Koo , Hyunho Cha , Jungwoo Lee

LLMs have gained immense popularity among researchers and the general public for its impressive capabilities on a variety of tasks. Notably, the efficacy of LLMs remains significantly dependent on the quality and structure of the input…

Machine Learning · Computer Science 2025-04-08 Wenliang Zheng , Sarkar Snigdha Sarathi Das , Yusen Zhang , Rui Zhang

Generative models, particularly diffusion model, have emerged as powerful tools for sequential recommendation. However, accurately modeling user preferences remains challenging due to the noise perturbations inherent in the forward and…

Information Retrieval · Computer Science 2025-05-23 Feng Liu , Lixin Zou , Xiangyu Zhao , Min Tang , Liming Dong , Dan Luo , Xiangyang Luo , Chenliang Li

Fine-tuning flow matching models is a central challenge in settings with limited data, evolving distributions, or strict efficiency demands, where unconstrained fine-tuning can erode the accuracy and efficiency gains learned during…

Machine Learning · Computer Science 2026-02-02 Gudrun Thorkelsdottir , Arindam Banerjee

Large language models (LLM) not only have revolutionized the field of natural language processing (NLP) but also have the potential to reshape many other fields, e.g., recommender systems (RS). However, most of the related work treats an…

Information Retrieval · Computer Science 2024-03-26 Lei Li , Yongfeng Zhang , Dugang Liu , Li Chen

Recommender systems are essential information technologies today, and recommendation algorithms combined with deep learning have become a research hotspot in this field. The recommendation model known as LFM (Latent Factor Model), which…

Information Retrieval · Computer Science 2024-03-27 Junyi Liu

Large language models (LLMs) have demonstrated remarkable proficiency in machine translation (MT), even without specific training on the languages in question. However, translating rare words in low-resource or domain-specific contexts…

Computation and Language · Computer Science 2024-11-14 Shangfeng Chen , Xiayang Shi , Pu Li , Yinlin Li , Jingjing Liu

This paper is about the problem of learning a stochastic policy for generating an object (like a molecular graph) from a sequence of actions, such that the probability of generating an object is proportional to a given positive reward for…

Machine Learning · Computer Science 2021-11-22 Emmanuel Bengio , Moksh Jain , Maksym Korablyov , Doina Precup , Yoshua Bengio

Large Language Model (LLM)-based cold-start recommendation systems continue to face significant computational challenges in billion-scale scenarios, as they follow a "Text-to-Judgment" paradigm. This approach processes user-item content…

Information Retrieval · Computer Science 2025-02-25 Ruochen Liu , Hao Chen , Yuanchen Bei , Zheyu Zhou , Lijia Chen , Qijie Shen , Feiran Huang , Fakhri Karray , Senzhang Wang

Federated fine-tuning offers a promising paradigm for adapting large language models (LLMs) on edge devices by leveraging the rich, diverse, and continuously generated data from smartphones and IoT devices without compromising user data…

Computation and Language · Computer Science 2026-05-12 Jiaxiang Geng , Yiyi Lu , Lunyu Zhao , Yan Gao , Nicholas D. Lane , Bing Luo

We propose a diffusion-based framework for prompt optimization that leverages Diffusion Language Models (DLMs) to iteratively refine system prompts through masked denoising. By conditioning on interaction traces, including user queries,…

Computation and Language · Computer Science 2026-02-24 Shiyu Wang , Haolin Chen , Liangwei Yang , Jielin Qiu , Rithesh Murthy , Ming Zhu , Zixiang Chen , Silvio Savarese , Caiming Xiong , Shelby Heinecke , Huan Wang

Large language models (LLMs) have been applied to a wide range of tasks, including text summarization, web navigation, and chatbots. They have benefitted from supervised fine-tuning (SFT) and reinforcement learning from human feedback…

Computation and Language · Computer Science 2024-08-07 Ryan Aponte , Ryan A. Rossi , Shunan Guo , Franck Dernoncourt , Tong Yu , Xiang Chen , Subrata Mitra , Nedim Lipka

Fashion, deeply rooted in sociocultural dynamics, evolves as individuals emulate styles popularized by influencers and iconic figures. In the quest to replicate such refined tastes using artificial intelligence, traditional fashion ensemble…

Computation and Language · Computer Science 2025-02-25 Zhan Shi , Shanglin Yang

Large language models (LLMs), endowed with exceptional reasoning capabilities, are adept at discerning profound user interests from historical behaviors, thereby presenting a promising avenue for the advancement of recommendation systems.…

Information Retrieval · Computer Science 2024-12-19 Guanghan Li , Xun Zhang , Yufei Zhang , Yifan Yin , Guojun Yin , Wei Lin

Post-training processes are essential phases in grounding pre-trained language models to real-world tasks, with learning from demonstrations or preference signals playing a crucial role in this adaptation. We present a unified theoretical…

Machine Learning · Computer Science 2025-07-08 Bo Wang , Qinyuan Cheng , Runyu Peng , Rong Bao , Peiji Li , Qipeng Guo , Linyang Li , Zhiyuan Zeng , Yunhua Zhou , Xipeng Qiu

Aligning language models (LMs) with preferences is an important problem in natural language generation. A key challenge is that preferences are typically provided at the sequence level while LM training and generation both occur at the…

Computation and Language · Computer Science 2025-01-09 Shentao Yang , Shujian Zhang , Congying Xia , Yihao Feng , Caiming Xiong , Mingyuan Zhou