English
Related papers

Related papers: CTR-Driven Ad Text Generation via Online Feedback …

200 papers

The success of RL for LLM post-training stems from an unreasonably uninformative source: a single bit of information per rollout as binary reward or preference label. At the other extreme, distillation offers dense supervision but requires…

Machine Learning · Computer Science 2026-02-12 Yuda Song , Lili Chen , Fahim Tajwar , Remi Munos , Deepak Pathak , J. Andrew Bagnell , Aarti Singh , Andrea Zanette

One of the key challenges in current Reinforcement Learning (RL)-based Automated Driving (AD) agents is achieving flexible, precise, and human-like behavior cost-effectively. This paper introduces an innovative approach that uses large…

Artificial Intelligence · Computer Science 2024-12-30 Ziqi Zhou , Jingyue Zhang , Jingyuan Zhang , Yangfan He , Boyue Wang , Tianyu Shi , Alaa Khamis

Large language models (LLMs) like ChatGPT and GPT-4 have attracted great attention given their surprising performance on a wide range of NLP tasks. Length controlled generation of LLMs emerges as an important topic, which enables users to…

Computation and Language · Computer Science 2023-10-03 Renlong Jie , Xiaojun Meng , Lifeng Shang , Xin Jiang , Qun Liu

Accurate query-product relevance labeling is indispensable to generate ground truth dataset for search ranking in e-commerce. Traditional approaches for annotating query-product pairs rely on human-based labeling services, which is…

Information Retrieval · Computer Science 2025-02-27 Jayant Sachdev , Sean D Rosario , Abhijeet Phatak , He Wen , Swati Kirti , Chittaranjan Tripathy

Commit message is one of the most important textual information in software development and maintenance. However, it is time-consuming to write commit messages manually. Commit Message Generation (CMG) has become a research hotspot.…

Software Engineering · Computer Science 2024-10-04 Linghao Zhang , Hongyi Zhang , Chong Wang , Peng Liang

Click-through rate (CTR) estimation is a fundamental task in personalized advertising and recommender systems and it's important for ranking models to effectively capture complex high-order features.Inspired by the success of ELMO and Bert…

Information Retrieval · Computer Science 2021-07-27 Zhiqiang Wang , Qingyun She , PengTao Zhang , Junlin Zhang

Commit messages are essential in software development as they serve to document and explain code changes. Yet, their quality often falls short in practice, with studies showing significant proportions of empty or inadequate messages. While…

Software Engineering · Computer Science 2025-07-16 Qunhong Zeng , Yuxia Zhang , Zexiong Ma , Bo Jiang , Ningyuan Sun , Klaas-Jan Stol , Xingyu Mou , Hui Liu

Click-through rate (CTR) prediction is a critical task in online advertising and recommender systems, relying on effective modeling of feature interactions. Explicit interactions capture predefined relationships, such as inner products, but…

Information Retrieval · Computer Science 2025-05-27 Kefan Wang , Hao Wang , Wei Guo , Yong Liu , Jianghao Lin , Defu Lian , Enhong Chen

Current approaches to text generation largely rely on autoregressive models and maximum likelihood estimation. This paradigm leads to (i) diverse but low-quality samples due to mismatched learning objective and evaluation metric (likelihood…

Computation and Language · Computer Science 2021-03-04 Richard Yuanzhe Pang , He He

Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-12-02 Tian Yu , Shaolei Zhang , Yang Feng

Automatically generating feedback via large language models (LLMs) in intelligent tutoring systems and online learning platforms has the potential to improve the learning outcomes of many students. However, both feedback generation and…

Computation and Language · Computer Science 2024-12-13 Alexander Scarlatos , Digory Smith , Simon Woodhead , Andrew Lan

Preference learning is critical for aligning large language models (LLMs) with human values, with the quality of preference datasets playing a crucial role in this process. While existing metrics primarily assess data quality based on…

Machine Learning · Computer Science 2025-03-05 Kexin Huang , Junkang Wu , Ziqian Chen , Xue Wang , Jinyang Gao , Bolin Ding , Jiancan Wu , Xiangnan He , Xiang Wang

While Large Language Models (LLMs) have demonstrated impressive performance across natural language generation tasks, their ability to generate truly creative content-characterized by novelty, diversity, surprise, and quality-remains…

Computation and Language · Computer Science 2025-09-22 Mete Ismayilzada , Antonio Laverghetta , Simone A. Luchini , Reet Patel , Antoine Bosselut , Lonneke van der Plas , Roger Beaty

Large Language Models (LLMs) are powerful models for generation tasks, but they may not generate good quality outputs in their first attempt. Apart from model fine-tuning, existing approaches to improve prediction accuracy and quality…

Computation and Language · Computer Science 2024-11-05 Jason Cai , Hang Su , Monica Sunkara , Igor Shalyminov , Saab Mansour

Collaborative Topic Regression (CTR) combines ideas of probabilistic matrix factorization (PMF) and topic modeling (e.g., LDA) for recommender systems, which has gained increasing successes in many applications. Despite enjoying many…

Machine Learning · Computer Science 2016-05-31 Chenghao Liu , Tao Jin , Steven C. H. Hoi , Peilin Zhao , Jianling Sun

The functionality of Large Language Model (LLM) agents is primarily determined by two capabilities: action planning and answer summarization. The former, action planning, is the core capability that dictates an agent's performance. However,…

Machine Learning · Computer Science 2025-08-28 Zhiwei Li , Yong Hu , Wenqing Wang

With the rapid growth of user historical behavior data, user interest modeling has become a prominent aspect in Click-Through Rate (CTR) prediction, focusing on learning user intent representations. However, this complexity poses…

Information Retrieval · Computer Science 2025-05-09 Xin Song , Xiaochen Li , Jinxin Hu , Hong Wen , Zulong Chen , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Controlling the attribute intensity of text generation is crucial across scenarios (e.g., writing conciseness, chatting emotion, and explanation clarity). The remarkable capabilities of large language models (LLMs) have revolutionized text…

Computation and Language · Computer Science 2024-06-10 Shang Zhou , Feng Yao , Chengyu Dong , Zihan Wang , Jingbo Shang

Understanding user interests is crucial for Click-Through Rate (CTR) prediction tasks. In sequential recommendation, pre-training from user historical behaviors through self-supervised learning can better comprehend user dynamic…

Information Retrieval · Computer Science 2024-07-30 Ruidong Han , Qianzhong Li , He Jiang , Rui Li , Yurou Zhao , Xiang Li , Wei Lin

When users are dissatisfied with recommendations from a recommender system, they often lack fine-grained controls for changing them. Large language models (LLMs) offer a solution by allowing users to guide their recommendations through…

Artificial Intelligence · Computer Science 2025-10-15 Micah Carroll , Adeline Foote , Kevin Feng , Marcus Williams , Anca Dragan , W. Bradley Knox , Smitha Milli