English
Related papers

Related papers: RTLSeek: Boosting the LLM-Based RTL Generation wit…

200 papers

Recent advances in Large Language Models (LLMs) have sparked growing interest in applying them to Electronic Design Automation (EDA) tasks, particularly Register Transfer Level (RTL) code generation. While several RTL datasets have been…

Hardware Architecture · Computer Science 2025-08-26 Anjiang Wei , Huanmi Tan , Tarun Suresh , Daniel Mendoza , Thiago S. F. X. Teixeira , Ke Wang , Caroline Trippel , Alex Aiken

Large Language Models (LLMs) have been integrated into recommender systems to enhance user behavior comprehension. The Retrieval Augmented Generation (RAG) technique is further incorporated into these systems to retrieve more relevant items…

Information Retrieval · Computer Science 2025-03-27 Sichun Luo , Jian Xu , Xiaojie Zhang , Linrong Wang , Sicong Liu , Hanxu Hou , Linqi Song

Transfer learning aims to improve the performance of a target model by leveraging data from related source populations, which is known to be especially helpful in cases with insufficient target data. In this paper, we study the problem of…

Methodology · Statistics 2025-02-19 Tian Gu , Yi Han , Rui Duan

Many modern retrieval problems are set-valued: given a broad intent, the system must return a collection of results that optimizes higher-order properties (e.g., diversity, coverage, complementarity, coherence) while remaining grounded with…

Information Retrieval · Computer Science 2026-03-09 Pengcheng Jiang , Judith Yue Li , Moonkyung Ryu , R. Lily Hu , Kun Su , Zhong Yi Wan , Liam Hebert , Hao Peng , Jiawei Han , Dima Kuzmin , Craig Boutilier

Reinforcement learning (RL) is a powerful approach to enhance task-oriented dialogue (TOD) systems. However, existing RL methods tend to mainly focus on generation tasks, such as dialogue policy learning (DPL) or response generation (RG),…

Artificial Intelligence · Computer Science 2024-06-21 Huifang Du , Shuqin Li , Minghao Wu , Xuejing Feng , Yuan-Fang Li , Haofen Wang

Reinforcement learning (RL) has been widely used in training large language models (LLMs) for preventing unexpected outputs, eg reducing harmfulness and errors. However, existing RL methods mostly adopt the instance-level reward, which is…

Computation and Language · Computer Science 2024-06-18 Zhipeng Chen , Kun Zhou , Wayne Xin Zhao , Junchen Wan , Fuzheng Zhang , Di Zhang , Ji-Rong Wen

Large language models (LLMs) hold promise for automating integrated circuit (IC) engineering using register transfer level (RTL) hardware description languages (HDLs) like Verilog. However, challenges remain in ensuring the quality of…

Hardware Architecture · Computer Science 2025-11-18 Zhiteng Chao , Yonghao Wang , Xinyu Zhang , Jiaxin Zhou , Tenghui Hua , Husheng Han , Tianmeng Yang , Jianan Mu , Bei Yu , Rui Zhang , Jing Ye , Huawei Li

The training paradigm integrating large language models (LLM) is gradually reshaping sequential recommender systems (SRS) and has shown promising results. However, most existing LLM-enhanced methods rely on rich textual information on the…

Information Retrieval · Computer Science 2024-10-17 Dugang Liu , Shenxian Xian , Xiaolin Lin , Xiaolian Zhang , Hong Zhu , Yuan Fang , Zhen Chen , Zhong Ming

Large Language Model (LLM) training is frequently interrupted by a heterogeneous spectrum of failures, from common GPU crashes to catastrophic cluster-wide outages. Existing checkpointing systems rely on monolithic, single-tier storage…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-19 Shujie Han , Feng Jiang , Patrick P. C. Lee , Xiao Zhang , Zhijie Huang , Nannan Zhao , Xiaonan Zhao , Lichen Pan

The integration of Large Language Models (LLMs) into recommender systems has led to substantial performance improvements. However, this often comes at the cost of diminished recommendation diversity, which can negatively impact user…

Information Retrieval · Computer Science 2025-01-07 Jiaju Chen , Chongming Gao , Shuai Yuan , Shuchang Liu , Qingpeng Cai , Peng Jiang

Reinforcement Learning (RL) based methods have been increasingly explored for robot learning. However, RL based methods often suffer from low sampling efficiency in the exploration phase, especially for long-horizon manipulation tasks, and…

Robotics · Computer Science 2024-12-31 Hao Zhang , Hao Wang , Xiucai Huang , Wenrui Chen , Zhen Kan

Recent advances in reinforcement learning (RL)-based post-training have led to notable improvements in large language models (LLMs), particularly in enhancing their reasoning capabilities to handle complex tasks. However, most existing…

Machine Learning · Computer Science 2025-10-14 Zhenting Wang , Guofeng Cui , Yu-Jhe Li , Kun Wan , Wentian Zhao

Leveraging the model's internal information as the self-reward signal in Reinforcement Learning (RL) has received extensive attention due to its label-free nature. While prior works have made significant progress in applying the Test-Time…

Machine Learning · Computer Science 2026-03-18 Xizhong Yang , Yinan Xia , Huiming Wang , Mofei Song

Many medical datasets have recently been created for medical image segmentation tasks, and it is natural to question whether we can use them to sequentially train a single model that (1) performs better on all these datasets, and (2)…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Chenyu You , Jinlin Xiang , Kun Su , Xiaoran Zhang , Siyuan Dong , John Onofrey , Lawrence Staib , James S. Duncan

Inspired by advances in LLMs, reasoning-enhanced sequential recommendation performs multi-step deliberation before making final predictions, unlocking greater potential for capturing user preferences. However, current methods are…

Information Retrieval · Computer Science 2025-12-17 Yifan Shao , Peilin Zhou , Shoujin Wang , Weizhi Zhang , Xu Cai , Sunghun Kim

Reinforcement learning with verifiable rewards (RLVR) has become a key technique for enhancing LLMs' reasoning abilities, yet its data inefficiency remains a major bottleneck. To address this critical yet challenging issue, we present a…

Machine Learning · Computer Science 2026-04-28 Shipeng Li , Zhiqin Yang , Shikun Li , Xiaobo Xia , Hengyu Liu , Xinghua Zhang , Gaode Chen , Dong Fang , Ying Tai , Zhe Peng

Functional verification has become the most time-consuming phase in IC development, and Assertion-Based Verification (ABV) is key to reducing debugging time. However, existing LLM-based assertion generation methods typically pursue…

Hardware Architecture · Computer Science 2026-04-13 Yonghao Wang , Hongqin Lyu , Boling Chen , MinYang Bao , Wenchao Ding , Feng Gu , Zhiteng Chao , Jianan Mu , Kan Shi , Tiancheng Wang , Huawei Li

Requirements traceability, the process of establishing and maintaining relationships between requirements and various software development artifacts, is paramount for ensuring system integrity and fulfilling requirements throughout the…

Software Engineering · Computer Science 2026-05-25 Nouf Alturayeif , Irfan Ahmad , Jameleddine Hassine

Performance of neural network models relies on the availability of large datasets with minimal levels of uncertainty. Transfer Learning (TL) models have been proposed to resolve the issue of small dataset size by letting the model train on…

Fine-tuning Large Language Models (LLMs) typically relies on large quantities of high-quality annotated data, or questions with well-defined ground truth answers in the case of Reinforcement Learning with Verifiable Rewards (RLVR). While…

Artificial Intelligence · Computer Science 2026-04-21 Justin Bauer , Thomas Walshe , Derek Pham , Harit Vishwakarma , Armin Parchami , Frederic Sala , Paroma Varma