English
Related papers

Related papers: SafeCRS: Personalized Safety Alignment for LLM-Bas…

200 papers

Real-world recommendation systems commonly offer diverse content scenarios for users to interact with. Considering the enormous number of users in industrial platforms, it is infeasible to utilize a single unified recommendation model to…

Information Retrieval · Computer Science 2024-12-10 Chonggang Song , Chunxu Shen , Hao Gu , Yaoming Wu , Lingling Yi , Jie Wen , Chuan Chen

The conversational recommendation system (CRS) has been criticized regarding its user experience in real-world scenarios, despite recent significant progress achieved in academia. Existing evaluation protocols for CRS may prioritize…

Computation and Language · Computer Science 2024-05-07 Chen Huang , Peixin Qin , Yang Deng , Wenqiang Lei , Jiancheng Lv , Tat-Seng Chua

Constrained reinforcement learning (CRL) has gained significant interest recently, since safety constraints satisfaction is critical for real-world problems. However, existing CRL methods constraining discounted cumulative costs generally…

Machine Learning · Computer Science 2022-06-08 Dongjie Yu , Haitong Ma , Shengbo Eben Li , Jianyu Chen

Autonomous vehicles hold great promise for reducing traffic fatalities and improving transportation efficiency, yet their widespread adoption hinges on embedding credible and transparent ethical reasoning into routine and emergency…

Machine Learning · Computer Science 2025-11-10 Dianzhao Li , Ostap Okhrin

Large language models (LLMs) have demonstrated their significant potential to be applied for addressing various application tasks. However, traditional recommender systems continue to face great challenges such as poor interactivity and…

Information Retrieval · Computer Science 2023-04-05 Yunfan Gao , Tao Sheng , Youlin Xiang , Yun Xiong , Haofen Wang , Jiawei Zhang

Balancing helpfulness and safety (harmlessness) is a critical challenge in aligning large language models (LLMs). Current approaches often decouple these two objectives, training separate preference models for helpfulness and safety, while…

Machine Learning · Computer Science 2025-02-28 Xiyue Peng , Hengquan Guo , Jiawei Zhang , Dongqing Zou , Ziyu Shao , Honghao Wei , Xin Liu

Large Language Models (LLMs) are increasingly integrated into safety-critical workflows, yet existing security analyses remain fragmented and often isolate model behavior from the broader system context. This work introduces a goal-driven…

Cryptography and Security · Computer Science 2026-03-10 Neha Nagaraja , Hayretdin Bahsi

Ensuring the safety and harmlessness of Large Language Models (LLMs) has become equally critical as their performance in applications. However, existing safety alignment methods typically suffer from safety-performance trade-offs and the…

Computation and Language · Computer Science 2025-06-30 Yichi Zhang , Siyuan Zhang , Yao Huang , Zeyu Xia , Zhengwei Fang , Xiao Yang , Ranjie Duan , Dong Yan , Yinpeng Dong , Jun Zhu

Optimizing large language models (LLMs) for downstream use cases often involves the customization of pre-trained LLMs through further fine-tuning. Meta's open release of Llama models and OpenAI's APIs for fine-tuning GPT-3.5 Turbo on custom…

Computation and Language · Computer Science 2023-10-06 Xiangyu Qi , Yi Zeng , Tinghao Xie , Pin-Yu Chen , Ruoxi Jia , Prateek Mittal , Peter Henderson

Conversational recommender systems (CRS) enable users to articulate their preferences and provide feedback through natural language. With the advent of large language models (LLMs), the potential to enhance user engagement with CRS and…

Human-Computer Interaction · Computer Science 2024-05-24 Yizhe Zhang , Yucheng Jin , Li Chen , Ting Yang

Recommender System (RS) is currently an effective way to solve information overload. To meet users' next click behavior, RS needs to collect users' personal information and behavior to achieve a comprehensive and profound user preference…

Information Retrieval · Computer Science 2022-06-29 Jiangcheng Qin , Baisong Liu

Recommender systems are quintessential applications of human-computer interaction. Widely utilized in daily life, they offer significant convenience but also present numerous challenges, such as the information cocoon effect, privacy…

Information Retrieval · Computer Science 2024-11-25 Kaike Zhang , Yunfan Wu , Yougang lyu , Du Su , Yingqiang Ge , Shuchang Liu , Qi Cao , Zhaochun Ren , Fei Sun

The integration of reinforcement learning (RL) into large language models (LLMs) has opened new opportunities for recommender systems by eliciting reasoning and improving user preference modeling. However, RL-based LLM recommendation faces…

Information Retrieval · Computer Science 2026-02-05 Lin Wang , Yang Zhang , Jingfan Chen , Xiaoyan Zhao , Fengbin Zhu , Qing Li , Tat-Seng Chua

Fine-tuning a general-purpose large language model (LLM) for a specific domain or task has become a routine procedure for ordinary users. However, fine-tuning is known to remove the safety alignment features of the model, even when the…

Computation and Language · Computer Science 2025-06-23 Kathleen C. Fraser , Hillary Dawkins , Isar Nejadgholi , Svetlana Kiritchenko

With the aid of large language models, current conversational recommender system (CRS) has gaining strong abilities to persuade users to accept recommended items. While these CRSs are highly persuasive, they can mislead users by…

Computation and Language · Computer Science 2024-10-08 Peixin Qin , Chen Huang , Yang Deng , Wenqiang Lei , Tat-Seng Chua

Extending recommender systems to federated learning (FL) frameworks to protect the privacy of users or platforms while making recommendations has recently gained widespread attention in academia. This is due to the natural coupling of…

Information Retrieval · Computer Science 2025-08-28 Yunqi Mi , Jiakui Shen , Guoshuai Zhao , Jialie Shen , Xueming Qian

In this paper, we present a systematic effort to design, evaluate, and implement a realistic conversational recommender system (CRS). The objective of our system is to allow users to input free-form text to request recommendations, and then…

Artificial Intelligence · Computer Science 2025-01-03 Se-eun Yoon , Xiaokai Wei , Yexi Jiang , Rachit Pareek , Frank Ong , Kevin Gao , Julian McAuley , Michelle Gong

The current paradigm for safety alignment of large language models (LLMs) follows a one-size-fits-all approach: the model refuses to interact with any content deemed unsafe by the model provider. This approach lacks flexibility in the face…

Computation and Language · Computer Science 2025-03-05 Jingyu Zhang , Ahmed Elgohary , Ahmed Magooda , Daniel Khashabi , Benjamin Van Durme

Conversational Recommender Systems (CRSs) aim to elicit user preferences via natural dialogue to provide suitable item recommendations. However, current CRSs often deviate from realistic human interactions by rapidly recommending items in…

Information Retrieval · Computer Science 2025-09-01 Manato Tajiri , Michimasa Inaba

Autonomous vehicles necessitate a delicate balance between safety, efficiency, and user preferences in trajectory planning. Existing traditional or learning-based methods face challenges in adequately addressing all these aspects. In…

Robotics · Computer Science 2024-05-24 Yuejiao Xu , Ruolin Wang , Chengpeng Xu , Jianmin Ji