English
Related papers

Related papers: Exploiting Preferences in Loss Functions for Seque…

200 papers

Loss function learning is a new meta-learning paradigm that aims to automate the essential task of designing a loss function for a machine learning model. Existing techniques for loss function learning have shown promising results, often…

Machine Learning · Computer Science 2025-10-14 Christian Raymond , Qi Chen , Bing Xue , Mengjie Zhang

Human preference alignment is critical in building powerful and reliable large language models (LLMs). However, current methods either ignore the multi-dimensionality of human preferences (e.g. helpfulness and harmlessness) or struggle with…

Machine Learning · Computer Science 2024-10-14 Xingzhou Lou , Junge Zhang , Jian Xie , Lifeng Liu , Dong Yan , Kaiqi Huang

Recommender systems learn from historical users' feedback that is often non-uniformly distributed across items. As a consequence, these systems may end up suggesting popular items more than niche items progressively, even when the latter…

Information Retrieval · Computer Science 2020-10-06 Ludovico Boratto , Gianni Fenu , Mirko Marras

Recommender systems play a critical role in enhancing user experience by providing personalized suggestions based on user preferences. Traditional approaches often rely on explicit numerical ratings or assume access to fully ranked lists of…

Information Retrieval · Computer Science 2025-08-22 Bahar Boroomand , James R. Wright

Recent years have witnessed the increasing popularity of Location-based Social Network (LBSN) services, which provides unparalleled opportunities to build personalized Point-of-Interest (POI) recommender systems. Existing POI recommendation…

Machine Learning · Computer Science 2022-01-04 Dongbo Xi , Fuzhen Zhuang , Yanchi Liu , Hengshu Zhu , Pengpeng Zhao , Chang Tan , Qing He

We propose a method for building an interpretable recommender system for personalizing online content and promotions. Historical data available for the system consists of customer features, provided content (promotions), and user responses.…

Machine Learning · Statistics 2016-06-21 Amit Dhurandhar , Sechan Oh , Marek Petrik

Loss functions drive the optimization of machine learning algorithms. The choice of a loss function can have a significant impact on the training of a model, and how the model learns the data. Binary classification is one of the major…

Machine Learning · Computer Science 2022-11-02 Rayan Wali

When users can benefit from certain predictive outcomes, they may be prone to act to achieve those outcome, e.g., by strategically modifying their features. The goal in strategic classification is therefore to train predictive models that…

Machine Learning · Computer Science 2023-06-12 Guy Horowitz , Nir Rosenfeld

In this paper, we propose a variational approach to weakly supervised document-level multi-aspect sentiment classification. Instead of using user-generated ratings or annotations provided by domain experts, we use target-opinion word pairs…

Computation and Language · Computer Science 2019-04-11 Ziqian Zeng , Wenxuan Zhou , Xin Liu , Yangqiu Song

Recommender systems are personalized: we expect the results given to a particular user to reflect that user's preferences. Some researchers have studied the notion of calibration, how well recommendations match users' stated preferences,…

Information Retrieval · Computer Science 2019-09-17 Kun Lin , Nasim Sonboli , Bamshad Mobasher , Robin Burke

We reformulate explanation quality assessment as a ranking problem rather than a generation problem. Instead of optimizing models to produce a single "best" explanation token-by-token, we train reward models to discriminate among multiple…

Artificial Intelligence · Computer Science 2026-04-28 Thomas Bailleux , Tanmoy Mukherjee , Emmanuel Lonca , Pierre Marquis , Zied Bouraoui

In multi-objective decision planning and learning, much attention is paid to producing optimal solution sets that contain an optimal policy for every possible user preference profile. We argue that the step that follows, i.e, determining…

Machine Learning · Computer Science 2018-02-22 Luisa M Zintgraf , Diederik M Roijers , Sjoerd Linders , Catholijn M Jonker , Ann Nowé

We study planning with submodular objective functions, where instead of maximizing the cumulative reward, the goal is to maximize the objective value induced by a submodular function. Our framework subsumes standard planning and submodular…

Artificial Intelligence · Computer Science 2020-10-23 Ruosong Wang , Hanrui Zhang , Devendra Singh Chaplot , Denis Garagić , Ruslan Salakhutdinov

We consider the task of learning from both positive and negative feedback in a sequential recommendation scenario, as both types of feedback are often present in user interactions. Meanwhile, conventional sequential learning models usually…

Information Retrieval · Computer Science 2025-08-21 Veronika Ivanova , Evgeny Frolov , Alexey Vasilev

Large-scale recommender systems often face severe latency and storage constraints at prediction time. These are particularly acute when the number of items that could be recommended is large, and calculating predictions for the full set is…

Information Retrieval · Computer Science 2017-09-05 Maciej Kula

Preference alignment methods are increasingly critical for steering large language models (LLMs) to generate outputs consistent with human values. While recent approaches often rely on synthetic data generated by LLMs for scalability and…

Computation and Language · Computer Science 2025-10-21 Mingye Zhu , Yi Liu , Zheren Fu , Yongdong Zhang , Zhendong Mao

With the great success of deep neural networks, adversarial learning has received widespread attention in various studies, ranging from multi-class learning to multi-label learning. However, existing adversarial attacks toward multi-label…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yuchen Sun , Qianqian Xu , Zitai Wang , Qingming Huang

Machine learning-supported decisions, such as ordering diagnostic tests or determining preventive custody, often require converting probabilistic forecasts into binary classifications. We adopt a consequentialist perspective from decision…

Machine Learning · Computer Science 2026-03-11 Gerardo Flores , Abigail Schiff , Alyssa H. Smith , Julia A Fukuyama , Ashia C. Wilson

Weakly-supervised learning is a paradigm for alleviating the scarcity of labeled data by leveraging lower-quality but larger-scale supervision signals. While existing work mainly focuses on utilizing a certain type of weak supervision, we…

Machine Learning · Statistics 2019-10-11 Yivan Zhang , Nontawat Charoenphakdee , Masashi Sugiyama

Recent studies strive to incorporate various human rationales into neural networks to improve model performance, but few pay attention to the quality of the rationales. Most existing methods distribute their models' focus to…

Computation and Language · Computer Science 2021-06-04 Quzhe Huang , Shengqi Zhu , Yansong Feng , Dongyan Zhao