English
Related papers

Related papers: D-CFPR: D numbers extended consistent fuzzy prefer…

200 papers

Direct Preference Optimization (DPO) has recently emerged as a simple and effective alternative to reinforcement learning from human feedback (RLHF) for aligning large language models (LLMs) with user preferences. However, existing DPO…

Machine Learning · Computer Science 2025-10-10 Jason Bohne , Pawel Polak , David Rosenberg , Brian Bloniarz , Gary Kazantsev

Post-training of language models, either through reinforcement learning, preference optimization or supervised finetuning, tends to sharpen the output probability distribution and reduce the diversity of generated responses. This is…

Computation and Language · Computer Science 2025-05-23 Jack Lanchantin , Angelica Chen , Shehzaad Dhuliawala , Ping Yu , Jason Weston , Sainbayar Sukhbaatar , Ilia Kulikov

Direct Preference Optimization (DPO), which derives reward signals directly from pairwise preference data, has shown its effectiveness on aligning Large Language Models (LLMs) with human preferences. Despite its widespread use across…

Computation and Language · Computer Science 2024-04-09 Duanyu Feng , Bowen Qin , Chen Huang , Zheng Zhang , Wenqiang Lei

Although Large Language Models (LLMs) have made remarkable progress, current preference optimization methods still struggle to align directional consistency while preserving reasoning diversity. To address this limitation, we propose…

Computation and Language · Computer Science 2026-05-12 Mengyi Deng , Zhiwei Li , Xin Li , Tingyu Zhu , Yulan Yuan , Zhijiang Guo , Wei Wang

Model selection is a cornerstone of statistical inference, where information criteria are widely employed to balance model fit and complexity. However, classical likelihood-based criteria are often highly sensitive to contamination,…

Methodology · Statistics 2026-03-26 Udita Goswami , Shuvashree Mondal

Aligning large language models with human preferences is crucial for their safe deployment. While Direct Preference Optimization (DPO) offers an efficient alternative to reinforcement learning from human feedback, traditional DPO methods…

Artificial Intelligence · Computer Science 2025-07-30 Mengyang Li , Zhong Zhang

Unsatisfying accuracy of learning methods is mostly caused by omitting the influence of important parameters such as membership assignments, type of data objects, and distance or similarity functions. The proposed method, called Bounded…

Machine Learning · Computer Science 2020-07-28 Hossein Yazdani

We define Conditional quasi concave Performance Measures (CPMs), on random variables bounded from below, to accommodate for additional information. Our notion encompasses a wide variety of cases, from conditional expected utility and…

Portfolio Management · Quantitative Finance 2012-12-18 Sara Biagini , Jocelyne Bion-Nadal

Many real life optimization problems contain both hard and soft constraints, as well as qualitative conditional preferences. However, there is no single formalism to specify all three kinds of information. We therefore propose a framework,…

Artificial Intelligence · Computer Science 2009-05-26 Carmel Domshlak , Francesca Rossi , Kristen Brent Venable , Toby Walsh

Closed-form differential equations, including partial differential equations and higher-order ordinary differential equations, are one of the most important tools used by scientists to model and better understand natural phenomena.…

Machine Learning · Computer Science 2023-11-30 Krzysztof Kacprzyk , Zhaozhi Qian , Mihaela van der Schaar

Stable matchings have been studied extensively in social choice literature. The focus has been mostly on integral matchings, in which the nodes on the two sides are wholly matched. A fractional matching, which is a convex combination of…

Computer Science and Game Theory · Computer Science 2022-04-20 Shivika Narang , Y Narahari

User-centric recommendation has become essential for delivering personalized services, as it enables systems to adapt to users' evolving behaviors while respecting their long-term preferences and privacy constraints. Although federated…

Information Retrieval · Computer Science 2026-03-19 Chunxu Zhang , Zhiheng Xue , Guodong Long , Weipeng Zhang , Bo Yang

Explainable artificial intelligence (XAI) has become increasingly important in decision-critical domains such as healthcare, finance, and law. Counterfactual (CF) explanations, a key approach in XAI, provide users with actionable insights…

Artificial Intelligence · Computer Science 2025-07-22 Volkan Bakir , Polat Goktas , Sureyya Akyuz

The construction of numerical value scales (or priority values) is a recurrent topic in decision-aiding research. However, in real contexts, uncertainty and limited cognitive precision often lead decision-makers to provide interval…

General Mathematics · Mathematics 2025-10-21 Diego García-Zamora , José Rui Figueira

Conformal prediction is emerging as a popular paradigm for providing rigorous uncertainty quantification in machine learning since it can be easily applied as a post-processing step to already trained models. In this paper, we extend…

Machine Learning · Computer Science 2023-06-02 Charles Lu , Yaodong Yu , Sai Praneeth Karimireddy , Michael I. Jordan , Ramesh Raskar

The purpose of this paper is to point to the usefulness of applying a linear mathematical formulation of fuzzy multiple criteria objective decision methods in organising business activities. In this respect fuzzy parameters of linear…

Artificial Intelligence · Computer Science 2007-05-23 Sonja Petrovic-Lazarevic , Ajith Abraham

Systems of fuzzy relation equations and inequalities in which an unknown fuzzy relation is on the one side of the equation or inequality are linear systems. They are the most studied ones, and a vast literature on linear systems focuses on…

Artificial Intelligence · Computer Science 2022-06-03 Stefan Stanimirovic , Ivana Micic

Accurately characterizing non-linear functional manifolds with singularities is a fundamental challenge in scientific computing. While Multi-Layer Perceptrons (MLPs) dominate, their spectral bias hinders resolving high-curvature features…

Machine Learning · Computer Science 2026-03-24 Chao Wang , Xuancheng Zhou , Ruilin Hou , Xiaoyu Cheng , Ruiyi Ding

Cross-domain recommendation (CDR) has been proven as a promising way to alleviate the cold-start issue, in which the most critical problem is how to draw an informative user representation in the target domain via the transfer of user…

Information Retrieval · Computer Science 2025-01-22 Xiaodong Li , Hengzhu Tang , Jiawei Sheng , Xinghua Zhang , Li Gao , Suqi Cheng , Dawei Yin , Tingwen Liu

The Fuzz programming language [Reed and Pierce, 2010] uses an elegant linear type system combined with a monad-like type to express and reason about probabilistic sensitivity properties, most notably $\epsilon$-differential privacy. We show…

Programming Languages · Computer Science 2019-04-22 Arthur Azevedo de Amorim , Marco Gaboardi , Justin Hsu , Shin-ya Katsumata