English
Related papers

Related papers: Safety vs. Performance: How Multi-Objective Learni…

200 papers

The advancement of Large Language Models (LLMs) has significantly impacted various domains, including Web search, healthcare, and software development. However, as these models scale, they become more vulnerable to cybersecurity risks,…

Cryptography and Security · Computer Science 2024-10-01 Qin Liu , Wenjie Mo , Terry Tong , Jiashu Xu , Fei Wang , Chaowei Xiao , Muhao Chen

Amid mounting concern about the reliability and credibility of machine learning research, we present a principled framework for making robust and generalizable claims: the multiverse analysis. Our framework builds upon the multiverse…

Machine Learning · Computer Science 2022-10-13 Samuel J. Bell , Onno P. Kampman , Jesse Dodge , Neil D. Lawrence

Consider a marketplace of AI tools, each with slightly different strengths and weaknesses. By selecting the right model for the task at hand, a user can do better than simply committing to a single model for everything. Routers operate…

Computer Science and Game Theory · Computer Science 2026-02-27 Kate Donahue , Manish Raghavan

Many research fields are currently reckoning with issues of poor levels of reproducibility. Some label it a "crisis", and research employing or building Machine Learning (ML) models is no exception. Issues including lack of transparency,…

Software Engineering · Computer Science 2025-02-27 Harald Semmelrock , Tony Ross-Hellauer , Simone Kopeinik , Dieter Theiler , Armin Haberl , Stefan Thalmann , Dominik Kowald

We argue that, when establishing and benchmarking Machine Learning (ML) models, the research community should favour evaluation metrics that better capture the value delivered by their model in practical applications. For a specific class…

Machine Learning · Computer Science 2021-12-14 Fabio Casati , Pierre-André Noël , Jie Yang

Ensuring robust safety measures across a wide range of scenarios is crucial for user-facing systems. While Large Language Models (LLMs) can generate valuable data for safety measures, they often exhibit distributional biases, focusing on…

Computation and Language · Computer Science 2024-10-16 Sabit Hassan , Anthony Sicilia , Malihe Alikhani

In this work, a new multiobjective optimization algorithm called multiobjective learner performance-based behavior algorithm is proposed. The proposed algorithm is based on the process of transferring students from high school to college.…

Neural and Evolutionary Computing · Computer Science 2022-01-31 Chnoor M. Rahman , Tarik A. Rashid , Aram Mahmood Ahmed , Seyedali Mirjalili

Understanding how language model performance varies with scale is critical to benchmark and algorithm development. Scaling laws are one approach to building this understanding, but the requirement of training models across many different…

Machine Learning · Computer Science 2024-10-03 Yangjun Ruan , Chris J. Maddison , Tatsunori Hashimoto

Multi-Objective Reinforcement Learning (MORL) presents significant challenges and opportunities for optimizing multiple objectives in Large Language Models (LLMs). We introduce a MORL taxonomy and examine the advantages and limitations of…

Computation and Language · Computer Science 2025-09-29 Lingxiao Kong , Cong Yang , Oya Deniz Beyan , Zeyd Boukhers

Over the past few years, providers such as Google, Microsoft, and Amazon have started to provide customers with access to software interfaces allowing them to easily embed machine learning tasks into their applications. Overall,…

Machine Learning · Computer Science 2020-05-20 Emiliano De Cristofaro

Multi-objective preference alignment in language models often encounters a challenging trade-off: optimizing for one human preference (e.g., helpfulness) frequently compromises others (e.g., harmlessness) due to the inherent conflicts…

Computation and Language · Computer Science 2025-04-16 Zhihao Xu , Yongqi Tong , Xin Zhang , Jun Zhou , Xiting Wang

This study explores the potential of large language models (LLMs) to conduct market experiments, aiming to understand their capability to comprehend competitive market dynamics. We model the behavior of market agents in a controlled…

Human-Computer Interaction · Computer Science 2024-11-04 Jingru Jia , Zehua Yuan

In multiple domains such as malware detection, automated driving systems, or fraud detection, classification algorithms are susceptible to being attacked by malicious agents willing to perturb the value of instance covariates to pursue…

Machine Learning · Statistics 2025-07-10 Victor Gallego , Roi Naveiro , Alberto Redondo , David Rios Insua , Fabrizio Ruggeri

Economic complexity methods, and in particular relatedness measures, lack a systematic evaluation and comparison framework. We argue that out-of-sample forecast exercises should play this role, and we compare various machine learning models…

Machine Learning · Computer Science 2021-06-01 Giambattista Albora , Luciano Pietronero , Andrea Tacchella , Andrea Zaccaria

Recommender systems can be characterized as software solutions that provide users convenient access to relevant content. Traditionally, recommender systems research predominantly focuses on developing machine learning algorithms that aim to…

Information Retrieval · Computer Science 2022-10-20 Dietmar Jannach

Machine learning can provide deep insights into data, allowing machines to make high-quality predictions and having been widely used in real-world applications, such as text mining, visual classification, and recommender systems. However,…

Machine Learning · Computer Science 2020-08-11 Meng Wang , Weijie Fu , Xiangnan He , Shijie Hao , Xindong Wu

The emergence and continued reliance on the Internet and related technologies has resulted in the generation of large amounts of data that can be made available for analyses. However, humans do not possess the cognitive capabilities to…

Machine Learning · Computer Science 2021-01-12 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

Applications of machine learning (ML) to high-stakes policy settings -- such as education, criminal justice, healthcare, and social service delivery -- have grown rapidly in recent years, sparking important conversations about how to ensure…

Machine Learning · Computer Science 2021-05-14 Hemank Lamba , Kit T. Rodolfa , Rayid Ghani

Machine learning in production needs to balance multiple objectives: This is particularly evident in ranking or recommendation models, where conflicting objectives such as user engagement, satisfaction, diversity, and novelty must be…

Human-Computer Interaction · Computer Science 2025-02-11 Chenyang Yang , Tesi Xiao , Michael Shavlovsky , Christian Kästner , Tongshuang Wu

As Artificial Intelligence (AI) technologies continue to gain traction in the modern-day world, they ultimately pose an immediate threat to current cybersecurity systems via exploitative methods. Prompt engineering is a relatively new field…

Cryptography and Security · Computer Science 2023-12-05 Haiyan Xuan , Mohith Manohar