English
Related papers

Related papers: Ranking Robustness Under Adversarial Document Mani…

200 papers

Over recent years, devising classification algorithms that are robust to adversarial perturbations has emerged as a challenging problem. In particular, deep neural nets (DNNs) seem to be susceptible to small imperceptible changes over test…

Machine Learning · Computer Science 2019-12-20 Sanjam Garg , Somesh Jha , Saeed Mahloujifar , Mohammad Mahmoody

Learning to Rank (LTR) methods generally assume that each document in a top-K ranking is presented in an equal format. However, previous work has shown that users' perceptions of relevance can be changed by varying presentations, i.e.,…

Information Retrieval · Computer Science 2025-07-01 Norman Knyazev , Harrie Oosterhuis

Online misinformation remains a critical challenge, and fact-checkers increasingly rely on claim matching systems that use sentence embedding models to retrieve relevant fact-checks. However, as users interact with claims online, they often…

Computation and Language · Computer Science 2025-06-06 Jabez Magomere , Emanuele La Malfa , Manuel Tonneau , Ashkan Kazemi , Scott Hale

Randomized smoothing has shown promising certified robustness against adversaries in classification tasks. Despite such success with only zeroth-order access to base models, randomized smoothing has not been extended to a general form of…

Machine Learning · Computer Science 2024-05-16 Aref Miri Rekavandi , Olga Ohrimenko , Benjamin I. P. Rubinstein

Spurious correlations threaten the validity of statistical classifiers. While model accuracy may appear high when the test data is from the same distribution as the training data, it can quickly degrade when the test distribution changes.…

Machine Learning · Computer Science 2020-12-21 Zhao Wang , Aron Culotta

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani

Recommender systems are one of the most pervasive applications of machine learning in industry, with many services using them to match users to products or information. As such it is important to ask: what are the possible fairness risks,…

Computers and Society · Computer Science 2019-03-12 Alex Beutel , Jilin Chen , Tulsee Doshi , Hai Qian , Li Wei , Yi Wu , Lukasz Heldt , Zhe Zhao , Lichan Hong , Ed H. Chi , Cristos Goodrow

In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jie Wang , Jun Ai , Minyan Lu , Haoran Su , Dan Yu , Yutao Zhang , Junda Zhu , Jingyu Liu

Existing deep neural networks, say for image classification, have been shown to be vulnerable to adversarial images that can cause a DNN misclassification, without any perceptible change to an image. In this work, we propose shock absorbing…

Machine Learning · Computer Science 2019-09-19 Kevin Eykholt , Swati Gupta , Atul Prakash , Amir Rahmati , Pratik Vaishnavi , Haizhong Zheng

With the introduction of machine learning in high-stakes decision making, ensuring algorithmic fairness has become an increasingly important problem to solve. In response to this, many mathematical definitions of fairness have been…

Machine Learning · Computer Science 2024-06-04 Edward Small , Wei Shao , Zeliang Zhang , Peihan Liu , Jeffrey Chan , Kacper Sokol , Flora Salim

Algorithmic recourse aims to disclose the inner workings of the black-box decision process in situations where decisions have significant consequences, by providing recommendations to empower beneficiaries to achieve a more favorable…

Machine Learning · Computer Science 2023-02-14 Ahmad-Reza Ehyaei , Amir-Hossein Karimi , Bernhard Schölkopf , Setareh Maghsudi

Design of reliable systems must guarantee stability against input perturbations. In machine learning, such guarantee entails preventing overfitting and ensuring robustness of models against corruption of input data. In order to maximize…

Machine Learning · Statistics 2019-08-08 Judy Hoffman , Daniel A. Roberts , Sho Yaida

Deep neural networks for computer vision are deployed in increasingly safety-critical and socially-impactful applications, motivating the need to close the gap in model performance under varied, naturally occurring imaging conditions.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Nathan Drenkow , Numair Sani , Ilya Shpitser , Mathias Unberath

Efforts in the recommendation community are shifting from the sole emphasis on utility to considering beyond-utility factors, such as fairness and robustness. Robustness of recommendation models is typically linked to their ability to…

Information Retrieval · Computer Science 2024-01-29 Ludovico Boratto , Francesco Fabbri , Gianni Fenu , Mirko Marras , Giacomo Medda

Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however, often has uncertainty and poor explainability in…

Cryptography and Security · Computer Science 2022-10-12 Mark Huasong Meng , Guangdong Bai , Sin Gee Teo , Zhe Hou , Yan Xiao , Yun Lin , Jin Song Dong

Recently, recommender system has achieved significant success. However, due to the openness of recommender systems, they remain vulnerable to malicious attacks. Additionally, natural noise in training data and issues such as data sparsity…

Information Retrieval · Computer Science 2025-06-16 Lei Cheng , Xiaowen Huang , Jitao Sang , Jian Yu

Although originally developed to evaluate sets of items, recall is often used to evaluate rankings of items, including those produced by recommender, retrieval, and other machine learning systems. The application of recall without a formal…

Information Retrieval · Computer Science 2024-12-03 Fernando Diaz , Michael D. Ekstrand , Bhaskar Mitra

Large Language Models (LLMs) have demonstrated strong performance in information retrieval tasks like passage ranking. Our research examines how instruction-following capabilities in LLMs interact with multi-document comparison tasks,…

Information Retrieval · Computer Science 2025-09-24 Yaoyao Qian , Yifan Zeng , Yuchao Jiang , Chelsi Jain , Huazheng Wang

Machine learning methods have significantly improved in their predictive capabilities, but at the same time they are becoming more complex and less transparent. As a result, explainers are often relied on to provide interpretability to…

Machine Learning · Computer Science 2024-04-17 Zulqarnain Khan , Davin Hill , Aria Masoomi , Joshua Bone , Jennifer Dy

In this paper, we study the adversarial robustness of subspace learning problems. Different from the assumptions made in existing work on robust subspace learning where data samples are contaminated by gross sparse outliers or small dense…

Signal Processing · Electrical Eng. & Systems 2020-04-22 Fuwei Li , Lifeng Lai , Shuguang Cui