English
Related papers

Related papers: Computational and Statistical Tradeoffs in Learnin…

200 papers

Robust machine learning formulations have emerged to address the prevalent vulnerability of deep neural networks to adversarial examples. Our work draws the connection between optimal robust learning and the privacy-utility tradeoff…

Machine Learning · Computer Science 2021-05-20 Ye Wang , Shuchin Aeron , Adnan Siraj Rakin , Toshiaki Koike-Akino , Pierre Moulin

This paper explores how different ideas of racial equity in machine learning, in justice settings in particular, can present trade-offs that are difficult to solve computationally. Machine learning is often used in justice settings to…

Machine Learning · Statistics 2021-02-09 Jesse Russell

We study the problem of improving the performance of online algorithms by incorporating machine-learned predictions. The goal is to design algorithms that are both consistent and robust, meaning that the algorithm performs well when…

Machine Learning · Computer Science 2020-10-23 Alexander Wei , Fred Zhang

The success of a cross-sectional systematic strategy depends critically on accurately ranking assets prior to portfolio construction. Contemporary techniques perform this ranking step either with simple heuristics or by sorting outputs from…

Trading and Market Microstructure · Quantitative Finance 2020-12-15 Daniel Poh , Bryan Lim , Stefan Zohren , Stephen Roberts

Ranking data arises in a wide variety of application areas but remains difficult to model, learn from, and predict. Datasets often exhibit multimodality, intransitivity, or incomplete rankings---particularly when generated by humans---yet…

Machine Learning · Computer Science 2019-01-29 Stephen Ragain , Johan Ugander

After a somewhat rocky start, geometry and topology have established a foothold in machine learning. Message passing, either on graphs or higher-order complexes, is one of the main drivers of geometric deep learning, and paradigms that were…

Machine Learning · Computer Science 2026-05-11 Bastian Rieck

In recent years, representation learning has become the research focus of the machine learning community. Large-scale neural networks are a crucial step toward achieving general intelligence, with their success largely attributed to their…

Machine Learning · Computer Science 2025-04-22 Lifeng Gu

Despite breakthrough performance, modern learning models are known to be highly vulnerable to small adversarial perturbations in their inputs. While a wide variety of recent \emph{adversarial training} methods have been effective at…

Machine Learning · Computer Science 2020-02-26 Adel Javanmard , Mahdi Soltanolkotabi , Hamed Hassani

In learning-to-learn the goal is to infer a learning algorithm that works well on a class of tasks sampled from an unknown meta distribution. In contrast to previous work on batch learning-to-learn, we consider a scenario where tasks are…

Machine Learning · Statistics 2018-03-23 Giulia Denevi , Carlo Ciliberto , Dimitris Stamos , Massimiliano Pontil

The bias/variance tradeoff is fundamental to learning: increasing a model's complexity can improve its fit on training data, but potentially worsens performance on future samples. Remarkably, however, the human brain effortlessly handles a…

Neurons and Cognition · Quantitative Biology 2012-10-18 David Balduzzi

As the issue of robustness in AI systems becomes vital, statistical learning techniques that are reliable even in presence of partly contaminated data have to be developed. Preference data, in the form of (complete) rankings in the simplest…

Machine Learning · Computer Science 2023-03-24 Morgane Goibert , Clément Calauzènes , Ekhine Irurozki , Stéphan Clémençon

The recent explosion in the amount and dimensionality of data has exacerbated the need of trading off computational and statistical efficiency carefully, so that inference is both tractable and meaningful. We propose a framework that…

Computation · Statistics 2015-06-29 Daniel L. Sussman , Alexander Volfovsky , Edoardo M. Airoldi

An important challenge in robust machine learning is when training data is provided by strategic sources who may intentionally report erroneous data for their own benefit. A line of work at the intersection of machine learning and mechanism…

Computer Science and Game Theory · Computer Science 2024-12-24 Eric Balkanski , Cherlin Zhu

Machine learning algorithms enable advanced decision making in contemporary intelligent systems. Research indicates that there is a tradeoff between their model performance and explainability. Machine learning models with higher performance…

Machine Learning · Computer Science 2022-06-23 Lukas-Valentin Herm , Kai Heinrich , Jonas Wanner , Christian Janiesch

A central problem in business concerns the optimal allocation of limited resources to a set of available tasks, where the payoff of these tasks is inherently uncertain. In credit card fraud detection, for instance, a bank can only assign a…

Machine Learning · Computer Science 2022-02-10 Toon Vanderschueren , Bart Baesens , Tim Verdonck , Wouter Verbeke

A trade-off between accuracy and fairness is almost taken as a given in the existing literature on fairness in machine learning. Yet, it is not preordained that accuracy should decrease with increased fairness. Novel to this work, we…

Machine Learning · Statistics 2020-12-14 Sanghamitra Dutta , Dennis Wei , Hazar Yueksel , Pin-Yu Chen , Sijia Liu , Kush R. Varshney

The promise of least-privilege learning -- to find feature representations that are useful for a learning task but prevent inference of any sensitive information unrelated to this task -- is highly appealing. However, so far this concept…

Machine Learning · Computer Science 2024-06-27 Theresa Stadler , Bogdan Kulynych , Michael C. Gastpar , Nicolas Papernot , Carmela Troncoso

Given the abundance of applications of ranking in recent years, addressing fairness concerns around automated ranking systems becomes necessary for increasing the trust among end-users. Previous work on fair ranking has mostly focused on…

Machine Learning · Computer Science 2021-06-09 Nikola Konstantinov , Christoph H. Lampert

A central question in computer science and statistics is whether efficient algorithms can achieve the information-theoretic limits of statistical problems. Many computational-statistical tradeoffs have been shown under average-case…

Computational Complexity · Computer Science 2025-07-18 Guy Blanc , Caleb Koch , Carmen Strassle , Li-Yang Tan

We revisit the foundations of fairness and its interplay with utility and efficiency in settings where the training data contain richer labels, such as individual types, rankings, or risk estimates, rather than just binary outcomes. In this…

Machine Learning · Computer Science 2025-05-23 Noga Amit , Omer Reingold , Guy N. Rothblum