English
Related papers

Related papers: On Characterizing the Trade-off in Invariant Repre…

200 papers

We empirically investigate the best trade-off between sparse and uniformly-weighted multiple kernel learning (MKL) using the elastic-net regularization on real and simulated datasets. We find that the best trade-off parameter depends not…

Machine Learning · Statistics 2010-01-18 Ryota Tomioka , Taiji Suzuki

The field of learning-augmented algorithms has gained significant attention in recent years. These algorithms, using potentially inaccurate predictions, must exhibit three key properties: consistency, robustness, and smoothness. In…

Data Structures and Algorithms · Computer Science 2025-01-23 Ziyad Benomar , Vianney Perchet

The importance of hierarchically structured representations for tractable planning has long been acknowledged. However, the questions of how people discover such abstractions and how to define a set of optimal abstractions remain open. This…

Artificial Intelligence · Computer Science 2018-07-20 Sophia Sanborn , David D. Bourgin , Michael Chang , Thomas L. Griffiths

We consider a fair representation learning perspective, where optimal predictors, on top of the data representation, are ensured to be invariant with respect to different sub-groups. Specifically, we formulate this intuition as a bi-level…

Machine Learning · Computer Science 2022-05-27 Changjian Shui , Qi Chen , Jiaqi Li , Boyu Wang , Christian Gagné

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

Machine Learning · Computer Science 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

Several recent studies in privacy-preserving learning have considered the trade-off between utility or risk and the level of differential privacy guaranteed by mechanisms for statistical query processing. In this paper we study this…

Machine Learning · Computer Science 2009-12-01 Benjamin I. P. Rubinstein , Peter L. Bartlett , Ling Huang , Nina Taft

Strategic information is valuable either by remaining private (for instance if it is sensitive) or, on the other hand, by being used publicly to increase some utility. These two objectives are antagonistic and leaking this information might…

Machine Learning · Statistics 2020-03-03 Etienne Boursier , Vianney Perchet

Representations of data that are invariant to changes in specified factors are useful for a wide range of problems: removing potential biases in prediction problems, controlling the effects of covariates, and disentangling meaningful…

Machine Learning · Computer Science 2019-12-03 Daniel Moyer , Shuyang Gao , Rob Brekelmans , Greg Ver Steeg , Aram Galstyan

Due to the recent popularity of online social networks, coupled with people's propensity to disclose personal information in an effort to achieve certain gratifications, the problem of navigating the tradeoff between privacy and utility…

Information Theory · Computer Science 2020-03-12 Chandra Sharma , George Amariucai

Differential privacy is a mathematical framework for privacy-preserving data analysis. Changing the hyperparameters of a differentially private algorithm allows one to trade off privacy and utility in a principled way. Quantifying this…

Machine Learning · Statistics 2020-07-23 Brendan Avent , Javier Gonzalez , Tom Diethe , Andrei Paleyes , Borja Balle

Real-world applications of machine learning tools in high-stakes domains are often regulated to be fair, in the sense that the predicted target should satisfy some quantitative notion of parity with respect to a protected attribute.…

Machine Learning · Computer Science 2022-02-07 Han Zhao , Geoffrey J. Gordon

We revisit the foundations of fairness and its interplay with utility and efficiency in settings where the training data contain richer labels, such as individual types, rankings, or risk estimates, rather than just binary outcomes. In this…

Machine Learning · Computer Science 2025-05-23 Noga Amit , Omer Reingold , Guy N. Rothblum

We develop a mathematical framework to address a broad class of metric and preference learning problems within a Hilbert space. We obtain a novel representer theorem for the simultaneous task of metric and preference learning. Our key…

Machine Learning · Computer Science 2025-10-28 Peyman Morteza

It has been a long-standing goal in machine learning, as well as in AI more generally, to develop life-long learning systems that learn many different tasks over time, and reuse insights from tasks learned, "learning to learn" as they do…

Machine Learning · Computer Science 2014-12-08 Maria-Florina Balcan , Avrim Blum , Santosh Vempala

Designing models that are both expressive and preserve known invariances of tasks is an increasingly hard problem. Existing solutions tradeoff invariance for computational or memory resources. In this work, we show how to leverage…

Machine Learning · Computer Science 2023-09-29 Leonardo Cotta , Gal Yehuda , Assaf Schuster , Chris J. Maddison

Machine learning is increasingly used in the most diverse applications and domains, whether in healthcare, to predict pathologies, or in the financial sector to detect fraud. One of the linchpins for efficiency and accuracy in machine…

Machine Learning · Computer Science 2022-01-17 Tânia Carvalho , Nuno Moniz , Pedro Faria , Luís Antunes

Several domains increasingly rely on machine learning in their applications. The resulting heavy dependence on data has led to the emergence of various laws and regulations around data ethics and privacy and growing awareness of the need…

Machine Learning · Computer Science 2023-09-11 Sofiane Ouaari , Ali Burak Ünal , Mete Akgün , Nico Pfeifer

A fundamental result in mechanism design theory, the so-called revelation principle, asserts that for many questions concerning the existence of mechanisms with a given outcome one can restrict attention to truthful direct…

Computer Science and Game Theory · Computer Science 2011-02-18 Paul Dütting , Felix Fischer , David C. Parkes

Recently, several authors have advocated the use of rule learning algorithms to model multi-label data, as rules are interpretable and can be comprehended, analyzed, or qualitatively evaluated by domain experts. Many rule learning…

Machine Learning · Computer Science 2020-12-09 Michael Rapp , Eneldo Loza Mencía , Johannes Fürnkranz

Markov decision processes (MDPs) are a well studied framework for solving sequential decision making problems under uncertainty. Exact methods for solving MDPs based on dynamic programming such as policy iteration and value iteration are…

Artificial Intelligence · Computer Science 2015-09-09 Yanping Huang