English
Related papers

Related papers: Fundamental Limits and Tradeoffs in Invariant Repr…

200 papers

Learning discriminative powerful representations is a crucial step for machine learning systems. Introducing invariance against arbitrary nuisance or sensitive attributes while performing well on specific tasks is an important problem in…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Mhd Hasan Sarhan , Nassir Navab , Abouzar Eslami , Shadi Albarqouni

In financial applications, regulations or best practices often lead to specific requirements in machine learning relating to four key pillars: fairness, privacy, interpretability and greenhouse gas emissions. These all sit in the broader…

Machine Learning · Computer Science 2024-07-18 Roberto Pagliari , Peter Hill , Po-Yu Chen , Maciej Dabrowny , Tingsheng Tan , Francois Buet-Golfouse

A key goal of unsupervised representation learning is "inverting" a data generating process to recover its latent properties. Existing work that provably achieves this goal relies on strong assumptions on relationships between the latent…

Machine Learning · Computer Science 2021-11-01 Kartik Ahuja , Jason Hartford , Yoshua Bengio

An important challenge in multi-objective reinforcement learning is obtaining a Pareto front of policies to attain optimal performance under different preferences. We introduce Iterated Pareto Referent Optimisation (IPRO), which decomposes…

Machine Learning · Computer Science 2025-02-07 Willem Röpke , Mathieu Reymond , Patrick Mannion , Diederik M. Roijers , Ann Nowé , Roxana Rădulescu

For the problem of 3D object recognition, researchers using deep learning methods have developed several very different input representations, including "multi-view" snapshots taken from discrete viewpoints around an object, as well as…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Tengyu Ma , Joel Michelson , James Ainooson , Deepayan Sanyal , Xiaohan Wang , Maithilee Kunda

Current approaches to group fairness in federated learning assume the existence of predefined and labeled sensitive groups during training. However, due to factors ranging from emerging regulations to dynamics and location-dependency of…

Machine Learning · Computer Science 2024-02-26 Afroditi Papadaki , Natalia Martinez , Martin Bertran , Guillermo Sapiro , Miguel Rodrigues

A major challenge in designing efficient statistical supervised learning algorithms is finding representations that perform well not only on available training samples but also on unseen data. While the study of representation learning has…

Machine Learning · Statistics 2024-02-06 Milad Sefidgaran , Abdellatif Zaidi , Piotr Krasnowski

This paper explores how different ideas of racial equity in machine learning, in justice settings in particular, can present trade-offs that are difficult to solve computationally. Machine learning is often used in justice settings to…

Machine Learning · Statistics 2021-02-09 Jesse Russell

We propose a novel algorithm for learning fair representations that can simultaneously mitigate two notions of disparity among different demographic subgroups in the classification setting. Two key components underpinning the design of our…

Machine Learning · Computer Science 2020-02-18 Han Zhao , Amanda Coston , Tameem Adel , Geoffrey J. Gordon

Due to the ability of deep neural nets to learn rich representations, recent advances in unsupervised domain adaptation have focused on learning domain-invariant features that achieve a small error on the source domain. The hope is that the…

Machine Learning · Computer Science 2019-05-31 Han Zhao , Remi Tachet des Combes , Kun Zhang , Geoffrey J. Gordon

Fair classification and fair representation learning are two important problems in supervised and unsupervised fair machine learning, respectively. Fair classification asks for a classifier that maximizes accuracy on a given data…

Machine Learning · Computer Science 2024-10-08 Sushant Agarwal , Amit Deshpande

This paper presents a unique approach for the dichotomy between useful and adverse variations of key-point descriptors, namely the identity and the expression variations in the descriptor (feature) space. The descriptors variations are…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Faisal R. Al-Osaimi

We consider the problem of learning to choose from a given set of objects, where each object is represented by a feature vector. Traditional approaches in choice modelling are mainly based on learning a latent, real-valued utility function,…

Machine Learning · Computer Science 2020-07-15 Karlson Pfannschmidt , Eyke Hüllermeier

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

Machine learning algorithms enable advanced decision making in contemporary intelligent systems. Research indicates that there is a tradeoff between their model performance and explainability. Machine learning models with higher performance…

Machine Learning · Computer Science 2022-06-23 Lukas-Valentin Herm , Kai Heinrich , Jonas Wanner , Christian Janiesch

Empirical process theory for i.i.d. observations has emerged as a ubiquitous tool for understanding the generalization properties of various statistical problems. However, in many applications where the data exhibit temporal dependencies…

Statistics Theory · Mathematics 2024-01-18 Nabarun Deb , Debarghya Mukherjee

Optimizing NLP models for fairness poses many challenges. Lack of differentiable fairness measures prevents gradient-based loss training or requires surrogate losses that diverge from the true metric of interest. In addition, competing…

Computation and Language · Computer Science 2025-06-19 Soumyajit Gupta , Venelin Kovatchev , Anubrata Das , Maria De-Arteaga , Matthew Lease

Balancing safety, efficiency, and operational costs in highway driving poses a challenging decision-making problem for heavy-duty vehicles. A central difficulty is that conventional scalar reward formulations, obtained by aggregating these…

Machine Learning · Computer Science 2026-01-27 Deepthi Pathare , Leo Laine , Morteza Haghir Chehreghani

Prior studies have unveiled the vulnerability of the deep neural networks in the context of adversarial machine learning, leading to great recent attention into this area. One interesting question that has yet to be fully explored is the…

Machine Learning · Computer Science 2020-08-04 Hossein Aboutalebi , Mohammad Javad Shafiee , Michelle Karg , Christian Scharfenberger , Alexander Wong

Learning algorithms need bias to generalize and perform better than random guessing. We examine the flexibility (expressivity) of biased algorithms. An expressive algorithm can adapt to changing training data, altering its outcome based on…

Machine Learning · Statistics 2019-11-13 Julius Lauw , Dominique Macias , Akshay Trikha , Julia Vendemiatti , George D. Montanez