English
Related papers

Related papers: Diverse Dictionary Learning

200 papers

We argue that the selective inclusion of data points based on latent objectives is common in practical situations, such as music sequences. Since this selection process often distorts statistical analysis, previous work primarily views it…

Machine Learning · Computer Science 2024-07-02 Yujia Zheng , Zeyu Tang , Yiwen Qiu , Bernhard Schölkopf , Kun Zhang

Interpretable machine learning seeks to understand the reasoning process of complex black-box systems that are long notorious for lack of explainability. One flourishing approach is through counterfactual explanations, which provide…

Artificial Intelligence · Computer Science 2023-06-02 Vy Vo , Trung Le , Van Nguyen , He Zhao , Edwin Bonilla , Gholamreza Haffari , Dinh Phung

Model identifiability is a desirable property in the context of unsupervised representation learning. In absence thereof, different models may be observationally indistinguishable while yielding representations that are nontrivially related…

Machine Learning · Statistics 2022-02-15 Shubhangi Ghosh , Luigi Gresele , Julius von Kügelgen , Michel Besserve , Bernhard Schölkopf

Dictionary learning is a popular approach for inferring a hidden basis or dictionary in which data has a sparse representation. Data generated from the dictionary A (an n by m matrix, with m > n in the over-complete setting) is given by Y =…

Machine Learning · Computer Science 2018-05-09 Pranjal Awasthi , Aravindan Vijayaraghavan

The goal of Causal Discovery is to find automated search methods for learning causal structures from observational data. In some cases all variables of the interested causal mechanism are measured, and the task is to predict the effects one…

Machine Learning · Statistics 2024-01-11 Shuyan Wang

In this work we consider the task of relaxing the i.i.d assumption in pattern recognition (or classification), aiming to make existing learning algorithms applicable to a wider range of tasks. Pattern recognition is guessing a discrete…

Machine Learning · Computer Science 2012-02-28 Daniil Ryabko

The i.i.d. assumption is a useful idealization that underpins many successful approaches to supervised machine learning. However, its violation can lead to models that learn to exploit spurious correlations in the training data, rendering…

Machine Learning · Computer Science 2020-06-15 Daniel Pace , Alessandra Russo , Murray Shanahan

A key goal of unsupervised representation learning is "inverting" a data generating process to recover its latent properties. Existing work that provably achieves this goal relies on strong assumptions on relationships between the latent…

Machine Learning · Computer Science 2021-11-01 Kartik Ahuja , Jason Hartford , Yoshua Bengio

Most positive and unlabeled data is subject to selection biases. The labeled examples can, for example, be selected from the positive set because they are easier to obtain or more obviously positive. This paper investigates how learning can…

Machine Learning · Computer Science 2019-07-01 Jessa Bekker , Pieter Robberechts , Jesse Davis

In real-world scenarios, typical visual recognition systems could fail under two major causes, i.e., the misclassification between known classes and the excusable misbehavior on unknown-class images. To tackle these deficiencies, flexible…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Lei Fan , Bo Liu , Haoxiang Li , Ying Wu , Gang Hua

We are often interested in decomposing complex, structured data into simple components that explain the data. The linear version of this problem is well-studied as dictionary learning and factor analysis. In this work, we propose a…

Machine Learning · Computer Science 2024-07-29 Avrim Blum , Kavya Ravichandran

Authentication is the task of confirming the matching relationship between a data instance and a given identity. Typical examples of authentication problems include face recognition and person re-identification. Data-driven authentication…

Machine Learning · Statistics 2020-11-24 Jian Liang , Yuren Cao , Shuang Li , Bing Bai , Hao Li , Fei Wang , Kun Bai

In causal models, a given mechanism is assumed to be invariant to changes of other mechanisms. While this principle has been utilized for inference in settings where the causal variables are observed, theoretical insights when the variables…

Machine Learning · Statistics 2023-12-07 Simon Bing , Jonas Wahl , Urmi Ninad , Jakob Runge

This paper presents a novel approach that leverages domain variability to learn representations that are conditionally invariant to unwanted variability or distractors. Our approach identifies both spurious and invariant latent features…

Machine Learning · Computer Science 2023-07-04 Hananeh Aliee , Ferdinand Kapl , Soroor Hediyeh-Zadeh , Fabian J. Theis

Many datasets are underspecified: there exist multiple equally viable solutions to a given task. Underspecification can be problematic for methods that learn a single hypothesis because different functions that achieve low training loss can…

Machine Learning · Computer Science 2023-02-22 Yoonho Lee , Huaxiu Yao , Chelsea Finn

Conditional-independence-based discovery uses statistical tests to identify a graphical model that represents the independence structure of variables in a dataset. These tests, however, can be unreliable, and algorithms are sensitive to…

Machine Learning · Computer Science 2026-04-21 Philipp M. Faller , Dominik Janzing

To conduct causal inference in observational settings, researchers must rely on certain identifying assumptions. In practice, these assumptions are unlikely to hold exactly. This paper considers the bias of selection-on-observables,…

Methodology · Statistics 2026-03-26 Melody Huang , Cory McCartan

Learning causal structure from observational data is a fundamental challenge in machine learning. However, the majority of commonly used differentiable causal discovery methods are non-identifiable, turning this problem into a continuous…

Machine Learning · Computer Science 2022-09-30 Yu Wang , An Zhang , Xiang Wang , Yancheng Yuan , Xiangnan He , Tat-Seng Chua

Learning controllable and generalizable representation of multivariate data with desired structural properties remains a fundamental problem in machine learning. In this paper, we present a novel framework for learning generative models…

Machine Learning · Computer Science 2020-10-05 Ruixiang Zhang , Masanori Koyama , Katsuhiko Ishiguro

Negation and uncertainty modeling are long-standing tasks in natural language processing. Linguistic theory postulates that expressions of negation and uncertainty are semantically independent from each other and the content they modify.…

Computation and Language · Computer Science 2022-04-04 Jake Vasilakes , Chrysoula Zerva , Makoto Miwa , Sophia Ananiadou