English
Related papers

Related papers: A Novel Information-Theoretic Objective to Disenta…

200 papers

Although disentangled representations are often said to be beneficial for downstream tasks, current empirical and theoretical understanding is limited. In this work, we provide evidence that disentangled representations coupled with sparse…

In this study, Disentanglement in Difference(DiD) is proposed to address the inherent inconsistency between the statistical independence of latent variables and the goal of semantic disentanglement in disentanglement representation…

Machine Learning · Computer Science 2025-04-04 Xingshen Zhang , Lin Wang , Shuangrong Liu , Xintao Lu , Chaoran Pang , Bo Yang

This paper investigates the deep learning optimization problem with softmax cross-entropy loss. We propose a layer separation strategy to alleviate the strong nonconvexity encountered during training deep networks. For cross-entropy models…

Machine Learning · Computer Science 2026-04-28 Yaru Liu , Michael K. Ng , Yiqi Gu

Face anti-spoofing is crucial to security of face recognition systems. Previous approaches focus on developing discriminative models based on the features extracted from images, which may be still entangled between spoof patterns and real…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Ke-Yue Zhang , Taiping Yao , Jian Zhang , Ying Tai , Shouhong Ding , Jilin Li , Feiyue Huang , Haichuan Song , Lizhuang Ma

Achieving visual reasoning is a long-term goal of artificial intelligence. In the last decade, several studies have applied deep neural networks (DNNs) to the task of learning visual relations from images, with modest results in terms of…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Guillermo Puebla , Jeffrey S. Bowers

During the training process, deep neural networks implicitly learn to represent the input data samples through a hierarchy of features, where the size of the hierarchy is determined by the number of layers. In this paper, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Florinel-Alin Croitoru , Diana-Nicoleta Grigore , Radu Tudor Ionescu

Trained classification models can unintentionally lead to biased representations and predictions, which can reinforce societal preconceptions and stereotypes. Existing debiasing methods for classification models, such as adversarial…

Computation and Language · Computer Science 2021-09-23 Aili Shen , Xudong Han , Trevor Cohn , Timothy Baldwin , Lea Frermann

Previous literature suggests that perceptual similarity is an emergent property shared across deep visual representations. Experiments conducted on a dataset of human-judged image distortions have proven that deep features outperform…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Simone Bianco , Luigi Celona , Paolo Napoletano

This paper presents a novel theoretical framework for understanding how diffusion models can learn disentangled representations. Within this framework, we establish identifiability conditions for general disentangled latent variable models,…

Learning representations of images that are invariant to sensitive or unwanted attributes is important for many tasks including bias removal and cross domain retrieval. Here, our objective is to learn representations that are invariant to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Jonathan Kahana , Yedid Hoshen

Although deep learning has demonstrated astonishing performance in many applications, there are still concerns about its dependability. One desirable property of deep learning applications with societal impact is fairness (i.e.,…

Machine Learning · Computer Science 2021-07-30 Peixin Zhang , Jingyi Wang , Jun Sun , Xinyu Wang , Guoliang Dong , Xingen Wang , Ting Dai , Jin Song Dong

Fine-grained remote sensing datasets often use hierarchical label structures to differentiate objects in a coarse-to-fine manner, with each object annotated across multiple levels. However, embedding this semantic hierarchy into the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Jingzhou Chen , Dexin Chen , Fengchao Xiong , Yuntao Qian , Liang Xiao

This work proposes a novel privacy-preserving neural network feature representation to suppress the sensitive information of a learned space while maintaining the utility of the data. The new international regulation for personal data…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Aythami Morales , Julian Fierrez , Ruben Vera-Rodriguez , Ruben Tolosana

As machine learning has been deployed ubiquitously across applications in modern data science, algorithmic fairness has become a great concern. Among them, imposing fairness constraints during learning, i.e. in-processing fair training, has…

Machine Learning · Computer Science 2023-07-18 Yuzhen Mao , Zhun Deng , Huaxiu Yao , Ting Ye , Kenji Kawaguchi , James Zou

Numerous approaches have been recently proposed for learning fair representations that mitigate unfair outcomes in prediction tasks. A key motivation for these methods is that the representations can be used by third parties with unknown…

Machine Learning · Computer Science 2024-06-25 Tianhao Wang , Zana Buçinca , Zilin Ma

In this study, the problem of computing a sparse representation of multi-dimensional visual data is considered. In general, such data e.g., hyperspectral images, color images or video data consists of signals that exhibit strong local…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Alexandros Gkillas , Dimitris Ampeliotis , Kostas Berberidis

We propose a transfer learning-based solution for the problem of multiple class novelty detection. In particular, we propose an end-to-end deep-learning based approach in which we investigate how the knowledge contained in an external,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Pramuditha Perera , Vishal M. Patel

One of the main arguments behind studying disentangled representations is the assumption that they can be easily reused in different tasks. At the same time finding a joint, adaptable representation of data is one of the key challenges in…

Machine Learning · Computer Science 2021-10-08 Łukasz Maziarka , Aleksandra Nowak , Maciej Wołczyk , Andrzej Bedychaj

Parametric system identification methods estimate the parameters of explicitly defined physical systems from data. Yet, they remain constrained by the need to provide an explicit function space, typically through a predefined library of…

Machine Learning · Computer Science 2026-03-17 Markus W. Baumgartner , Anson Lei , Joe Watson , Ingmar Posner

Multi-view representation learning aims to derive robust representations that are both view-consistent and view-specific from diverse data sources. This paper presents an in-depth analysis of existing approaches in this domain, highlighting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Guanzhou Ke , Bo Wang , Xiaoli Wang , Shengfeng He