中文
相关论文

相关论文: Invariant Representations with Stochastically Quan…

200 篇论文

In neural networks with binary activations and or binary weights the training by gradient descent is complicated as the model has piecewise constant response. We consider stochastic binary networks, obtained by adding noises in front of…

机器学习 · 统计学 2020-11-05 Alexander Shekhovtsov , Viktor Yanush , Boris Flach

Network graphs have become a popular tool to represent complex systems composed of many interacting subunits; especially in neuroscience, network graphs are increasingly used to represent and analyze functional interactions between neural…

信息论 · 计算机科学 2015-11-24 Patricia Wollstadt , Ulrich Meyer , Michael Wibral

Ensuring fairness in machine learning is a critical and challenging task, as biased data representations often lead to unfair predictions. To address this, we propose Deep Fair Learning, a framework that integrates nonlinear sufficient…

机器学习 · 统计学 2025-04-10 Enze Shi , Linglong Kong , Bei Jiang

Representation learning is the foundation for the recent success of neural network models. However, the distributed representations generated by neural networks are far from ideal. Due to their highly entangled nature, they are di cult to…

机器学习 · 计算机科学 2016-02-09 William Whitney

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

机器学习 · 计算机科学 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou

It has been observed that representations learned by distinct neural networks conceal structural similarities when the models are trained under similar inductive biases. From a geometric perspective, identifying the classes of…

机器学习 · 计算机科学 2024-03-21 Irene Cannistraci , Luca Moschella , Marco Fumero , Valentino Maiorca , Emanuele Rodolà

Implicit neural representations (INRs) have emerged as a powerful tool for compressing large-scale volume data. This opens up new possibilities for in situ visualization. However, the efficient application of INRs to distributed data…

分布式、并行与集群计算 · 计算机科学 2024-07-23 Qi Wu , Joseph A. Insley , Victor A. Mateevitsi , Silvio Rizzi , Michael E. Papka , Kwan-Liu Ma

Representations are fundamental to artificial intelligence. The performance of a learning system depends on the type of representation used for representing the data. Typically, these representations are hand-engineered using domain…

机器学习 · 计算机科学 2017-04-28 Vivek Veeriah , Shangtong Zhang , Richard S. Sutton

We apply recent advances in machine learning and computer vision to a central problem in materials informatics: The statistical representation of microstructural images. We use activations in a pre-trained convolutional neural network to…

计算物理 · 物理学 2018-12-04 Nicholas Lubbers , Turab Lookman , Kipton Barros

This paper presents a novel approach that leverages domain variability to learn representations that are conditionally invariant to unwanted variability or distractors. Our approach identifies both spurious and invariant latent features…

机器学习 · 计算机科学 2023-07-04 Hananeh Aliee , Ferdinand Kapl , Soroor Hediyeh-Zadeh , Fabian J. Theis

Biological imaging data are often partially confounded or contain unwanted variability. Examples of such phenomena include variable lighting across microscopy image captures, stain intensity variation in histological slides, and batch…

计算机视觉与模式识别 · 计算机科学 2018-11-28 Craig A. Glastonbury , Michael Ferlaino , Christoffer Nellåker , Cecilia M. Lindgren

This paper introduces a representative-based approach for distributed learning that transforms multiple raw data points into a virtual representation. Unlike traditional distributed learning methods such as Federated Learning, which do not…

机器学习 · 计算机科学 2025-02-12 Mengchen Fan , Baocheng Geng , Keren Li , Xueqian Wang , Pramod K. Varshney

We propose to learn invariant representations, in the data domain, to achieve interpretability in algorithmic fairness. Invariance implies a selectivity for high level, relevant correlations w.r.t. class label annotations, and a robustness…

机器学习 · 计算机科学 2020-08-13 Thomas Kehrenberg , Myles Bartlett , Oliver Thomas , Novi Quadrianto

Stochastic neurons and hard non-linearities can be useful for a number of reasons in deep learning models, but in many cases they pose a challenging problem: how to estimate the gradient of a loss function with respect to the input of such…

机器学习 · 计算机科学 2013-08-16 Yoshua Bengio , Nicholas Léonard , Aaron Courville

Algorithmic decision making process now affects many aspects of our lives. Standard tools for machine learning, such as classification and regression, are subject to the bias in data, and thus direct application of such off-the-shelf tools…

机器学习 · 统计学 2017-10-16 Junpei Komiyama , Hajime Shimao

A wide range of machine learning applications such as privacy-preserving learning, algorithmic fairness, and domain adaptation/generalization among others, involve learning invariant representations of the data that aim to achieve two…

机器学习 · 计算机科学 2022-11-24 Han Zhao , Chen Dan , Bryon Aragam , Tommi S. Jaakkola , Geoffrey J. Gordon , Pradeep Ravikumar

Neural networks are proven to be remarkably successful for classification and diagnosis in medical applications. However, the ambiguity in the decision-making process and the interpretability of the learned features is a matter of concern.…

计算机视觉与模式识别 · 计算机科学 2019-08-20 Ashkan Khakzar , Shadi Albarqouni , Nassir Navab

In this work, we perform unsupervised learning of representations by maximizing mutual information between an input and the output of a deep neural network encoder. Importantly, we show that structure matters: incorporating knowledge about…

This work proposes a novel privacy-preserving neural network feature representation to suppress the sensitive information of a learned space while maintaining the utility of the data. The new international regulation for personal data…

计算机视觉与模式识别 · 计算机科学 2020-08-10 Aythami Morales , Julian Fierrez , Ruben Vera-Rodriguez , Ruben Tolosana

Learning from demonstration is an effective method for human users to instruct desired robot behaviour. However, for most non-trivial tasks of practical interest, efficient learning from demonstration depends crucially on inductive bias in…

机器人学 · 计算机科学 2019-10-08 Yordan Hristov , Daniel Angelov , Michael Burke , Alex Lascarides , Subramanian Ramamoorthy