English
Related papers

Related papers: Grounding Representation Similarity with Statistic…

200 papers

We consider a broad class of walk-based, parameterized node centrality measures for network analysis. These measures are expressed in terms of functions of the adjacency matrix and generalize various well-known centrality indices, including…

Numerical Analysis · Mathematics 2015-07-09 Michele Benzi , Christine Klymko

While deep neural networks have achieved remarkable performance, they tend to lack transparency in prediction. The pursuit of greater interpretability in neural networks often results in a degradation of their original performance. Some…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Hefeng Wu , Hao Jiang , Keze Wang , Ziyi Tang , Xianghuan He , Liang Lin

How do two deep neural networks differ in how they arrive at a decision? Measuring the similarity of deep networks has been a long-standing open question. Most existing methods provide a single number to measure the similarity of two…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Neehar Kondapaneni , Oisin Mac Aodha , Pietro Perona

This paper investigates fairness and bias in Canonical Correlation Analysis (CCA), a widely used statistical technique for examining the relationship between two sets of variables. We present a framework that alleviates unfairness by…

Machine Learning · Computer Science 2023-09-28 Zhuoping Zhou , Davoud Ataee Tarzanagh , Bojian Hou , Boning Tong , Jia Xu , Yanbo Feng , Qi Long , Li Shen

The accuracy of deep learning, i.e., deep neural networks, can be characterized by dividing the total error into three main types: approximation error, optimization error, and generalization error. Whereas there are some satisfactory…

Machine Learning · Statistics 2021-11-03 Pengzhan Jin , Lu Lu , Yifa Tang , George Em Karniadakis

Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of…

A longstanding problem for Deep Neural Networks (DNNs) is understanding their puzzling ability to generalize well. We approach this problem through the unconventional angle of \textit{cognitive abstraction mechanisms}, drawing inspiration…

Machine Learning · Computer Science 2020-04-20 Alex Gain , Hava Siegelmann

Class-agnostic counting (CAC) aims to count all instances in a query image given few exemplars. A standard pipeline is to extract visual features from exemplars and match them with query images to infer object counts. Two essential…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Min Shi , Hao Lu , Chen Feng , Chengxin Liu , Zhiguo Cao

Recent advances in deep reinforcement learning require a large amount of training data and generally result in representations that are often over specialized to the target task. In this work, we present a methodology to study the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-16 Erik Wijmans , Julian Straub , Dhruv Batra , Irfan Essa , Judy Hoffman , Ari Morcos

Canonical correlation analysis (CCA) is a technique for measuring the association between two multivariate data matrices. A regularized modification of canonical correlation analysis (RCCA) which imposes an $\ell_2$ penalty on the CCA…

Methodology · Statistics 2021-07-30 Elena Tuzhilina , Leonardo Tozzi , Trevor Hastie

For full-reference image quality assessment (FR-IQA) using deep-learning approaches, the perceptual similarity score between a distorted image and a reference image is typically computed as a distance measure between features extracted from…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Abhijay Ghildyal , Nabajeet Barman , Saman Zadtootaghaj

Benchmarking models is a key factor for the rapid progress in machine learning (ML) research. Thus, further progress depends on improving benchmarking metrics. A standard metric to measure the behavioral alignment between ML models and…

Neurons and Cognition · Quantitative Biology 2025-11-10 Thomas Klein , Sascha Meyen , Wieland Brendel , Felix A. Wichmann , Kristof Meding

In this study we adopt predictive modelling to identify simultaneously commonalities and differences in multi-modal brain networks acquired within subjects. Typically, predictive modelling of functional connectomes from structural…

Neurons and Cognition · Quantitative Biology 2019-11-06 Fani Deligianni , Jonathan D. Clayden , Guang-Zhong Yang

Compositional generalisation (CG), in NLP and in machine learning more generally, has been assessed mostly using artificial datasets. It is important to develop benchmarks to assess CG also in real-world natural language tasks in order to…

Computation and Language · Computer Science 2023-11-15 Anssi Moisio , Mathias Creutz , Mikko Kurimo

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

In practice it is often found that large over-parameterized neural networks generalize better than their smaller counterparts, an observation that appears to conflict with classical notions of function complexity, which typically favor…

Machine Learning · Statistics 2018-06-20 Roman Novak , Yasaman Bahri , Daniel A. Abolafia , Jeffrey Pennington , Jascha Sohl-Dickstein

Representation learning has driven major advances in natural image analysis by enabling models to acquire high-level semantic features. In microscopy imaging, however, it remains unclear what current representation learning methods actually…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ivan Svatko , Maxime Sanchez , Ihab Bendidi , Gilles Cottrell , Auguste Genovesio

In mental health research, it has proven difficult to find measures of brain function that provide reliable indicators of mental health and well-being, including susceptibility to mental health disorders. Recently, a family of data-driven…

Neurons and Cognition · Quantitative Biology 2022-01-27 Nikhil Goyal1 , Dustin Moraczewski , Peter A. Bandettini , Emily S. Finn , Adam G. Thomas

The increasing use of deep neural networks (DNNs) has motivated a parallel endeavor: the design of adversaries that profit from successful misclassifications. However, not all adversarial examples are crafted for malicious purposes. For…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Pk Douglas , Farzad Vasheghani Farahani

Representation learning, i.e. the generation of representations useful for downstream applications, is a task of fundamental importance that underlies much of the success of deep neural networks (DNNs). Recently, robustness to adversarial…

Machine Learning · Computer Science 2022-09-16 Christian Cianfarani , Arjun Nitin Bhagoji , Vikash Sehwag , Ben Y. Zhao , Prateek Mittal , Haitao Zheng