English
Related papers

Related papers: From Layers to Networks: Comparing Neural Represen…

200 papers

As a newly emerging advance in deep generative models, diffusion models have achieved state-of-the-art results in many fields, including computer vision, natural language processing, and molecule design. The remote sensing (RS) community…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yidan Liu , Jun Yue , Shaobo Xia , Pedram Ghamisi , Weiying Xie , Leyuan Fang

A data-driven framework is presented, that enables the prediction of quantities, either observations or parameters, given sufficient partial data. The framework is illustrated via a computational model of the deposition of Cu in a Chemical…

Image representations (artificial or biological) are often compared in terms of their global geometric structure; however, representations with similar global structure can have strikingly different local geometries. Here, we propose a…

Neurons and Cognition · Quantitative Biology 2025-05-19 Jenelle Feather , David Lipshutz , Sarah E. Harvey , Alex H. Williams , Eero P. Simoncelli

Strong generative models can accurately learn channel distributions. This could save recurring costs for physical measurements of the channel. Moreover, the resulting differentiable channel model supports training neural encoders by…

Information Theory · Computer Science 2024-06-12 Muah Kim , Rick Fritschek , Rafael F. Schaefer

While many unsupervised learning models focus on one family of tasks, either generative or discriminative, we explore the possibility of a unified representation learner: a model which uses a single pre-training stage to address both…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Soumik Mukhopadhyay , Matthew Gwilliam , Vatsal Agarwal , Namitha Padmanabhan , Archana Swaminathan , Srinidhi Hegde , Tianyi Zhou , Abhinav Shrivastava

While high-quality texture maps are essential for realistic 3D asset rendering, few studies have explored learning directly in the texture space, especially on large-scale datasets. In this work, we depart from the conventional approach of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Xin Yu , Ze Yuan , Yuan-Chen Guo , Ying-Tian Liu , JianHui Liu , Yangguang Li , Yan-Pei Cao , Ding Liang , Xiaojuan Qi

Learning from a large corpus of data, pre-trained models have achieved impressive progress nowadays. As popular generative pre-training, diffusion models capture both low-level visual knowledge and high-level semantic relations. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chaofan Ma , Yuhuan Yang , Chen Ju , Fei Zhang , Jinxiang Liu , Yu Wang , Ya Zhang , Yanfeng Wang

Diffusion models are central to generative modeling and have been adapted to graphs by diffusing adjacency matrix representations. The challenge of having up to $n!$ such representations for graphs with $n$ nodes is only partially mitigated…

Diffusion maps (DM) constitute a classic dimension reduction technique, for data lying on or close to a (relatively) low-dimensional manifold embedded in a much larger dimensional space. The DM procedure consists in constructing a spectral…

Machine Learning · Statistics 2022-03-08 Shan Shan , Ingrid Daubechies

We develop a general analytical and numerical framework for estimating intra- and extra-neurite water fractions and diffusion coefficients, as well as neurite orientational dispersion, in each imaging voxel. By employing a set of rotational…

Biological Physics · Physics 2018-04-10 Dmitry S. Novikov , Jelle Veraart , Ileana O. Jelescu , Els Fieremans

Diffusion magnetic resonance imaging (diffusion MRI) is a non-invasive microstructure assessment technique. Scalar measures, such as FA (fractional anisotropy) and MD (mean diffusivity), quantifying micro-structural tissue properties can be…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Xuan Gu , Hans Knutsson , Markus Nilsson , Anders Eklund

Understanding how the brain represents and processes information is crucial for advancing neuroscience and artificial intelligence. Representational similarity analysis (RSA) has been instrumental in characterizing neural representations,…

Neurons and Cognition · Quantitative Biology 2024-08-23 Baihan Lin

Diffusion models are generative models with impressive text-to-image synthesis capabilities and have spurred a new wave of creative methods for classical machine learning tasks. However, the best way to harness the perceptual knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Neehar Kondapaneni , Markus Marks , Manuel Knott , Rogerio Guimaraes , Pietro Perona

Diffusion models have revolutionized generative modeling, enabling unprecedented realism in image and video synthesis. This success has sparked interest in leveraging their representations for visual understanding tasks. While recent works…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Pedro Vélez , Luisa F. Polanía , Yi Yang , Chuhan Zhang , Rishabh Kabra , Anurag Arnab , Mehdi S. M. Sajjadi

We first study the generalization error of models that use a fixed feature representation (frozen intermediate layers) followed by a trainable readout layer. This setting encompasses a range of architectures, from deep random-feature models…

Statistics Theory · Mathematics 2025-11-10 Yessin Moakher , Malik Tiomoko , Cosme Louart , Zhenyu Liao

A network representation is useful for describing the structure of a large variety of complex systems. However, most real and engineered systems have multiple subsystems and layers of connectivity, and the data produced by such systems is…

Non-linear manifold learning enables high-dimensional data analysis, but requires out-of-sample-extension methods to process new data points. In this paper, we propose a manifold learning algorithm based on deep learning to create an…

Machine Learning · Statistics 2015-06-26 Gal Mishne , Uri Shaham , Alexander Cloninger , Israel Cohen

Diffusion has shown great success in improving accuracy of unsupervised image retrieval systems by utilizing high-order structures of image manifold. However, existing diffusion methods suffer from three major limitations: 1) they usually…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Zhiyong Dou , Haotian Cui , Lin Zhang , Bo Wang

Diffusion MRI tractography technique enables non-invasive visualization of the white matter pathways in the brain. It plays a crucial role in neuroscience and clinical fields by facilitating the study of brain connectivity and neurological…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Yiqiong Yang , Yitian Yuan , Baoxing Ren , Ye Wu , Yanqiu Feng , Xinyuan Zhang

Recent studies reveal the connection between GNNs and the diffusion process, which motivates many diffusion-based GNNs to be proposed. However, since these two mechanisms are closely related, one fundamental question naturally arises: Is…

Social and Information Networks · Computer Science 2024-04-23 Yibo Li , Xiao Wang , Hongrui Liu , Chuan Shi