English
Related papers

Related papers: Self-Organising Neural Discrete Representation Lea…

200 papers

We present a Split Vector Quantized Variational Autoencoder (SVQ-VAE) architecture using a split vector quantizer for NTTS, as an enhancement to the well-known Variational Autoencoder (VAE) and Vector Quantized Variational Autoencoder…

Sound · Computer Science 2023-09-15 Marek Strong , Jonas Rohnke , Antonio Bonafonte , Mateusz Łajszczak , Trevor Wood

Motion planning with constraints is an important part of many real-world robotic systems. In this work, we study manifold learning methods to learn such constraints from data. We explore two methods for learning implicit constraint…

We present Self-Organizing Visual Prototypes (SOP), a new training technique for unsupervised visual feature learning. Unlike existing prototypical self-supervised learning (SSL) methods that rely on a single prototype to encode all…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Thalles Silva , Helio Pedrini , Adín Ramírez Rivera

Variational autoencoders (VAEs) are fundamental for generative modeling and image reconstruction, yet their performance often struggles to maintain high fidelity in reconstructions. This study introduces a hybrid model, quantum variational…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Farina Riaz , Fakhar Zaman , Hajime Suzuki , Sharif Abuadbba , David Nguyen

Learning the latent representation of data in unsupervised fashion is a very interesting process that provides relevant features for enhancing the performance of a classifier. For speech emotion recognition tasks, generating effective…

Sound · Computer Science 2020-07-29 Siddique Latif , Rajib Rana , Junaid Qadir , Julien Epps

Quantum machine learning is a fast-emerging field that aims to tackle machine learning using quantum algorithms and quantum computing. Due to the lack of physical qubits and an effective means to map real-world data from Euclidean space to…

Quantum Physics · Physics 2024-01-22 Xing Ai , Zhihong Zhang , Luzhe Sun , Junchi Yan , Edwin Hancock

Unsupervised and self-supervised representation learning has become popular in recent years for learning useful features from unlabelled data. Representation learning has been mostly developed in the neural network literature, and other…

Machine Learning · Computer Science 2023-09-06 Pascal Esser , Maximilian Fleissner , Debarghya Ghoshdastidar

While most frontier models still use deterministic frequency-based tokenization algorithms such as byte-pair encoding (BPE), there has been significant recent work to design learned neural tokenizers. However, these schemes generally add to…

Machine Learning · Computer Science 2025-12-29 Theo Datta , Kayla Huang , Sham Kakade , David Brandfonbrener

Variational Autoencoders (VAEs) have been shown to be remarkably effective in recovering model latent spaces for several computer vision tasks. However, currently trained VAEs, for a number of reasons, seem to fall short in learning…

Machine Learning · Computer Science 2021-07-27 Chandrajit Bajaj , Avik Roy , Haoran Zhang

In the last few years, quantum computing and machine learning fostered rapid developments in their respective areas of application, introducing new perspectives on how information processing systems can be realized and programmed. The…

Traditional transformer-based semantic segmentation relies on quantized embeddings. However, our analysis reveals that autoencoder accuracy on segmentation mask using quantized embeddings (e.g. VQ-VAE) is 8% lower than continuous-valued…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Masud Ahmed , Zahid Hasan , Syed Arefinul Haque , Abu Zaher Md Faridee , Sanjay Purushotham , Suya You , Nirmalya Roy

Reduced-order models (ROMs) are very popular for surrogate modeling of full-order computational fluid dynamics (CFD) simulations, allowing for real-time approximation of complex flow phenomena. However, their application to CFD models…

Fluid Dynamics · Physics 2025-11-25 Rakesh Halder , Benet Eiximeno , Oriol Lehmkuhl

Many data analysis methods cannot be applied to data that are not represented by a fixed number of real values, whereas most of real world observations are not readily available in such a format. Vector based data analysis methods have…

Neural and Evolutionary Computing · Computer Science 2007-09-25 Aïcha El Golli , Fabrice Rossi , Brieuc Conan-Guez , Yves Lechevallier

In this study, a novel self-supervised learning (SSL) method is proposed, which considers SSL in terms of variational inference to learn not only representation but also representation uncertainties. SSL is a method of learning…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Hiroki Nakamura , Masashi Okada , Tadahiro Taniguchi

Inverse problems aim to determine model parameters of a mathematical problem from given observational data. Neural networks can provide an efficient tool to solve these problems. In the context of Bayesian inverse problems, Uncertainty…

Numerical Analysis · Mathematics 2025-09-16 Andrea Tonini , Tan Bui-Thanh , Francesco Regazzoni , Luca Dede' , Alfio Quarteroni

We present a new optimization method for small-to-intermediate scale variational algorithms on noisy near-term quantum processors which uses a Gaussian process surrogate model equipped with a classically-evaluated quantum kernel.…

Quantum Physics · Physics 2023-08-16 Alistair W. R. Smith , A. J. Paige , M. S. Kim

A longstanding computational challenge is the accurate simulation of many-body particle systems. Especially for deriving key characteristics of high-impact but complex systems such as battery materials and high entropy alloys (HEA). While…

Quantum Physics · Physics 2025-11-20 Koen Mesman , Yinglu Tang , Matthias Moller , Boyang Chen , Sebastian Feld

Knowledge graph embedding models (KGEMs) have gained considerable traction in recent years. These models learn a vector representation of knowledge graph entities and relations, a.k.a. knowledge graph embeddings (KGEs). Learning versatile…

Artificial Intelligence · Computer Science 2023-10-20 Nicolas Hubert , Heiko Paulheim , Pierre Monnin , Armelle Brun , Davy Monticolo

Kohonen Maps, aka. Self-organizing maps (SOMs) are neural networks that visualize a high-dimensional feature space on a low-dimensional map. While SOMs are an excellent tool for data examination and exploration, they inherently cause a loss…

Human-Computer Interaction · Computer Science 2024-10-16 Simon Linke , Tim Ziemer

Neuron segmentation from electron microscopy (EM) volumes is crucial for understanding brain circuits, yet the complex neuronal structures in high-resolution EM images present significant challenges. EM data exhibits unique characteristics…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yinda Chen , Haoyuan Shi , Xiaoyu Liu , Te Shi , Ruobing Zhang , Dong Liu , Zhiwei Xiong , Feng Wu