English
Related papers

Related papers: Optimal Binary Autoencoding with Pairwise Correlat…

200 papers

In supervised binary hashing, one wants to learn a function that maps a high-dimensional feature vector to a vector of binary codes, for application to fast image retrieval. This typically results in a difficult optimization problem,…

Machine Learning · Computer Science 2016-02-08 Ramin Raziperchikolaei , Miguel Á. Carreira-Perpiñán

Convolutional neural networks have achieved astonishing results in different application areas. Various methods which allow us to use these models on mobile and embedded devices have been proposed. Especially binary neural networks seem to…

Machine Learning · Computer Science 2018-09-28 Joseph Bethge , Haojin Yang , Christian Bartz , Christoph Meinel

This paper proposes a generic formulation that significantly expedites the training and deployment of image classification models, particularly under the scenarios of many image categories and high feature dimensions. As a defining…

Computer Vision and Pattern Recognition · Computer Science 2016-03-15 Fumin Shen , Yadong Mu , Wei Liu , Yang Yang , Heng Tao Shen

Slow and costly communication is often the main bottleneck in distributed optimization, especially in federated learning where it occurs over wireless networks. We introduce BiCoLoR, a communication-efficient optimization algorithm that…

Optimization and Control · Mathematics 2026-01-21 Laurent Condat , Artavazd Maranjyan , Peter Richtárik

Autonomous driving has a natural bi-level structure. The goal of the upper behavioural layer is to provide appropriate lane change, speeding up, and braking decisions to optimize a given driving task. However, this layer can only indirectly…

Robotics · Computer Science 2022-12-06 Arun Kumar Singh , Jatan Shrestha , Nicola Albarella

Recovering the digital input of a time-discrete linear system from its (noisy) output is a significant challenge in the fields of data transmission, deconvolution, channel equalization, and inverse modeling. A variety of algorithms have…

Optimization and Control · Mathematics 2020-12-03 Sophie M. Fosson

Compressed sensing techniques enable efficient acquisition and recovery of sparse, high-dimensional data signals via low-dimensional projections. In this work, we propose Uncertainty Autoencoders, a learning framework for unsupervised…

Machine Learning · Statistics 2019-04-15 Aditya Grover , Stefano Ermon

Deep hashing has shown to be a complexity-efficient solution for the Approximate Nearest Neighbor search problem in high dimensional space. Many methods usually build the loss function from pairwise or triplet data points to capture the…

Machine Learning · Computer Science 2023-06-21 Yuan Chen , Stéphane Marchand-Maillet

We present an approach to learning multi-sense word embeddings relying both on monolingual and bilingual information. Our model consists of an encoder, which uses monolingual and bilingual context (i.e. a parallel sentence) to choose a…

Computation and Language · Computer Science 2016-03-31 Simon Šuster , Ivan Titov , Gertjan van Noord

We study a class of convex-concave min-max problems in which the coupled component of the objective is linear in at least one of the two decision vectors. We identify such problem structure as interpolating between the bilinearly and…

Optimization and Control · Mathematics 2025-07-10 Ronak Mehta , Jelena Diakonikolas , Zaid Harchaoui

Autoencoders learn data representations through reconstruction. Robust training is the key factor affecting the quality of the learned representations and, consequently, the accuracy of the application that use them. Previous works…

Neural and Evolutionary Computing · Computer Science 2018-07-11 Maisa Doaud , Michael Mayo

The problem of maximum likelihood decoding with a neural decoder for error-correcting code is considered. It is shown that the neural decoder can be improved with two novel loss terms on the node's activations. The first loss term imposes a…

Information Theory · Computer Science 2022-08-12 Eliya Nachmani , Yair Be'ery

Binary neural networks have attracted tremendous attention due to the efficiency for deploying them on mobile devices. Since the weak expression ability of binary weights and features, their accuracy is usually much lower than that of…

Machine Learning · Computer Science 2019-09-18 Mingzhu Shen , Kai Han , Chunjing Xu , Yunhe Wang

Neural associative memories are single layer perceptrons with fast synaptic learning typically storing discrete associations between pairs of neural activity patterns. Previous works have analyzed the optimal networks under naive Bayes…

Neural and Evolutionary Computing · Computer Science 2024-12-25 Andreas Knoblauch

A efficient incremental learning algorithm for classification tasks, called NetLines, well adapted for both binary and real-valued input patterns is presented. It generates small compact feedforward neural networks with one hidden layer of…

Artificial Intelligence · Computer Science 2009-04-30 Juan-Manuel Torres-Moreno , Mirta B. Gordon

Image translation with convolutional autoencoders has recently been used as an approach to multimodal change detection in bitemporal satellite images. A main challenge is the alignment of the code spaces by reducing the contribution of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 Luigi T. Luppino , Mads A. Hansen , Michael Kampffmeyer , Filippo M. Bianchi , Gabriele Moser , Robert Jenssen , Stian N. Anfinsen

We propose a principled method for autoencoding with random forests. Our strategy builds on foundational results from nonparametric statistics and spectral graph theory to learn a low-dimensional embedding of the model that optimally…

Machine Learning · Statistics 2026-01-16 Binh Duc Vu , Jan Kapar , Marvin Wright , David S. Watson

Combinatorial optimization problems are typically tackled by the branch-and-bound paradigm. We propose a new graph convolutional neural network model for learning branch-and-bound variable selection policies, which leverages the natural…

Machine Learning · Computer Science 2019-10-31 Maxime Gasse , Didier Chételat , Nicola Ferroni , Laurent Charlin , Andrea Lodi

We focus on a particular form of network coding, reverse carpooling, in a wireless network where the potentially coded transmitted messages are to be decoded immediately upon reception. The network is fixed and known, and the system…

Networking and Internet Architecture · Computer Science 2010-01-20 Ali ParandehGheibi , Asuman Ozdaglar , Michelle Effros , Muriel Medard

Designing codes that combat the noise in a communication medium has remained a significant area of research in information theory as well as wireless communications. Asymptotically optimal channel codes have been developed by mathematicians…

Information Theory · Computer Science 2019-11-11 Yihan Jiang , Hyeji Kim , Himanshu Asnani , Sreeram Kannan , Sewoong Oh , Pramod Viswanath