English
Related papers

Related papers: Locality-Promoting Representation Learning

200 papers

Convolutional Neural Networks (CNN) have been pivotal to the success of many state-of-the-art classification problems, in a wide variety of domains (for e.g. vision, speech, graphs and medical imaging). A commonality within those domains is…

Machine Learning · Computer Science 2019-12-02 Rohan Ghosh , Anupam K. Gupta , Mehul Motani

After the incredible success of deep learning in the computer vision domain, there has been much interest in applying Convolutional Network (ConvNet) features in robotic fields such as visual navigation and SLAM. Unfortunately, there are…

Robotics · Computer Science 2015-07-30 Niko Sünderhauf , Feras Dayoub , Sareh Shirazi , Ben Upcroft , Michael Milford

Locating a target is key in many applications, namely in high-stakes real-world scenarios, like detecting humans or obstacles in vehicular networks. In scenarios where precise statistics of the measurement noise are unavailable,…

Optimization and Control · Mathematics 2022-08-17 João Domingos , Cláudia Soares , João Xavier

Convolutional networks are ubiquitous in deep learning. They are particularly useful for images, as they reduce the number of parameters, reduce training time, and increase accuracy. However, as a model of the brain they are seriously…

Machine Learning · Computer Science 2022-01-19 Roman Pogodin , Yash Mehta , Timothy P. Lillicrap , Peter E. Latham

Large-scale visual place recognition (VPR) is inherently challenging because not all visual cues in the image are beneficial to the task. In order to highlight the task-relevant visual cues in the feature embedding, the existing attention…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Guohao Peng , Yufeng Yue , Jun Zhang , Zhenyu Wu , Xiaoyu Tang , Danwei Wang

We study an interesting problem in training neural network-based models for natural language generation tasks, which we call the \emph{representation degeneration problem}. We observe that when training a model for natural language…

Computation and Language · Computer Science 2019-07-30 Jun Gao , Di He , Xu Tan , Tao Qin , Liwei Wang , Tie-Yan Liu

This paper addresses the problem of localization, which is inherently non-convex and non-smooth in a federated setting where the data is distributed across a multitude of devices. Due to the decentralized nature of federated environments,…

Machine Learning · Computer Science 2023-09-04 Reza Mirzaeifard , Naveen K. D. Venkategowda , Stefan Werner

The convolutional neural network (CNN) learns the same object in different positions in images, which can improve the recognition accuracy of the model. An implication of this is that CNN may know where the object is. The usefulness of the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Nan Yang , Laicheng Zhong , Fan Huang , Dong Yuan , Wei Bao

Neural networks trained on standard image classification data sets are shown to be less resistant to data set bias. It is necessary to comprehend the behavior objective function that might correspond to superior performance for data with…

Machine Learning · Computer Science 2022-11-16 Gnyanesh Bangaru , Lalith Bharadwaj Baru , Kiran Chakravarthula

We consider an implementation of convolutional architecture in a spiking neural network (SNN) used to classify images. As in the traditional neural network, the convolutional layers form informational "features" used as predictors in the…

Neural and Evolutionary Computing · Computer Science 2025-05-14 Mikhail Kiselev , Andrey Lavrentyev

Graph neural networks (GNNs) emerge as a powerful family of representation learning models on graphs. To derive node representations, they utilize a global model that recursively aggregates information from the neighboring nodes. However,…

Machine Learning · Computer Science 2021-11-04 Zemin Liu , Yuan Fang , Chenghao Liu , Steven C. H. Hoi

This paper presents a study on the use of Convolutional Neural Networks for camera relocalisation and its application to map compression. We follow state of the art visual relocalisation results and evaluate the response to different data…

Computer Vision and Pattern Recognition · Computer Science 2018-05-17 Luis Contreras , Walterio Mayol-Cuevas

Recent studies revealed that convolutional neural networks do not generalize well to small image transformations, e.g. rotations by a few degrees or translations of a few pixels. To improve the robustness to such transformations, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Adrian Sandru , Mariana-Iuliana Georgescu , Radu Tudor Ionescu

Convolutional neural networks (CNNs) have achieved remarkable performance in various fields, particularly in the domain of computer vision. However, why this architecture works well remains to be a mystery. In this work we move a small step…

Machine Learning · Computer Science 2019-05-27 Bing Yu , Junzhao Zhang , Zhanxing Zhu

Graph convolutional network (GCN) is an emerging neural network approach. It learns new representation of a node by aggregating feature vectors of all neighbors in the aggregation process without considering whether the neighbors or…

Machine Learning · Computer Science 2022-04-01 Li Zhang , Heda Song , Nikolaos Aletras , Haiping Lu

Network representation learning (NRL) is an effective graph analytics technique and promotes users to deeply understand the hidden characteristics of graph data. It has been successfully applied in many real-world tasks related to network…

Social and Information Networks · Computer Science 2021-03-09 Ke Sun , Lei Wang , Bo Xu , Wenhong Zhao , Shyh Wei Teng , Feng Xia

In this paper, we propose Selective Output Smoothing Regularization, a novel regularization method for training the Convolutional Neural Networks (CNNs). Inspired by the diverse effects on training from different samples, Selective Output…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Xuan Cheng , Tianshu Xie , Xiaomin Wang , Qifeng Weng , Minghui Liu , Jiali Deng , Ming Liu

Recent advances in deep learning have relied on large, labelled datasets to train high-capacity models. However, collecting large datasets in a time- and cost-efficient manner often results in label noise. We present a method for learning…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Ahmet Iscen , Jack Valmadre , Anurag Arnab , Cordelia Schmid

Recent results suggest that reinitializing a subset of the parameters of a neural network during training can improve generalization, particularly for small training sets. We study the impact of different reinitialization methods in several…

Machine Learning · Computer Science 2021-09-02 Ibrahim Alabdulmohsin , Hartmut Maennel , Daniel Keysers

As much as Graph Convolutional Networks (GCNs) have shown tremendous success in recommender systems and collaborative filtering (CF), the mechanism of how they, especially the core components (\textit{i.e.,} neighborhood aggregation)…

Information Retrieval · Computer Science 2022-04-26 Shaowen Peng , Kazunari Sugiyama , Tsunenori Mine