English
Related papers

Related papers: Group Downsampling with Equivariant Anti-aliasing

200 papers

As much as Graph Convolutional Networks (GCNs) have shown tremendous success in recommender systems and collaborative filtering (CF), the mechanism of how they, especially the core components (\textit{i.e.,} neighborhood aggregation)…

Information Retrieval · Computer Science 2022-04-26 Shaowen Peng , Kazunari Sugiyama , Tsunenori Mine

Although group convolution operators are increasingly used in deep convolutional neural networks to improve the computational efficiency and to reduce the number of parameters, most existing methods construct their group convolution…

Machine Learning · Computer Science 2020-09-30 Qingbei Guo , Xiao-Jun Wu , Josef Kittler , Zhiquan Feng

Recent works show that group equivariance as an inductive bias improves neural network performance for both classification and generation. However, designing group-equivariant neural networks is challenging when the group of interest is…

Machine Learning · Computer Science 2021-06-09 Sourya Basu , Akshayaa Magesh , Harshit Yadav , Lav R. Varshney

Ensemble algorithms offer state of the art performance in many machine learning applications. A common explanation for their excellent performance is due to the bias-variance decomposition of the mean squared error which shows that the…

Machine Learning · Computer Science 2020-12-10 Sebastian Buschjäger , Lukas Pfahler , Katharina Morik

Resampling detection plays an important role in identifying image tampering, such as image splicing. Currently, the resampling detection is still difficult in recompressed images, which are yielded by applying resampling followed by…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Gang Cao , Antao Zhou , Xianglin Huang , Gege Song , Lifang Yang , Yonggui Zhu

Tools to analyze the latent space of deep neural networks provide a step towards better understanding them. In this work, we motivate sparse subspace clustering (SSC) with an aim to learn affinity graphs from the latent structure of a given…

Machine Learning · Computer Science 2021-07-06 Uday Singh Saini , Pravallika Devineni , Evangelos E. Papalexakis

Graph clustering, a classical task in graph learning, involves partitioning the nodes of a graph into distinct clusters. This task has applications in various real-world scenarios, such as anomaly detection, social network analysis, and…

Machine Learning · Computer Science 2024-08-09 Xiaoyang Ji , Yuchen Zhou , Haofu Yang , Shiyue Xu , Jiahao Li

Spectral-type subspace clustering algorithms have shown excellent performance in many subspace clustering applications. The existing spectral-type subspace clustering algorithms either focus on designing constraints for the reconstruction…

Machine Learning · Computer Science 2023-05-08 Lai Wei , Zhengwei Chen , Jun Yin , Changming Zhu , Rigui Zhou , Jin Liu

Image compression is a method to remove spatial redundancy between adjacent pixels and reconstruct a high-quality image. In the past few years, deep learning has gained huge attention from the research community and produced promising image…

Image and Video Processing · Electrical Eng. & Systems 2021-09-07 Khawar Islam , L. Minh Dang , Sujin Lee , Hyeonjoon Moon

Medical image analysis using supervised deep learning methods remains problematic because of the reliance of deep learning methods on large amounts of labelled training data. Although medical imaging data repositories continue to expand…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Euijoon Ahn , Ashnil Kumar , Dagan Feng , Michael Fulham , Jinman Kim

Current deep learning models for classification tasks in computer vision are trained using mini-batches. In the present article, we take advantage of the relationships between samples in a mini-batch, using graph neural networks to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-10 Arnab Kumar Mondal , Vineet Jain , Kaleem Siddiqi

Subspace clustering algorithms are used for understanding the cluster structure that explains the dataset well. These methods are extensively used for data-exploration tasks in various areas of Natural Sciences. However, most of these…

Machine Learning · Computer Science 2022-11-15 Ashutosh Singh , Ashish Singh , Aria Masoomi , Tales Imbiriba , Erik Learned-Miller , Deniz Erdogmus

Subsampling layers play a crucial role in deep nets by discarding a portion of an activation map to reduce its spatial dimensions. This encourages the deep net to learn higher-level representations. Contrary to this motivation, we…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Chiao-An Yang , Ziwei Liu , Raymond A. Yeh

Non-local self-similarity is well-known to be an effective prior for the image denoising problem. However, little work has been done to incorporate it in convolutional neural networks, which surpass non-local model-based methods despite…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Diego Valsesia , Giulia Fracastoro , Enrico Magli

CNNs achieve remarkable performance by leveraging deep, over-parametrized architectures, trained on large datasets. However, they have limited generalization ability to data outside the training domain, and a lack of robustness to noise and…

In convolutional neural networks (CNNs), the filter grouping in convolution layers is known to be useful to reduce the network parameter size. In this paper, we propose a new logarithmic filter grouping which can capture the nonlinearity of…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Tae Kwan Lee , Wissam J. Baddar , Seong Tae Kim , Yong Man Ro

The weight-sharing mechanism of convolutional kernels ensures translation-equivariance of convolution neural networks (CNNs). Recently, rotation-equivariance has been investigated. However, research on scale-equivariance or simultaneous…

Computer Vision and Pattern Recognition · Computer Science 2023-06-13 Wei-Dong Qiao , Yang Xu , Hui Li

We introduce a simple permutation equivariant layer for deep learning with set structure.This type of layer, obtained by parameter-sharing, has a simple implementation and linear-time complexity in the size of each set. We use deep…

Machine Learning · Statistics 2017-02-27 Siamak Ravanbakhsh , Jeff Schneider , Barnabas Poczos

Incorporating group symmetries via equivariance into neural networks has emerged as a robust approach for overcoming the efficiency and data demands of modern deep learning. While most existing approaches, such as group convolutions and…

Geometric quantum machine learning uses the symmetries inherent in data to design tailored machine learning tasks with reduced search space dimension. The field has been well-studied recently in an effort to avoid barren plateau issues…

Quantum Physics · Physics 2025-07-14 Zachary P. Bradshaw , Ethan N. Evans , Matthew Cook , Margarite L. LaBorde