English
Related papers

Related papers: Sum-Product-Transform Networks: Exploiting Symmetr…

200 papers

Scattering Networks were initially designed to elucidate the behavior of early layers in Convolutional Neural Networks (CNNs) over Euclidean spaces and are grounded in wavelets. In this work, we introduce a scattering transform on an…

Numerical Analysis · Mathematics 2025-05-28 Maria Teresa Arias , Davide Barbieri , Eugenio Hernández

It has been proven that transfer learning provides an easy way to achieve state-of-the-art accuracies on several vision tasks by training a simple classifier on top of features obtained from pre-trained neural networks. The goal of this…

Machine Learning · Computer Science 2016-06-07 Milad Mohammadi , Subhasis Das

Deep unfolding networks have recently gained popularity in the context of solving imaging inverse problems. However, the computational and memory complexity of data-consistency layers within traditional deep unfolding networks scales with…

Image and Video Processing · Electrical Eng. & Systems 2021-06-04 Jiaming Liu , Yu Sun , Weijie Gan , Xiaojian Xu , Brendt Wohlberg , Ulugbek S. Kamilov

We develop Structured-Knowledge-Informed Neural Networks (SKINNs), a unified estimation framework that embeds theoretical, simulated, previously learned, or cross-domain insights as differentiable constraints within flexible neural function…

Machine Learning · Statistics 2026-04-02 Yi Cao , Zexun Chen , Lin William Cong , Heqing Shi

Identifying high-emission vehicles is a crucial step in regulating urban pollution levels and formulating traffic emission reduction strategies. However, in practical monitoring data, the proportion of high-emission state data is…

Machine Learning · Computer Science 2025-08-19 Yunning Cao , Lihong Pei , Jian Guo , Yang Cao , Yu Kang , Yanlong Zhao

Physics-Informed Neural Networks (PINN) are a machine learning tool that can be used to solve direct and inverse problems related to models described by Partial Differential Equations. This paper proposes an adaptive inverse PINN applied to…

Numerical Analysis · Mathematics 2024-11-28 Marco Berardi , Fabio Difonzo , Matteo Icardi

Deep learning is a hot research topic in the field of machine learning methods and applications. Generative Adversarial Networks (GANs) and Variational Auto-Encoders (VAEs) provide impressive image generations from Gaussian white noise, but…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Jiasong Wu , Jing Zhang , Fuzhi Wu , Youyong Kong , Guanyu Yang , Lotfi Senhadji , Huazhong Shu

Convolutional neural networks have been widely applied to hyperspectral image classification. However, traditional convolutions can not effectively extract features for objects with irregular distributions. Recent methods attempt to address…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Di Wang , Bo Du , Liangpei Zhang

We introduce Group equivariant Convolutional Neural Networks (G-CNNs), a natural generalization of convolutional neural networks that reduces sample complexity by exploiting symmetries. G-CNNs use G-convolutions, a new type of layer that…

Machine Learning · Computer Science 2016-06-06 Taco S. Cohen , Max Welling

Vision transformers have gained significant attention and achieved state-of-the-art performance in various computer vision tasks, including image classification, instance segmentation, and object detection. However, challenges remain in…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Badri N. Patro , Vijay Srinivas Agneeswaran

One of the central themes in Sum-Product networks (SPNs) is the interpretation of sum nodes as marginalized latent variables (LVs). This interpretation yields an increased syntactic or semantic structure, allows the application of the EM…

Artificial Intelligence · Computer Science 2016-10-31 Robert Peharz , Robert Gens , Franz Pernkopf , Pedro Domingos

Bayesian online algorithms for Sum-Product Networks (SPNs) need to update their posterior distribution after seeing one single additional instance. To do so, they must compute moments of the model parameters under this distribution. The…

Machine Learning · Computer Science 2017-11-07 Han Zhao , Geoff Gordon

Slimmable Neural Networks (S-Net) is a novel network which enabled to select one of the predefined proportions of channels (sub-network) dynamically depending on the current computational resource availability. The accuracy of each…

Computer Vision and Pattern Recognition · Computer Science 2022-12-08 Hideaki Kuratsu , Atsuyoshi Nakamura

Graph Neural Networks (GNNs) have shown considerable effectiveness in a variety of graph learning tasks, particularly those based on the message-passing approach in recent years. However, their performance is often constrained by a limited…

Machine Learning · Computer Science 2024-04-22 Ruizhe Zhang , Xinke Jiang , Yuchen Fang , Jiayuan Luo , Yongxin Xu , Yichen Zhu , Xu Chu , Junfeng Zhao , Yasha Wang

Deep Convolutional Neural Network (DCNN) and Transformer have achieved remarkable successes in image recognition. However, their performance in fine-grained image recognition is still difficult to meet the requirements of actual needs. This…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Chaorong Li , Malu Zhang , Wei Huang , Fengqing Qin , Anping Zeng , Yuanyuan Huang

While mixture density networks (MDNs) have been extensively used for regression tasks, they have not been used much for classification tasks. One reason for this is that the usability of MDNs for classification is not clear and…

Machine Learning · Computer Science 2024-02-09 Narendhar Gugulothu , Sanjay P. Bhat , Tejas Bodas

Graph neural networks (GNNs) provide state-of-the-art results in a wide variety of tasks which typically involve predicting features at the vertices of a graph. They are built from layers of graph convolutions which serve as a powerful…

Machine Learning · Statistics 2024-11-08 Mauricio Velasco , Kaiying O'Hare , Bernardo Rychtenberg , Soledad Villar

Deep Convolutional Neural Networks (CNN) has achieved significant success in computer vision field. However, the high computational cost of the deep complex models prevents the deployment on edge devices with limited memory and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-15 Huiyuan Zhuo , Xuelin Qian , Yanwei Fu , Heng Yang , Xiangyang Xue

We present a transformer-based image anomaly detection and localization network. Our proposed model is a combination of a reconstruction-based approach and patch embedding. The use of transformer networks helps to preserve the spatial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Pankaj Mishra , Riccardo Verk , Daniele Fornasier , Claudio Piciarelli , Gian Luca Foresti

Although Convolutional Neural Networks (CNNs) have achieved promising results in image classification, they still are vulnerable to affine transformations including rotation, translation, flip and shuffle. The drawback motivates us to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Zijie Tan , Guanfang Dong , Chenqiu Zhao , Anup Basu