English
Related papers

Related papers: Power Normalizations in Fine-grained Image, Few-sh…

200 papers

This paper presents a data processing algorithm with machine learning for polarization extraction and event selection applied to photoelectron track images taken with X-ray polarimeters. The method uses a convolutional neural network (CNN)…

Instrumentation and Methods for Astrophysics · Physics 2019-09-04 Takao Kitaguchi , Kevin Black , Teruaki Enoto , Asami Hayato , Joanne E. Hill , Wataru B. Iwakiri , Philip Kaaret , Tsunefumi Mizuno , Toru Tamagawa

As the deep neural networks are being applied to complex tasks, the size of the networks and architecture increases and their topology becomes more complicated too. At the same time, training becomes slow and at some instances inefficient.…

Machine Learning · Computer Science 2021-02-22 Massimiliano Esposito , Nader Ganaba

Greater direct electrification of end-use sectors with a higher share of renewables is one of the pillars to power a carbon-neutral society by 2050. However, in contrast to conventional power plants, renewable energy is subject to…

Machine Learning · Computer Science 2021-09-22 Jonathan Dumas , Antoine Wehenkel Damien Lanaspeze , Bertrand Cornélusse , Antonio Sutera

Two main families of node feature augmentation schemes have been explored for enhancing GNNs: random features and spectral positional encoding. Surprisingly, however, there is still no clear understanding of the relation between these two…

Machine Learning · Computer Science 2023-07-20 Moshe Eliasof , Fabrizio Frasca , Beatrice Bevilacqua , Eran Treister , Gal Chechik , Haggai Maron

Deep Neural Networks (DNNs) are generated by sequentially performing linear and non-linear processes. Using a combination of linear and non-linear procedures is critical for generating a sufficiently deep feature space. The majority of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Yufei Hu , Nacim Belkhir , Jesus Angulo , Angela Yao , Gianni Franchi

We address a learning-to-normalize problem by proposing Switchable Normalization (SN), which learns to select different normalizers for different normalization layers of a deep neural network. SN employs three distinct scopes to compute…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Ping Luo , Jiamin Ren , Zhanglin Peng , Ruimao Zhang , Jingyu Li

Graph Neural Networks (GNNs) have gained popularity in various learning tasks, with successful applications in fields like molecular biology, transportation systems, and electrical grids. These fields naturally use graph data, benefiting…

Machine Learning · Computer Science 2024-09-23 Caio F. Deberaldini Netto , Zhiyang Wang , Luana Ruiz

Continuous neural representations have recently emerged as a powerful and flexible alternative to classical discretized representations of signals. However, training them to capture fine details in multi-scale signals is difficult and…

Machine Learning · Computer Science 2022-10-06 Sifan Wang , Hanwen Wang , Jacob H. Seidman , Paris Perdikaris

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

Estimating the primary quantization matrix of double JPEG compressed images is a problem of relevant importance in image forensics since it allows to infer important information about the past history of an image. In addition, the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Benedetta Tondi , Andrea Costranzo , Dequ Huang , Bin Li

Parameter Estimation (PE) and State Estimation (SE) are the most wide-spread tasks in the system engineering. They need to be done automatically, fast and frequently, as measurements arrive. Deep Learning (DL) holds the promise of tackling…

Machine Learning · Computer Science 2021-02-15 Laurent Pagnier , Michael Chertkov

This paper investigates the relationship between graph convolution and Mixup techniques. Graph convolution in a graph neural network involves aggregating features from neighboring samples to learn representative features for a specific node…

We propose a Multi-level Second-order (MlSo) few-shot learning network for supervised or unsupervised few-shot image classification and few-shot action recognition. We leverage so-called power-normalized second-order base learner streams…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Hongguang Zhang , Hongdong Li , Piotr Koniusz

Generative diffusion models can provide powerful prior probability models for inverse problems in imaging, but existing implementations suffer from two key limitations: $(i)$ the prior density is represented implicitly, and $(ii)$ they rely…

Machine Learning · Computer Science 2026-05-19 Nicolas Zilberstein , Santiago Segarra , Eero Simoncelli , Florentin Guth

We formulate a framework of polynomial diagrams, which are a generalisation of power diagrams (PDs) and anisotropic power diagrams (APDs) allowing for boundaries between cells to be algebraic curves of a prescribed degree. We show that they…

Optimization and Control · Mathematics 2026-05-21 David P. Bourne , Maciej Buze , Thomas Gallouët , Quentin Mérigot

CoVariance Neural Networks (VNNs) perform convolutions on the graph determined by the covariance matrix of the data, which enables expressive and stable covariance-based learning. However, covariance matrices are typically dense, fail to…

Machine Learning · Computer Science 2026-01-21 Andrea Cavallo , Samuel Rey , Antonio G. Marques , Elvin Isufi

In this paper, we explore the structure of the penultimate Gram matrix in deep neural networks, which contains the pairwise inner products of outputs corresponding to a batch of inputs. In several architectures it has been observed that…

Machine Learning · Computer Science 2023-11-21 Amir Joudaki , Hadi Daneshmand , Francis Bach

Deep learning has been widely used for hyperspectral pixel classification due to its ability of generating deep feature representation. However, how to construct an efficient and powerful network suitable for hyperspectral data is still…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Jingzhou Chen , Siyu Chen , Peilin Zhou , Yuntao Qian

Graph neural networks (GNNs) have been used effectively in different applications involving the processing of signals on irregular structures modeled by graphs. Relying on the use of shift-invariant graph filters, GNNs extend the operation…

Machine Learning · Computer Science 2020-03-05 Alejandro Parada-Mayorga , Luana Ruiz , Alejandro Ribeiro

Convolutional Neural Networks (CNNs) have become the state-of-the-art in supervised learning vision tasks. Their convolutional filters are of paramount importance for they allow to learn patterns while disregarding their locations in input…

Machine Learning · Computer Science 2017-10-26 Jean-Charles Vialatte , Vincent Gripon , Grégoire Mercier