English
Related papers

Related papers: High-order Tensor Pooling with Attention for Actio…

200 papers

Tensor decomposition is a fundamental method used in various areas to deal with high-dimensional data. \emph{Tensor power method} (TPM) is one of the widely-used techniques in the decomposition of tensors. This paper presents a novel tensor…

Machine Learning · Computer Science 2023-06-02 Yichuan Deng , Zhao Song , Junze Yin

We introduce a parametric form of pooling, based on a Gaussian, which can be optimized alongside the features in a single global objective function. By contrast, existing pooling schemes are based on heuristics (e.g. local maximum) and have…

Computer Vision and Pattern Recognition · Computer Science 2012-07-03 Matthew D. Zeiler , Rob Fergus

Interest point descriptors have fueled progress on almost every problem in computer vision. Recent advances in deep neural networks have enabled task-specific learned descriptors that outperform hand-crafted descriptors on many problems. We…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Mohammed E. Fathy , Quoc-Huy Tran , M. Zeeshan Zia , Paul Vernaza , Manmohan Chandraker

We make the connection between certain deep learning architectures and the renormalisation group explicit in the context of QCD by using a deep learning network to construct a toy parton shower model. The model aims to describe…

High Energy Physics - Phenomenology · Physics 2018-12-26 James William Monk

Temperature is a widely used hyperparameter in various tasks involving neural networks, such as classification or metric learning, whose choice can have a direct impact on the model performance. Most of existing works select its value using…

Machine Learning · Computer Science 2022-10-19 Benjamin Chamand , Olivier Risser-Maroix , Camille Kurtz , Philippe Joly , Nicolas Loménie

High Dynamic Range (HDR) images can be recovered from several Low Dynamic Range (LDR) images by existing Deep Neural Networks (DNNs) techniques. Despite the remarkable progress, DNN-based methods still generate ghosting artifacts when LDR…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Qingsen Yan , Tao Hu , Yuan Sun , Hao Tang , Yu Zhu , Wei Dong , Luc Van Gool , Yanning Zhang

Detecting poorly textured objects and estimating their 3D pose reliably is still a very challenging problem. We introduce a simple but powerful approach to computing descriptors for object views that efficiently capture both the object…

Computer Vision and Pattern Recognition · Computer Science 2017-11-15 Paul Wohlhart , Vincent Lepetit

Knowledge distillation(KD) is a widely-used technique to train compact models in object detection. However, there is still a lack of study on how to distill between heterogeneous detectors. In this paper, we empirically find that better FPN…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Weihan Cao , Yifan Zhang , Jianfei Gao , Anda Cheng , Ke Cheng , Jian Cheng

Based on tensor neural network, we propose an interpolation method for high dimensional non-tensor-product-type functions. This interpolation scheme is designed by using the tensor neural network based machine learning method. This means…

Numerical Analysis · Mathematics 2024-04-12 Yongxin Li , Zhongshuo Lin , Yifan Wang , Hehu Xie

The density estimation is one of the core problems in statistics. Despite this, existing techniques like maximum likelihood estimation are computationally inefficient due to the intractability of the normalizing constant. For this reason an…

Machine Learning · Computer Science 2021-01-14 Tsimboy Olga , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

Tensor classification has become increasingly crucial in statistics and machine learning, with applications spanning neuroimaging, computer vision, and recommendation systems. However, the high dimensionality of tensors presents significant…

Methodology · Statistics 2024-09-24 Elynn Chen , Yuefeng Han , Jiayu Li

PCANet, as one noticeable shallow network, employs the histogram representation for feature pooling. However, there are three main problems about this kind of pooling method. First, the histogram-based pooling method binarizes the feature…

Computer Vision and Pattern Recognition · Computer Science 2017-10-03 Lei Tian , Xiaopeng Hong , Guoying Zhao , Chunxiao Fan , Yue Ming , Matti Pietikäinen

We propose a novel pooling strategy that learns how to adaptively rank deep convolutional features for selecting more informative representations. To this end, we exploit discriminative analysis to project the features onto a space spanned…

Machine Learning · Computer Science 2017-10-23 Arash Shahriari , Fatih Porikli

Recently, graph neural networks (GNNs) have revolutionized the field of graph representation learning through effectively learned node embeddings, and achieved state-of-the-art results in tasks such as node classification and link…

Machine Learning · Computer Science 2019-02-21 Rex Ying , Jiaxuan You , Christopher Morris , Xiang Ren , William L. Hamilton , Jure Leskovec

We present a new method for calculating the temperature profile in high explosive (HE) material using a Convolutional Neural Network (CNN). To train/test the CNN, we have developed a hybrid experiment/simulation method for collecting…

Signal Processing · Electrical Eng. & Systems 2023-10-20 John Greenhall , David K. Zerkle , Eric S. Davis , Robert Broilo , Cristian Pantea

Power and thermal management are critical components of High-Performance-Computing (HPC) systems, due to their high power density and large total power consumption. The assessment of thermal dissipation by means of compact models directly…

Machine Learning · Computer Science 2018-11-08 Federico Pittino , Roberto Diversi , Luca Benini , Andrea Bartolini

Simultaneous recordings from multiple neural units allow us to investigate the activity of very large neural ensembles. To understand how large ensembles of neurons process sensory information, it is necessary to develop suitable…

Neurons and Cognition · Quantitative Biology 2013-05-30 Fernando Montani , Elena Phoka , Mariela Portesi , Simon R. Schultz

Graph pooling compresses graph information into a compact representation. State-of-the-art graph pooling methods follow a hierarchical approach, which reduces the graph size step-by-step. These methods must balance memory efficiency with…

Machine Learning · Computer Science 2024-02-23 Yunchong Song , Siyuan Huang , Xinbing Wang , Chenghu Zhou , Zhouhan Lin

Higher-order tensors are becoming prevalent in many scientific areas such as computer vision, social network analysis, data mining and neuroscience. Traditional tensor decomposition approaches face three major challenges: model selecting,…

Numerical Analysis · Computer Science 2014-07-08 Fanhua Shang , Yuanyuan Liu , James Cheng

In the node classification task, it is natural to presume that densely connected nodes tend to exhibit similar attributes. Given this, it is crucial to first define what constitutes a dense connection and to develop a reliable mathematical…

Social and Information Networks · Computer Science 2025-01-03 Eunho Koo , Tongseok Lim