English
Related papers

Related papers: An Efficient Sparse Kernel Generator for O(3)-Equi…

200 papers

Machine learning algorithms are being used more frequently in the first-level triggers in collider experiments, with Graph Neural Networks pushing the hardware requirements of FPGA-based triggers beyond the current state of the art. To meet…

High Energy Physics - Experiment · Physics 2026-02-27 Marc Neu , Isabel Haide , Torben Ferber , Jürgen Becker

We propose a distributed approach to train deep convolutional generative adversarial neural network (DC-CGANs) models. Our method reduces the imbalance between generator and discriminator by partitioning the training data according to data…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Massimiliano Lupo Pasini , Vittorio Gabbi , Junqi Yin , Simona Perotto , Nouamane Laanait

Recurrent Neural Networks (RNNs) are powerful tools for solving sequence-based problems, but their efficacy and execution time are dependent on the size of the network. Following recent work in simplifying these networks with model pruning…

Neural and Evolutionary Computing · Computer Science 2018-04-30 Feiwen Zhu , Jeff Pool , Michael Andersch , Jeremy Appleyard , Fung Xie

Incorporating Euclidean symmetries (e.g. rotation equivariance) as inductive biases into graph neural networks has improved their generalization ability and data efficiency in unbounded physical dynamics modeling. However, in various…

Machine Learning · Computer Science 2024-06-25 Zinan Zheng , Yang Liu , Jia Li , Jianhua Yao , Yu Rong

Geometric deep learning enables the encoding of physical symmetries in modeling 3D objects. Despite rapid progress in encoding 3D symmetries into Graph Neural Networks (GNNs), a comprehensive evaluation of the expressiveness of these…

Machine Learning · Computer Science 2023-04-12 Weitao Du , Yuanqi Du , Limei Wang , Dieqiao Feng , Guifeng Wang , Shuiwang Ji , Carla Gomes , Zhi-Ming Ma

A surge in artificial intelligence and autonomous technologies have increased the demand toward enhanced edge-processing capabilities. Computational complexity and size of state-of-the-art Deep Neural Networks (DNNs) are rising…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-12 Rawan Naous , Lazar Supic , Yoonhwan Kang , Ranko Sredojevic , Anish Singhani , Vladimir Stojanovic

The learning capability of a neural network improves with increasing depth at higher computational costs. Wider layers with dense kernel connectivity patterns furhter increase this cost and may hinder real-time inference. We propose feature…

Machine Learning · Computer Science 2016-11-01 Sajid Anwar , Wonyong Sung

The increasing scale and complexity of integrated circuit design have led to increased challenges in Electronic Design Automation (EDA). Graph Neural Networks (GNNs) have emerged as a promising approach to assist EDA design as circuits can…

Machine Learning · Computer Science 2025-08-26 Yuebo Luo , Shiyang Li , Junran Tao , Kiran Thorat , Xi Xie , Hongwu Peng , Nuo Xu , Caiwen Ding , Shaoyi Huang

We propose a new approach to Generative Adversarial Networks (GANs) to achieve an improved performance with additional robustness to its so-called and well recognized mode collapse. We first proceed by mapping the desired data onto a…

Computer Vision and Pattern Recognition · Computer Science 2019-08-26 Shahin Mahdizadehaghdam , Ashkan Panahi , Hamid Krim

We introduce a kernel approximation strategy that enables computation of the Gaussian process log marginal likelihood and all hyperparameter derivatives in $\mathcal{O}(p)$ time. Our GRIEF kernel consists of $p$ eigenfunctions found using a…

Machine Learning · Statistics 2018-08-02 Trefor W. Evans , Prasanth B. Nair

3D Gaussian Splatting (3DGS) has emerged as a mainstream solution for novel view synthesis and 3D reconstruction. By explicitly encoding a 3D scene using a collection of Gaussian kernels, 3DGS achieves high-quality rendering with superior…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Lei Lan , Tianjia Shao , Zixuan Lu , Yu Zhang , Chenfanfu Jiang , Yin Yang

While CNNs naturally lend themselves to densely sampled data, and sophisticated implementations are available, they lack the ability to efficiently process sparse data. In this work we introduce a suite of tools that exploit sparsity in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-13 Timo Hackel , Mikhail Usvyatsov , Silvano Galliani , Jan D. Wegner , Konrad Schindler

It is still a challenging task to learn a neural text generation model under the framework of generative adversarial networks (GANs) since the entire training process is not differentiable. The existing training strategies either suffer…

Computation and Language · Computer Science 2023-07-25 Liping Yuan , Jiehang Zeng , Xiaoqing Zheng

Deep neural networks (DNNs) have been proven to be effective in solving many real-life problems, but its high computation cost prohibits those models from being deployed to edge devices. Pruning, as a method to introduce zeros to model…

Machine Learning · Computer Science 2021-12-22 Fei Sun , Minghai Qin , Tianyun Zhang , Xiaolong Ma , Haoran Li , Junwen Luo , Zihao Zhao , Yen-Kuang Chen , Yuan Xie

We present a sparse Gauss-Newton solver for accelerated sensitivity analysis with applications to a wide range of equilibrium-constrained optimization problems. Dense Gauss-Newton solvers have shown promising convergence rates for inverse…

Optimization and Control · Mathematics 2021-07-12 Jonas Zehnder , Stelian Coros , Bernhard Thomaszewski

Graph Neural Networks (GNNs) have achieved tremendous success in graph representation learning. Unfortunately, current GNNs usually rely on loading the entire attributed graph into network for processing. This implicit assumption may not be…

Machine Learning · Computer Science 2022-02-15 Junfu Wang , Yunhong Wang , Zhen Yang , Liang Yang , Yuanfang Guo

The method of deep learning has achieved excellent results in improving the performance of robotic grasping detection. However, the deep learning methods used in general object detection are not suitable for robotic grasping detection.…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Hu Cao , Guang Chen , Zhijun Li , Jianjie Lin , Alois Knoll

Spectral-domain CNNs have been shown to be more efficient than traditional spatial CNNs in terms of reducing computation complexity. However they come with a `kernel explosion' problem that, even after compression (pruning), imposes a high…

Hardware Architecture · Computer Science 2023-10-18 Yue Niu , Rajgopal Kannan , Ajitesh Srivastava , Viktor Prasanna

Tensor computations present significant performance challenges that impact a wide spectrum of applications ranging from machine learning, healthcare analytics, social network analysis, data mining to quantum chemistry and signal processing.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-01-06 Jiajia Li , Mahesh Lakshminarasimhan , Xiaolong Wu , Ang Li , Catherine Olschanowsky , Kevin Barker

Gaussian processes (GPs) stand as crucial tools in machine learning and signal processing, with their effectiveness hinging on kernel design and hyper-parameter optimization. This paper presents a novel GP linear multiple kernel (LMK) and a…

Machine Learning · Computer Science 2025-01-17 Richard Cornelius Suwandi , Zhidi Lin , Feng Yin , Zhiguo Wang , Sergios Theodoridis