English
Related papers

Related papers: Multi-Scale Distributed Representation for Deep Le…

200 papers

Binary Neural Networks (BNNs) significantly reduce computational complexity and memory usage in machine and deep learning by representing weights and activations with just one bit. However, most existing training algorithms for BNNs rely on…

Machine Learning · Computer Science 2025-12-08 Luca Colombo , Fabrizio Pittorino , Manuel Roveri

Deep Neural Networks (DNNs) have recently shown state of the art performance on semantic segmentation tasks, however, they still suffer from problems of poor boundary localization and spatial fragmented predictions. The difficulties lie in…

Computer Vision and Pattern Recognition · Computer Science 2018-10-29 Peng Jiang , Fanglin Gu , Yunhai Wang , Changhe Tu , Baoquan Chen

In this paper, we evaluate the quality of knowledge representations encoded in deep neural networks (DNNs) for 3D point cloud processing. We propose a method to disentangle the overall model vulnerability into the sensitivity to the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Wen Shen , Qihan Ren , Dongrui Liu , Quanshi Zhang

Classification of jets as originating from light-flavor or heavy-flavor quarks is an important task for inferring the nature of particles produced in high-energy collisions. The large and variable dimensionality of the data provided by the…

High Energy Physics - Experiment · Physics 2016-12-07 Daniel Guest , Julian Collado , Pierre Baldi , Shih-Chieh Hsu , Gregor Urban , Daniel Whiteson

Foundation models use large datasets to build an effective representation of data that can be deployed on diverse downstream tasks. Previous research developed the OmniLearn foundation model for jet physics, using unique properties of…

High Energy Physics - Phenomenology · Physics 2026-03-27 Wahid Bhimji , Chris Harris , Vinicius Mikuni , Benjamin Nachman

Machine learning has played a pivotal role in advancing physics, with deep learning notably contributing to solving complex classification problems such as jet tagging in the field of jet physics. In this experiment, we aim to harness the…

High Energy Physics - Phenomenology · Physics 2023-11-27 Mauricio A. Diaz , Giorgio Cerro , Jacan Chaplais , Srinandan Dasmahapatra , Stefano Moretti

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Deep learning research aims at discovering learning algorithms that discover multiple levels of distributed representations, with higher levels representing more abstract concepts. Although the study of deep learning has already led to…

Machine Learning · Computer Science 2013-06-10 Yoshua Bengio

Deep Neural Networks (DNNs) are becoming an important tool in modern computing applications. Accelerating their training is a major challenge and techniques range from distributed algorithms to low-level circuit design. In this survey, we…

Machine Learning · Computer Science 2018-09-18 Tal Ben-Nun , Torsten Hoefler

Deciphering the complex information contained in jets produced in collider events requires a physical organization of the jet data. We introduce two-particle correlations (2PCs) by pairing individual particles as the initial jet…

High Energy Physics - Phenomenology · Physics 2020-07-01 Kai-Feng Chen , Yang-Ting Chien

Bilevel programs (BPs) find a wide range of applications in fields such as energy, transportation, and machine learning. As compared to BPs with continuous (linear/convex) optimization problems in both levels, the BPs with discrete decision…

Optimization and Control · Mathematics 2024-07-25 Bo Zhou , Ruiwei Jiang , Siqian Shen

Deep Learning approaches are becoming the go-to methods for data analysis in High Energy Physics (HEP). Nonetheless, most physics-inspired modern architectures are computationally inefficient and lack interpretability. This is especially…

Computational Physics · Physics 2023-01-31 Jose M Munoz , Ilyes Batatia , Christoph Ortner

This work presents an in-depth analysis of the majority of the deep neural networks (DNNs) proposed in the state of the art for image recognition. For each DNN multiple performance indices are observed, such as recognition accuracy, model…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Simone Bianco , Remi Cadene , Luigi Celona , Paolo Napoletano

Distributed deep neural networks (DNNs) have become central to modern computer vision, yet their deployment on resource-constrained edge devices remains hindered by substantial parameter counts, computational demands, and the probability of…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-17 Mahadev Sunil Kumar , Arnab Raha , Debayan Das , Gopakumar G , Rounak Chatterjee , Amitava Mukherjee

One of the biggest challenges for deep learning algorithms in medical image analysis is the indiscriminate mixing of image properties, e.g. artifacts and anatomy. These entangled image properties lead to a semantically redundant feature…

Machine Learning · Computer Science 2019-08-22 Qingjie Meng , Nick Pawlowski , Daniel Rueckert , Bernhard Kainz

Embedded distributed inference of Neural Networks has emerged as a promising approach for deploying machine-learning models on resource-constrained devices in an efficient and scalable manner. The inference task is distributed across a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-07 Federico Nicolás Peccia , Oliver Bringmann

Diffractive Neural Networks (DNNs) leverage the power of light to enhance computational performance in machine learning, offering a pathway to high-speed, low-energy, and large-scale neural information processing. However, most existing DNN…

Optics · Physics 2024-11-21 Sahar Behroozinia , Qing Gu

Significant success has been reported recently using deep neural networks for classification. Such large networks can be computationally intensive, even after training is over. Implementing these trained networks in hardware chips with a…

Machine Learning · Statistics 2013-10-25 Daniel Soudry , Ron Meir

Network node embedding is an active research subfield of complex network analysis. This paper contributes a novel approach to learning network node embeddings and direct node classification using a node ranking scheme coupled with an…

Machine Learning · Computer Science 2021-09-14 Blaž Škrlj , Jan Kralj , Janez Konc , Marko Robnik-Šikonja , Nada Lavrač

Deep neural networks (DNNs) have succeeded in many different perception tasks, e.g., computer vision, natural language processing, reinforcement learning, etc. The high-performed DNNs heavily rely on intensive resource consumption. For…

Machine Learning · Computer Science 2022-10-10 Zhongnan Qu