English
Related papers

Related papers: Comparing and improving hybrid deep learning algor…

200 papers

In this paper, we present a novel technique to search for hardware architectures of accelerators optimized for end-to-end training of deep neural networks (DNNs). Our approach addresses both single-device and distributed pipeline and tensor…

Hardware Architecture · Computer Science 2024-04-24 Muhammad Adnan , Amar Phanishayee , Janardhan Kulkarni , Prashant J. Nair , Divya Mahajan

The task of lane detection has garnered considerable attention in the field of autonomous driving due to its complexity. Lanes can present difficulties for detection, as they can be narrow, fragmented, and often obscured by heavy traffic.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Jia-Qi Zhang , Hao-Bin Duan , Jun-Long Chen , Ariel Shamir , Miao Wang

Deep learning is a topic of considerable current interest. The availability of massive data collections and powerful software resources has led to an impressive amount of results in many application areas that reveal essential but hidden…

Machine Learning · Computer Science 2023-01-31 Gianluigi Pillonetto , Aleksandr Aravkin , Daniel Gedon , Lennart Ljung , Antônio H. Ribeiro , Thomas B. Schön

Significant new challenges are continuously confronting the High Energy Physics (HEP) experiments, in particular the two detectors at the Large Hadron Collider (LHC) at CERN, where nominal conditions deliver proton-proton collisions to the…

Instrumentation and Detectors · Physics 2013-10-24 V. Halyo , A. Hunt , P. Jindal , P. LeGresley , P. Lujan

The Primal-Dual Hybrid Gradient (PDHG) algorithm is a first-order method that can exploit GPUs to solve large-scale linear programming problems. The approach can often be faster than the alternatives, simplex and interior-point methods,…

Optimization and Control · Mathematics 2026-03-04 Edward Rothberg

In this paper, we construct approximated solutions of Differential Equations (DEs) using the Deep Neural Network (DNN). Furthermore, we present an architecture that includes the process of finding model parameters through experimental data,…

Numerical Analysis · Mathematics 2019-07-31 Hyeontae Jo , Hwijae Son , Hyung Ju Hwang , Eunheui Kim

Deep neural networks have recently achieved state of the art performance thanks to new training algorithms for rapid parameter estimation and new regularization methods to reduce overfitting. However, in practice the network architecture…

Machine Learning · Computer Science 2016-03-04 Minyoung Kim , Luca Rigazio

Recently sequential model based optimization (SMBO) has emerged as a promising hyper-parameter optimization strategy in machine learning. In this work, we investigate SMBO to identify architecture hyper-parameters of deep convolution…

Computer Vision and Pattern Recognition · Computer Science 2015-05-19 Sachin S. Talathi

Knowledge distillation is a form of model compression that allows artificial neural networks of different sizes to learn from one another. Its main application is the compactification of large deep neural networks to free up computational…

High Energy Physics - Experiment · Physics 2024-05-08 Aritra Bal , Tristan Brandes , Fabio Iemmi , Markus Klute , Benedikt Maier , Vinicius Mikuni , Thea Aarrestad

The recent rise of deep learning has led to numerous applications, including solving partial differential equations using Physics-Informed Neural Networks. This approach has proven highly effective in several academic cases. However, their…

Numerical Analysis · Mathematics 2024-10-07 Marien Chenaud , Frédéric Magoulès , José Alves

Solving large-scale Generalized Eigenvalue Problems (GEPs) is a fundamental yet computationally prohibitive task in science and engineering. As a promising direction, contour integral (CI) methods, such as the CIRR algorithm, offer an…

Machine Learning · Computer Science 2025-11-05 Yeqiu Chen , Ziyan Liu , Hong Wang

Estimating neuron location from extracellular recordings is essential for developing advanced brain-machine interfaces. Accurate neuron localization improves spike sorting, which involves detecting action potentials and assigning them to…

Neurons and Cognition · Quantitative Biology 2025-08-20 Hao Zhao , Xinhe Zhang , Arnau Marin-Llobet , Xinyi Lin , Jia Liu

Recent advances in deep learning have enabled us to address the curse of dimensionality (COD) by solving problems in higher dimensions. A subset of such approaches of addressing the COD has led us to solving high-dimensional PDEs. This has…

The determination of charged particle trajectories (tracking) in collisions at the CERN Large Hadron Collider (LHC) is one of the most important aspects for event reconstruction at hadron colliders. This is especially true in the high…

Instrumentation and Detectors · Physics 2022-12-06 H. Abidi , A. Boveia , V. Cavaliere , D. Furletov , A. Gekow , C. W. Kalderon , S. Yoo

Accurate and fast simulation of particle physics processes is crucial for the high-energy physics community. Simulating particle interactions with detectors is both time consuming and computationally expensive. With the proton-proton…

High Energy Physics - Experiment · Physics 2021-08-26 Ali Hariri , Darya Dyachkova , Sergei Gleyzer

Physics-informed neural networks (PINNs) have recently emerged as a prominent paradigm for solving partial differential equations (PDEs), yet their training strategies remain underexplored. While hard prioritization methods inspired by…

Machine Learning · Computer Science 2025-12-22 Zhaoqian Gao , Min Yanga

We propose to combine recent Convolutional Neural Networks (CNN) models with depth imaging to obtain a reliable and fast multi-person pose estimation algorithm applicable to Human Robot Interaction (HRI) scenarios. Our hypothesis is that…

Computer Vision and Pattern Recognition · Computer Science 2019-10-31 Angel Martínez-González , Michael Villamizar , Olivier Canévet , Jean-Marc Odobez

As the particle physics community needs higher and higher precisions in order to test our current model of the subatomic world, larger and larger datasets are necessary. With upgrades scheduled for the detectors of colliding-beam…

Data Analysis, Statistics and Probability · Physics 2025-09-09 Fotis I. Giasemis

Deep kernel learning aims at designing nonlinear combinations of multiple standard elementary kernels by training deep networks. This scheme has proven to be effective, but intractable when handling large-scale datasets especially when the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Mingyuan Jiu , Hichem Sahbi

We introduce H3DNet, which takes a colorless 3D point cloud as input and outputs a collection of oriented object bounding boxes (or BB) and their semantic labels. The critical idea of H3DNet is to predict a hybrid set of geometric…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Zaiwei Zhang , Bo Sun , Haitao Yang , Qixing Huang