English
Related papers

Related papers: Unexplored Opportunities for Automatic Differentia…

200 papers

Machine learning and neural network models in particular have been improving the state of the art performance on many artificial intelligence related tasks. Neural network models are typically implemented using frameworks that perform…

Machine Learning · Computer Science 2021-10-18 Davan Harrison

We present a new algorithm, named Autonomous Gaussian Decomposition (AGD), for automatically decomposing spectra into Gaussian components. AGD uses derivative spectroscopy and machine learning to provide optimized guesses for the number of…

Instrumentation and Methods for Astrophysics · Physics 2015-06-22 Robert R. Lindner , Carlos Vera-Ciro , Claire E. Murray , Snežana Stanimirović , Brian L. Babler , Carl Heiles , Patrick Hennebelle , W. M. Goss , John Dickey

In mathematics and computer algebra, automatic differentiation (AD) is a set of techniques to evaluate the derivative of a function specified by a computer program. AD exploits the fact that every computer program, no matter how…

Mathematical Software · Computer Science 2021-02-03 Vassil Vassilev , Aleksandr Efremov , Oksana Shadura

Within scientific and real life problems, classification is a typical case of extremely complex tasks in data-driven scenarios, especially if approached with traditional techniques. Machine Learning supervised and unsupervised paradigms,…

Instrumentation and Methods for Astrophysics · Physics 2018-07-13 Giuseppe Angora , Massimo Brescia , Stefano Cavuoti , Giuseppe Riccio , Maurizio Paolillo , Thomas H. Puzia

A computational revolution unleashed the power of artificial neural networks. At the heart of that revolution is automatic differentiation, which calculates the derivative of a performance measure relative to a large number of parameters.…

Quantitative Methods · Quantitative Biology 2023-12-27 Steven A. Frank

Stochastic optimization plays a crucial role in the advancement of deep learning technologies. Over the decades, significant effort has been dedicated to improving the training efficiency and robustness of deep neural networks, via various…

Machine Learning · Computer Science 2024-08-21 Huixiu Jiang , Ling Yang , Yu Bao , Rutong Si , Sikun Yang

Many problems in computational science and engineering can be described in terms of approximating a smooth function of $d$ variables, defined over an unknown domain of interest $\Omega\subset \mathbb{R}^d$, from sample data. Here both the…

Numerical Analysis · Mathematics 2022-10-05 Ben Adcock , Juan M. Cardenas , Nick Dexter

Redshift estimation and the classification of gamma-ray AGNs represent crucial challenges in the field of gamma-ray astronomy. Recent efforts have been made to tackle these problems using traditional machine learning methods. However, the…

High Energy Astrophysical Phenomena · Physics 2024-08-27 Sarvesh Gharat , Abhimanyu Borthakur , Gopal Bhatta

This paper presents a transformative framework for artificial neural networks over graded vector spaces, tailored to model hierarchical and structured data in fields like algebraic geometry and physics. By exploiting the algebraic…

Artificial Intelligence · Computer Science 2026-01-07 Tony Shaska

Millimeter-wave radar offers unique advantages in adverse weather but suffers from low spatial fidelity, severe azimuth ambiguity, and clutter-induced spurious returns. Existing methods mainly focus on improving spatial perception…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Shengpeng Wang , Kuangyu Wang , Wei Wang

We study distributed stochastic gradient (D-SG) method and its accelerated variant (D-ASG) for solving decentralized strongly convex stochastic optimization problems where the objective function is distributed over several computational…

Optimization and Control · Mathematics 2021-10-05 Alireza Fallah , Mert Gurbuzbalaban , Asuman Ozdaglar , Umut Simsekli , Lingjiong Zhu

The sensitivity limits of space telescopes are imposed by uncalibrated errors in the point spread function, photon-noise, background light, and detector sensitivity. These are typically calibrated with specialized wavefront sensor hardware…

Instrumentation and Methods for Astrophysics · Physics 2024-06-18 Louis Desdoigts , Benjamin Pope , Jordan Dennis , Peter Tuthill

In the past few years, following the differentiable programming paradigm, there has been a growing interest in computing the gradient information of physical processes (e.g., physical simulation, image rendering). However, such processes…

Robotics · Computer Science 2022-06-24 Quentin Le Lidec , Louis Montaut , Cordelia Schmid , Ivan Laptev , Justin Carpentier

As the demand to integrate Artificial Intelligence into high-stakes environments continues to grow, explaining the reasoning behind neural-network predictions has shifted from a theoretical curiosity to a strict operational requirement. Our…

Machine Learning · Statistics 2026-04-27 Younes Essafouri , Laure Raynaud , Luciano Drozda , Laurent Risser

Graph Anomaly Detection (GAD) is crucial for identifying abnormal entities within networks, garnering significant attention across various fields. Traditional unsupervised methods, which decode encoded latent representations of unlabeled…

Machine Learning · Computer Science 2025-02-26 Jinghan Li , Yuan Gao , Jinda Lu , Junfeng Fang , Congcong Wen , Hui Lin , Xiang Wang

RooFit is a toolkit for statistical modeling and fitting used by most experiments in particle physics. Just as data sets from next-generation experiments grow, processing requirements for physics analysis become more computationally…

Mathematical Software · Computer Science 2023-04-07 Garima Singh , Jonas Rembser , Lorenzo Moneta , David Lange , Vassil Vassilev

Graph anomaly detection (GAD) is a critical task in graph machine learning, with the primary objective of identifying anomalous nodes that deviate significantly from the majority. This task is widely applied in various real-world scenarios,…

Machine Learning · Computer Science 2025-07-03 Xiang Li , Jianpeng Qi , Zhongying Zhao , Guanjie Zheng , Lei Cao , Junyu Dong , Yanwei Yu

Responding to the challenge of detecting unusual radar targets in a well identified environment, innovative anomaly and novelty detection methods keep emerging in the literature. This work aims at presenting a benchmark gathering common and…

Signal Processing · Electrical Eng. & Systems 2021-06-22 Martin Bauw , Santiago Velasco-Forero , Jesus Angulo , Claude Adnet , Olivier Airiau

Diffusion has shown great success in improving accuracy of unsupervised image retrieval systems by utilizing high-order structures of image manifold. However, existing diffusion methods suffer from three major limitations: 1) they usually…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Zhiyong Dou , Haotian Cui , Lin Zhang , Bo Wang

Graph anomaly detection (GAD) has garnered increasing attention in recent years, yet remains challenging due to two key factors: (1) label scarcity stemming from the high cost of annotations and (2) homophily disparity at node and class…

Machine Learning · Computer Science 2026-01-30 Yunhui Liu , Jiashun Cheng , Yiqing Lin , Qizhuo Xie , Jia Li , Fugee Tsung , Hongzhi Yin , Tao Zheng , Jianhua Zhao , Tieke He