English
Related papers

Related papers: Automatic Differentiation of Algorithms for Machin…

200 papers

Automatic Programming is one of the most important areas of computer science research today. Hardware speed and capability have increased exponentially, but the software is years behind. The demand for software has also increased…

Neural and Evolutionary Computing · Computer Science 2021-10-04 Mihai Oltean

We describe an algorithm for the automated deduction of many $d_2$ differentials in the Adams spectral sequence. We discuss our implementation and the results of the computation.

Algebraic Topology · Mathematics 2022-10-28 Joey Beauvais-Feisthauer

We show how forward-mode automatic differentiation (AD) can be employed within larger reverse-mode computations to dynamically differentiate broadcast operations in a GPU-friendly manner. Our technique fully exploits the broadcast…

Mathematical Software · Computer Science 2018-10-26 Jarrett Revels , Tim Besard , Valentin Churavy , Bjorn De Sutter , Juan Pablo Vielma

Thermodynamic and flash equilibrium calculations are the cornerstones of simulation process calculations. The iterative approach, a widely used nonlinear problem-solving technique, relies on derivative calculations throughout the procedure…

Computational Engineering, Finance, and Science · Computer Science 2023-11-21 Shaoyi Yang

In biological research machine learning algorithms are part of nearly every analytical process. They are used to identify new insights into biological phenomena, interpret data, provide molecular diagnosis for diseases and develop…

Implicit time integration schemes are widely used in computational fluid dynamics numerical codes to speed-up computations. Indeed, implicit schemes usually allow for less stringent time-step stability constraints than their explicit…

Computational Physics · Physics 2019-10-23 François Fraysse , Richard Saurel

Differentiation lies at the core of many machine-learning algorithms, and is well-supported by popular autodiff systems, such as TensorFlow and PyTorch. Originally, these systems have been developed to compute derivatives of differentiable…

Machine Learning · Computer Science 2020-10-27 Wonyeol Lee , Hangyeol Yu , Xavier Rival , Hongseok Yang

The automated categorization (or classification) of texts into predefined categories has witnessed a booming interest in the last ten years, due to the increased availability of documents in digital form and the ensuing need to organize…

Information Retrieval · Computer Science 2021-09-21 Fabrizio Sebastiani

Machine Learning approaches are good in solving problems that have less information. In most cases, the software domain problems characterize as a process of learning that depend on the various circumstances and changes accordingly. A…

Software Engineering · Computer Science 2015-06-26 Saiqa Aleem , Luiz Fernando Capretz , Faheem Ahmed

Quantum algorithms for both differential equation solving and for machine learning potentially offer an exponential speedup over all known classical algorithms. However, there also exist obstacles to obtaining this potential speedup in…

Quantum Physics · Physics 2022-05-03 Bobak T. Kiani , Giacomo De Palma , Dirk Englund , William Kaminsky , Milad Marvian , Seth Lloyd

We demonstrate that automatic differentiation (AD), which has become commonly available in machine learning frameworks, is an efficient way to explore ideas that lead to algorithmic improvement in multi-scale affine image registration and…

Optimization and Control · Mathematics 2025-08-05 Warin Watson , Cash Cherry , Rachelle Lang

We present a machine learning based method for learning first integrals of systems of ordinary differential equations from given trajectory data. The method is model-agnostic in that it does not require explicit knowledge of the underlying…

Machine Learning · Computer Science 2023-02-02 Shivam Arora , Alex Bihlo , Rüdiger Brecht , Pavel Holba

Today, intelligent systems that offer artificial intelligence capabilities often rely on machine learning. Machine learning describes the capacity of systems to learn from problem-specific training data to automate the process of analytical…

Artificial Intelligence · Computer Science 2021-04-15 Christian Janiesch , Patrick Zschech , Kai Heinrich

The foundational theory of differentiation was developed as part of the original release of ACL2(r). In work reported at the last ACL2 Workshop, we presented theorems justifying the usual differentiation rules, including the chain rule and…

Symbolic Computation · Computer Science 2011-10-24 Peter Reid , Ruben Gamboa

Machine learning assumes a pivotal role in our data-driven world. The increasing scale of models and datasets necessitates quick and reliable algorithms for model training. This dissertation investigates adaptivity in machine learning…

Machine Learning · Computer Science 2023-11-20 Slavomír Hanzely

In this work, we introduce a machine/deep learning methodology to solve parametric integrals. Besides classical machine learning approaches, we consider a differential learning framework that incorporates derivative information during…

Machine Learning · Computer Science 2025-12-15 Álvaro Leitao , Jonatan Ráfales

Probabilistic programming has emerged as a powerful paradigm in statistics, applied science, and machine learning: by decoupling modelling from inference, it promises to allow modellers to directly reason about the processes generating…

Machine Learning · Statistics 2019-06-10 Maria I. Gorinova , Dave Moore , Matthew D. Hoffman

A procedure for unfolding the true distribution from experimental data is presented. Machine learning methods are applied for simultaneous identification of an apparatus function and solving of an inverse problem. A priori information about…

Data Analysis, Statistics and Probability · Physics 2011-05-26 Nikolai Gagunashvili

Deep learning has been one of the most prominent machine learning techniques nowadays, being the state-of-the-art on a broad range of applications where automatic feature extraction is needed. Many such applications also demand varying…

Machine Learning · Computer Science 2016-05-25 Yu-An Chung , Hsuan-Tien Lin , Shao-Wen Yang

Change detection is a fundamental task in computer vision that processes a bi-temporal image pair to differentiate between semantically altered and unaltered regions. Large language models (LLMs) have been utilized in various domains for…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Zhenglin Li , Yangchen Huang , Mengran Zhu , Jingyu Zhang , JingHao Chang , Houze Liu