English
Related papers

Related papers: Algorithmic Differentiation for Domain Specific La…

200 papers

Derivative computation is a key component of optimization, sensitivity analysis, uncertainty quantification, and nonlinear solvers. Automatic differentiation (AD) is a powerful technique for evaluating such derivatives, and in recent years,…

Mathematical Software · Computer Science 2025-07-18 Kim Liegeois , Brian Kelley , Eric Phipps , Sivasankaran Rajamanickam , Vassil Vassilev

The need to efficiently calculate first- and higher-order derivatives of increasingly complex models expressed in Python has stressed or exceeded the capabilities of available tools. In this work, we explore techniques from the field of…

Machine Learning · Computer Science 2018-09-27 Bart van Merriënboer , Dan Moldovan , Alexander B Wiltschko

We review the current state of automatic differentiation (AD) for array programming in machine learning (ML), including the different approaches such as operator overloading (OO) and source transformation (ST) used for AD, graph-based…

Machine Learning · Computer Science 2019-01-04 Bart van Merriënboer , Olivier Breuleux , Arnaud Bergeron , Pascal Lamblin

Differentiable programming is a fresh programming paradigm which composes parameterized algorithmic components and trains them using automatic differentiation (AD). The concept emerges from deep learning but is not only limited to training…

Strongly Correlated Electrons · Physics 2019-09-11 Hai-Jun Liao , Jin-Guo Liu , Lei Wang , Tao Xiang

To keep a DSL clean, readable and reusable in different contexts, it is useful to define a separate tagging language. A tag model logically adds information to the tagged DSL model while technically keeping the artifacts separated. Using a…

Software Engineering · Computer Science 2016-06-17 Timo Greifenberg , Markus Look , Sebastian Roidl , Bernhard Rumpe

Automatic differentiation (AD) is a set of techniques that systematically applies the chain rule to compute the gradients of functions without requiring human intervention. Although the fundamentals of this technology were established…

Machine Learning · Computer Science 2025-09-03 Afif Boudaoud , Alexandru Calotoiu , Marcin Copik , Torsten Hoefler

In recent years, formal methods of privacy protection such as differential privacy (DP), capable of deployment to data-driven tasks such as machine learning (ML), have emerged. Reconciling large-scale ML with the closed-form reasoning…

Rigid body dynamics algorithms play a crucial role in several components of a robot controller and simulations. Real time constraints in high frequency control loops and time requirements of specific applications demand these functions to…

Robotics · Computer Science 2013-01-31 Marco Frigerio , Jonas Buchli , Darwin G. Caldwell

In recent years, Deep Learning (DL) has found great success in domains such as multimedia understanding. However, the complex nature of multimedia data makes it difficult to develop DL-based software. The state-of-the art tools, such as…

Programming Languages · Computer Science 2017-01-10 Tian Zhao , Xiaobing Huang , Yu Cao

Existing anomaly detection (AD) methods for tabular data usually rely on some assumptions about anomaly patterns, leading to inconsistent performance in real-world scenarios. While Large Language Models (LLMs) show remarkable reasoning…

Machine Learning · Computer Science 2026-03-31 Hangting Ye , Jinmeng Li , He Zhao , Mingchen Zhuge , Dandan Guo , Yi Chang , Hongyuan Zha

We present MathDSL, a Domain-Specific Language (DSL) for mathematical equation solving, which, when deployed in program synthesis models, outperforms state-of-the-art reinforcement-learning-based methods. We also introduce a quantitative…

Machine Learning · Computer Science 2024-12-12 Sagnik Anupam , Maddy Bowers , Omar Costilla-Reyes , Armando Solar-Lezama

Automatic differentiation---the mechanical transformation of numeric computer programs to calculate derivatives efficiently and accurately---dates to the origin of the computer age. Reverse mode automatic differentiation both antedates and…

Machine Learning · Computer Science 2014-04-30 Atilim Gunes Baydin , Barak A. Pearlmutter

As deep learning models become increasingly bigger and more complex, it is critical to improve model training and inference efficiency. Though a variety of highly optimized libraries and packages (known as DL kernels) have been developed,…

Software Engineering · Computer Science 2024-08-22 Ruixin Wang , Minghai Lu , Cody Hao Yu , Yi-Hsiang Lai , Tianyi Zhang

This paper describes an approach to creating textual syntax for Do- main-Specific Languages (DSL). We consider target meta-model to be the main artifact and hence to be developed first. The key idea is to represent analysis of textual…

Programming Languages · Computer Science 2008-01-09 Andrey Breslav

Generation of software from modeling languages such as UML and domain specific languages (DSLs) has become an important paradigm in software engineering. In this contribution, we present some positions on software development in a model…

Software Engineering · Computer Science 2014-09-09 Bernhard Rumpe , Martin Schindler , Steven Völkel , Ingo Weisemöller

This work-in-progress paper presents our work with a domain specific language (DSL) for tackling the issue of programming robots for small-sized batch production. We observe that as the complexity of assembly increases so does the…

Traditional Digital Signal Processing ( DSP ) compilers work at low level ( C-level / assembly level ) and hence lose much of the optimization opportunities present at high-level ( domain-level ). The emerging multi-level compiler…

Signal Processing · Electrical Eng. & Systems 2025-06-23 Abhinav Kumar , Atharva Khedkar , Aviral Shrivastava

The goal of program synthesis is to automatically generate programs in a particular language from corresponding specifications, e.g. input-output behavior. Many current approaches achieve impressive results after training on randomly…

Machine Learning · Computer Science 2020-01-01 Richard Shin , Neel Kant , Kavi Gupta , Christopher Bender , Brandon Trabucco , Rishabh Singh , Dawn Song

Context: Domain-specific languages (DSLs) enable domain experts to specify tasks and problems themselves, while enabling static analysis to elucidate issues in the modelled domain early. Although language workbenches have simplified the…

Programming Languages · Computer Science 2020-02-17 Johannes Mey , Thomas Kühn , René Schöne , Uwe Aßmann

Data curation tasks that prepare data for analytics are critical for turning data into actionable insights. However, due to the diverse requirements of applications in different domains, generic off-the-shelf tools are typically…

Databases · Computer Science 2024-04-25 Zui Chen , Lei Cao , Sam Madden , Tim Kraska , Zeyuan Shang , Ju Fan , Nan Tang , Zihui Gu , Chunwei Liu , Michael Cafarella