REVIEW 20 cited by
Forward-Mode Automatic Differentiation in Julia
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Forward-Mode Automatic Differentiation in Julia
read the original abstract
We present ForwardDiff, a Julia package for forward-mode automatic differentiation (AD) featuring performance competitive with low-level languages like C++. Unlike recently developed AD tools in other popular high-level languages such as Python and MATLAB, ForwardDiff takes advantage of just-in-time (JIT) compilation to transparently recompile AD-unaware user code, enabling efficient support for higher-order differentiation and differentiation using custom number types (including complex numbers). For gradient and Jacobian calculations, ForwardDiff provides a variant of vector-forward mode that avoids expensive heap allocation and makes better use of memory bandwidth than traditional vector mode. In our numerical experiments, we demonstrate that for nontrivially large dimensions, ForwardDiff's gradient computations can be faster than a reverse-mode implementation from the Python-based autograd package. We also illustrate how ForwardDiff is used effectively within JuMP, a modeling language for optimization. According to our usage statistics, 41 unique repositories on GitHub depend on ForwardDiff, with users from diverse fields such as astronomy, optimization, finite element analysis, and statistics. This document is an extended abstract that has been accepted for presentation at the AD2016 7th International Conference on Algorithmic Differentiation.
Forward citations
Cited by 20 Pith papers
-
Stable and Scalable Probabilistic Numerical Solvers for Stiff and High-Dimensional ODEs
Develops matrix-free Jacobian-vector product updates and iterative re-linearization to achieve stable, linearly scaling probabilistic solvers for stiff high-dimensional ODEs.
-
Stochastic Differential Dynamic Programming for Trajectory Optimization under Partial Observability
A new stochastic differential dynamic programming method optimizes coupled trajectory design and orbit determination under partial observability, producing navigation-aware solutions with lower fuel consumption than d...
-
Stochastic Differential Dynamic Programming for Trajectory Optimization under Partial Observability
Introduces a stochastic DDP algorithm that optimizes nominal controls and feedback gains for belief-state trajectory problems under partial observability without relying on the separation principle.
-
Admissible Lax-Wendroff Flux Reconstruction Method with Automatic Differentiation on Adaptive Curved Meshes for Relativistic Hydrodynamics
An admissible Lax-Wendroff flux reconstruction method with automatic differentiation and subcell blending enables robust high-order simulations of relativistic hydrodynamics on adaptive curved meshes.
-
Kolmogorov-Arnold Chemical Reaction Neural Networks for learning pressure-dependent kinetic rate laws
KA-CRNNs learn pressure-dependent and collider-specific kinetic rate laws from data using Kolmogorov-Arnold activations inside a CRNN framework, outperforming interpolative methods by 2.88x in MSE on two proof-of-conc...
-
Optimal linear response for Anosov diffeomorphisms
Develops an optimization framework for the linear response of SRB measures to perturbations of Anosov diffeomorphisms, proving uniqueness of the optimal perturbation for non-degenerate cases, giving explicit Fourier c...
-
Invariant Image Reparameterisation: Bridging Symbolic and Numerical Methods for Identifiability Analysis, Model Reduction, and Prediction
IIR shows that under a one-to-one componentwise transformation where observables depend on fixed linear combinations of transformed parameters, a single numerical Jacobian determines the lower-dimensional reparameteri...
-
ModelPredictiveControl.jl: advanced process control made easy in Julia
The paper presents ModelPredictiveControl.jl, an open-source Julia toolkit for model predictive control including nonlinear, economic, and successive linearization variants, illustrated with CSTR and inverted pendulum...
-
Universal Differential Equations for Scientific Machine Learning
Universal Differential Equations unify scientific models with machine learning by embedding flexible approximators into differential equations, enabling applications from biological mechanism discovery to high-dimensi...
-
PAC-Bayesian Certificates for Quadratic Closed-Loop Control
PAC-Bayesian bounds are derived for quadratic closed-loop control via SLS parameterization, yielding Chernoff certificates for posteriors over responses, a mean-response deployment result, and a data-driven learning a...
-
Computing resonances of perturbed Schr\"odinger equations: Application to Reissner-Norsdtr\"om-de Sitter black holes
Numerical method finds resonances in perturbed Schrödinger equations via Wronskian zeros of reference Jost solutions and applies it to RNdS black holes to study perturbation effects and cosmic censorship.
-
Propagating data-driven galaxy redshift distribution uncertainties in 3$\times$2-pt analyses
A five-parameter PCA model for n(z) uncertainties in Stage-IV 3x2-pt analyses degrades the S8 constraint by only 5% relative to shift-stretch models while halving biases on Omega_m and sigma_8, and all tested models a...
-
Sensitivities of Black Hole Images from GRMHD Simulations
Differentiable GRMHD image sensitivities create a structured error landscape that supports gradient-based parameter recovery for black hole imaging under idealized and noisy conditions.
-
Learning continuous state of charge dependent thermal decomposition kinetics for Li-ion cathodes using Kolmogorov-Arnold Chemical Reaction Neural Networks (KA-CRNNs)
KA-CRNN learns continuous SOC-dependent kinetic parameters for cathode-electrolyte decomposition directly from DSC data, reproducing heat-release features across all SOCs for NCA, NM, and NMA cathodes.
-
Learning Post-Newtonian Corrections from Numerical Relativity
A PINN learns higher-order corrections to the TaylorT4 PN model from eight NR surrogate waveforms, reducing phase and amplitude errors in the inspiral while enforcing physical symmetries.
-
Action-Gradient Monte Carlo Tree Search for Non-Parametric Continuous (PO)MDPs
AGMCTS augments MCTS with action-score gradients for particle beliefs, a Multiple Importance Sampling tree for reuse, and Area Formula gradients for smooth models, outperforming prior sample-based solvers on continuou...
-
Constrained Policy Optimization for Stochastic Optimal Control under Nonstationary Uncertainties
Constrained policy optimization for stochastic optimal control under nonstationary uncertainties via Markov embeddability and finite approximation.
-
A numerical analysis focused comparison of several Finite Volume schemes for an Unipolar Degenerated Drift-Diffusion Model
Four finite volume schemes based on different flux formulations are proposed for a degenerated drift-diffusion system, with stability and existence shown for all four and convergence proven for two, plus numerical exp...
-
Automatic Differentiation for Adjoint Stencil Loops
A method for adjoint differentiation of stencil loops that preserves their structure and parallelizability via combined AD and loop transformations, released as the PerforAD tool with seismic and CFD test cases.
-
Propagating data-driven galaxy redshift distribution uncertainties in 3$\times$2-pt analyses
Simulations show 5-parameter PCA n(z) uncertainty models degrade S8 constraints by only 5% versus shift-stretch while halving bias in Omega_m and sigma_8, and all models allow safe analytical marginalization with up t...
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.