The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo
read the original abstract
Hamiltonian Monte Carlo (HMC) is a Markov chain Monte Carlo (MCMC) algorithm that avoids the random walk behavior and sensitivity to correlated parameters that plague many MCMC methods by taking a series of steps informed by first-order gradient information. These features allow it to converge to high-dimensional target distributions much more quickly than simpler methods such as random walk Metropolis or Gibbs sampling. However, HMC's performance is highly sensitive to two user-specified parameters: a step size {\epsilon} and a desired number of steps L. In particular, if L is too small then the algorithm exhibits undesirable random walk behavior, while if L is too large the algorithm wastes computation. We introduce the No-U-Turn Sampler (NUTS), an extension to HMC that eliminates the need to set a number of steps L. NUTS uses a recursive algorithm to build a set of likely candidate points that spans a wide swath of the target distribution, stopping automatically when it starts to double back and retrace its steps. Empirically, NUTS perform at least as efficiently as and sometimes more efficiently than a well tuned standard HMC method, without requiring user intervention or costly tuning runs. We also derive a method for adapting the step size parameter {\epsilon} on the fly based on primal-dual averaging. NUTS can thus be used with no hand-tuning at all. NUTS is also suitable for applications such as BUGS-style automatic inference engines that require efficient "turnkey" sampling algorithms.
This paper has not been read by Pith yet.
Forward citations
Cited by 40 Pith papers
-
Atmospheric asymmetries in WASP-121 b revealed by rotational transits detected with JWST
Rotational transits of WASP-121 b observed with JWST/NIRSpec and NIRISS show asymmetric light curves and phase-dependent molecular absorption revealing stronger evening than morning terminator temperature gradients.
-
Gaussian processes on ray-guided transformed uniform grids for fast, flexible, and auto-differentiable adaptive source reconstruction in lens modelling
A new RTU grid method models the lensing source as a Gaussian process on a ray-transformed uniform grid, achieving comparable fits with roughly half the pixels per dimension and higher ELBOs on mock data.
-
A hierarchical Bayesian framework for cosmology using Type 1 AGN variability
A hierarchical Bayesian framework that uses the empirical anti-correlation between AGN variability amplitude and luminosity to infer cosmological parameters from moderate-baseline light curves via importance reweighting.
-
Expected Free Energy-based Planning as Variational Inference
EFE-based planning is formulated as variational free energy minimization with epistemic priors, decomposing into expected plan costs plus a complexity term.
-
What Type of Inference is Active Inference?
EFE-based active inference planning is characterized as VFE on an augmented model plus entropy and planning corrections, with a derived message-passing implementation and grid-world validation.
-
Multifrequency Synthesis via CHIBI: Colorful Hierarchical Interferometric Bayesian Imaging
CHIBI is a new hierarchical Bayesian method for multifrequency synthesis radio imaging based on synchrotron spectral parametrization, demonstrated on VLBA MOJAVE data and simulated EHT observations of M87*.
-
High-Dimensional Bayesian Calibration of Expensive Nuclear Models with Differentiable Emulation
DREAM enables exact-gradient Bayesian calibration of nuclear models via offline SVD emulation of parameter-dependent operators, demonstrated by rapid HMC convergence on an 18-parameter CDCC analysis of d+58Ni scattering.
-
Bayesian Doppler Imaging: Simultaneous Inference of Surface Maps and Geometric Parameters
A fully Bayesian pixel-based Doppler imaging framework uses Gaussian Process priors and Hamiltonian Monte Carlo to simultaneously infer surface maps and geometric parameters from spectral data.
-
High-dimensional inference for the $\gamma$-ray sky with differentiable programming
A differentiable forward model and likelihood enable probabilistic inference over many spatial morphologies for the Galactic Center gamma-ray Excess using variational methods on GPUs.
-
People readily follow personal advice from AI but it does not improve their well-being
Large longitudinal RCT finds high rates of following AI personal advice but no sustained well-being gains versus a hobbies control condition.
-
Differentiable Fuzzy Cosmic-Web for Field Level Inference
Introduces HICOBIAN, a differentiable fuzzy hierarchical cosmic-web bias model using sigmoid gradients for smooth region transitions, enabling accurate Bayesian field-level reconstruction of primordial density fields ...
-
HIcosmo: a differentiable JAX-based framework for cosmology inference
HIcosmo is a new JAX-based differentiable framework for background cosmology inference that matches Cobaya results while delivering 8.7x CPU and up to 20x GPU speedups.
-
From Lab to Landscape: Assessing the Impact of Pesticides on Pollinator Populations Based on Laboratory Data by Combining ALMaSS and BufferGUTS
The authors integrate BufferGUTS with ALMaSS to simulate Osmia bicornis population dynamics under sulfoxaflor exposure from lab-calibrated parameters, reporting negligible population effects at high application rates ...
-
Towards Practical Field-Level Inference for Weak Lensing
Field-level inference from weak lensing maps yields significantly tighter cosmological constraints than power-spectrum analysis when using the same forward-modeling pipeline, especially on small scales.
-
Calibration of an Analog-to-Digital Conversion Nonlinearity in JWST/NIRISS
A data-driven model for periodic ADC integral nonlinearity in JWST/NIRISS is fitted to ramp residuals and applied to correct the ERS1366 WASP-39b transmission spectrum, reducing systematics at the 30ppm level.
-
Evidence for mass-dependent spin subpopulations in GWTC-4
GWTC-4 data supports two mass-dependent spin subpopulations: low-mass binaries mostly slow-spinning, high-mass ones dominated by moderate-to-rapid spins with transition from 35 to 70 solar masses.
-
A Strongly Parametrized Mass Ratio Model for the Stable Mass Transfer Channel: a Case Study of the $10 \, \rm{M}_{\odot}$ Peak
A parametrized analytical model for BBH mass ratios from the stable mass transfer channel is derived and applied to the 10 solar-mass peak in GWTC-4, favoring little mass-ratio reversal.
-
On the Reparameterization Between Cartesian Position-Velocity Vectors and Orbital Elements in the Kepler Problem
Compact analytic Jacobians are derived for reparameterizing Keplerian orbits between orbital elements and Cartesian states, correcting a singularity in the Skowron et al. (2011) microlensing model and improving MCMC e...
-
A renormalization-group inspired lattice-based framework for piecewise generalized linear models
RG-inspired lattice models for piecewise GLMs provide explicit interpretable partitions and a replica-analysis-derived scaling law for regularization that allows increasing complexity without expected rise in generali...
-
Tokenised Flow Matching for Hierarchical Simulation Based Inference
TFMPE combines likelihood factorisation with tokenised flow matching to enable efficient hierarchical SBI from single-site simulations, producing well-calibrated posteriors at lower computational cost on a new benchma...
-
A unified harmonic framework for dark siren cosmology
The GW-galaxy cross-correlation method, unified with spectral sirens in a harmonic framework, can measure H0 to 1% and Omega_m to 5% precision with 2 years of data from next-generation detectors like Einstein Telescop...
-
Stochastic gravitational-wave background search using data from five pulsar timing arrays
Combined five-PTA dataset yields posterior on SGWB power-law amplitude and index consistent with nonzero signal but below 5-sigma significance, with reconstructed angular correlations matching the Hellings-Downs prediction.
-
Conversational AI increases political knowledge as effectively as self-directed internet search
Conversational AI matches self-directed internet search in increasing belief in true political information and decreasing belief in misinformation.
-
Sifting for a Stream: The Morphology of the $300S$ Stellar Stream
300S stellar stream exhibits three density peaks, smooth width variations, a possible 4.7 degree gap, and a kink modeled as resulting from Large Magellanic Cloud interaction across its full known footprint.
-
DESI 2024 V: Full-Shape Galaxy Clustering from Galaxies and Quasars
DESI DR1 full-shape galaxy clustering constrains Omega_m = 0.296 ± 0.010, H0 = 68.63 ± 0.79 km/s/Mpc, and sigma_8 = 0.841 ± 0.034, consistent with LambdaCDM and Planck.
-
dynesty: A Dynamic Nested Sampling Package for Estimating Bayesian Posteriors and Evidences
dynesty is an open-source Python package for dynamic nested sampling that improves efficiency in Bayesian posterior and evidence estimation compared to MCMC on certain problems.
-
The HST/WFC3 Transmission Spectrum of AU Mic b Part I: An Atmosphere Obscured by Contamination and Systematics
The transmission spectrum of AU Mic b is dominated by the transit light source effect from stellar spots, yielding only weak atmospheric constraints with a preferred scale height below 185 km.
-
Posterior sampling in the Age of Emulators
Compares MH, MALA, HMC, NUTS, and AIES on differentiable likelihood emulators for ΛCDM and sterile-neutrino models, finding MALA and MH competitive in wall time despite NUTS needing fewer samples.
-
Multimodal Transformer Based Generic Mixture Density Network for Scattering Timescale Estimation of Fast Radio Bursts
A multimodal transformer-based generic mixture density network estimates FRB scattering timescale τ with 94% R² on measurable events and 90% recall for unresolvable cases on CHIME/FRB data.
-
Constraining Gravitational Wave Memory with Hierarchical Inference
Hierarchical Bayesian inference on GWTC-5.0 constrains the memory enhancement factor to 0.26 with large uncertainties consistent with the GR value of 1 and forecasts that 2000 detections are needed for a 1σ constraint...
-
StanBKT: Rethinking Parameter Estimation in Bayesian Knowledge Tracing
StanBKT provides a unified Bayesian inference framework for BKT models supporting HMC, variational inference, and hierarchical variants, evaluated on ASSISTments and intervention datasets.
-
Gravitational-wave constraints on $H_0$ are robust to (putative) redshift evolution in the binary black hole mass spectrum at current sensitivity
Spectral-siren H0 constraints from GWTC-4.0 binary black holes remain robust when the mass spectrum is permitted to evolve with redshift at current detector sensitivity.
-
QCD-factorization amplitudes from flavour symmetries: beyond the $SU(3)$ symmetric case
A data-driven SU(3)-breaking analysis of B to PP decays yields QCD-factorization amplitudes that resemble dynamical predictions and require no enhanced annihilation terms.
-
Bathymetry Reconstruction by Bayesian Inference
Bayesian inference reconstructs bathymetry from point water height measurements, improving NRMSE over adjoint optimization on real wave flume data while quantifying uncertainty.
-
Determining the Host Stars of Planets in Binary Star Systems with Asterodensity Profiling: Investigating the Canonical Radius Gap
Probabilistic host-star assignments via asterodensity profiling suggest the exoplanet radius gap is less empty in binary systems once possible circumsecondary planets are included.
-
Discovery of a compact hierarchical triple main-sequence star system while searching for binary stars with compact objects
A new compact hierarchical triple main-sequence star system G1010 was discovered through combined low- and high-SNR spectroscopy, Gaia DR3 data, and TESS light curve analysis, showing an inner eclipsing binary rather ...
-
Symbolic Emulators for Cosmology: Accelerating Cosmological Analyses Without Sacrificing Precision
Symbolic emulators approximate key Lambda CDM functions to 0.001-0.05% accuracy across relevant redshifts and Omega_m values, enabling faster 3x2pt inference with consistent results.
-
Deployable probabilistic programming
Design guidelines and a Go library (Infergo) for deploying probabilistic programming in production systems, with benchmark comparisons.
-
Extended Structure in E+A Galaxies Via Image Stacking
Image stacking of 57 E+A galaxies shows excess extended light relative to comparison samples, consistent with faint tidal features from small-scale interactions.
-
Revisiting the Exo-Mercury Candidate GJ 367 b with ESPRESSO and a Self-Consistent Tidal Distortion Model
Revised mass of 0.503 M_Earth and radius of 0.736 R_Earth for GJ 367 b give a density of 6.9 g cm^{-3} and an iron fraction of 50-70% via new tidal and composition modeling.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.