REVIEW 14 cited by
Sampling-Based Accuracy Testing of Posterior Estimators for General Inference
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Sampling-Based Accuracy Testing of Posterior Estimators for General Inference
read the original abstract
Parameter inference, i.e. inferring the posterior distribution of the parameters of a statistical model given some data, is a central problem to many scientific disciplines. Generative models can be used as an alternative to Markov Chain Monte Carlo methods for conducting posterior inference, both in likelihood-based and simulation-based problems. However, assessing the accuracy of posteriors encoded in generative models is not straightforward. In this paper, we introduce `Tests of Accuracy with Random Points' (TARP) coverage testing as a method to estimate coverage probabilities of generative posterior estimators. Our method differs from previously-existing coverage-based methods, which require posterior evaluations. We prove that our approach is necessary and sufficient to show that a posterior estimator is accurate. We demonstrate the method on a variety of synthetic examples, and show that TARP can be used to test the results of posterior inference analyses in high-dimensional spaces. We also show that our method can detect inaccurate inferences in cases where existing methods fail.
Forward citations
Cited by 14 Pith papers
-
Dark Matter in Draco and Bo\"otes I: Hints of a Core in an Ultra-Faint Dwarf from Simulation-Based Inference
GraphNPE recovers a significantly lower central density for Boötes I consistent with a core while Draco remains marginally cuspy, and demonstrates that higher-order velocity moments reduce bias in dynamical modeling.
-
Cluster Mass Inference from Galaxy Kinematics
Simulation-based Deep Sets model with neural posterior estimation halves scatter in cluster mass estimates from galaxy kinematics compared to the M-sigma relation.
-
Amortized Simulation-Based Inference of Relativistic Mean-Field Couplings for Neutron-Star Equations of State
Amortized neural posterior estimation reproduces nested sampling constraints on RMF couplings for neutron-star EOS with no bias and generates 30,000 samples in 2.5 seconds.
-
The Degeneracy Distillery
A method called the degeneracy distillery uses symbolic transformations to flatten the Fisher information matrix globally from simulations alone, identifying independent parameter combinations and reducing neural post...
-
Dark Energy Survey Year 3 results: optimized $w$CDM simulation-based inference with weak lensing map-level hybrid statistics
DES Y3 weak lensing analysis with hybrid map-level statistics and simulation-based inference yields S8 = 0.808 ± 0.017, Ωm = 0.325 ± 0.024, and w < -0.766, improving the figure of merit by 60% over prior state-of-the-art.
-
Learning the Universe with cosmological rescaling of merger trees and semi-analytic galaxy formation models
Rescaling merger trees with a halo-profile correction enables cheap generation of galaxy summary statistics across cosmologies using semi-analytic models, matching dedicated simulation accuracy with far fewer base runs.
-
Learning the Universe: Posterior Reliability of Neural Generative Models in High-Dimensional Field-Level Inference of Cosmic Initial Conditions
Generative models for cosmological field-level inference can reproduce posterior means and cross-correlations yet fail to capture correct uncertainty geometry when validated against HMC reference samples.
-
GenSBI: Generative Methods for Simulation-Based Inference in JAX
GenSBI delivers JAX-native implementations of generative SBI methods with transformer backbones and reports near-ideal calibration scores on standard benchmarks.
-
Pre-trained Tabular Foundation Models as Versatile Summary Networks for Neural Posterior Estimation
Pre-trained TabPFN acts as an effective training-free summary network for neural posterior estimation, matching or outperforming standard methods while preserving useful marginal and location information in the posterior.
-
Tokenised Flow Matching for Hierarchical Simulation Based Inference
TFMPE combines likelihood factorisation with tokenised flow matching to enable efficient hierarchical SBI from single-site simulations, producing well-calibrated posteriors at lower computational cost on a new benchma...
-
Gravitational-Wave Parameter Estimation in non-Gaussian noise using Score-Based Likelihood Characterization
Score-based diffusion models learn the empirical distribution of real LIGO noise to enable unbiased gravitational-wave parameter estimation under only an additivity assumption.
-
Statistical Patterns in the Equations of Physics and the Emergence of a Meta-Law of Nature
Physics equation corpora exhibit exponential decay in mathematical operator frequencies, proposed as a meta-law that narrows the space of plausible expressions for symbolic regression.
-
Artifact-Conditioned Interval Diagnostics for Flow-Matching Neural Posterior Estimation in a Controlled Gravitational-Wave Benchmark
In a controlled binary-black-hole benchmark, soft learned artifact-aware interval rescaling (LAIR) reduces marginal calibration error for frequency masks from 0.1195 to 0.0672 but is not uniformly better than raw inte...
-
A Review of Diffusion-based Simulation-Based Inference: Foundations and Applications in Non-Ideal Data Scenarios
A synthesis of diffusion-based simulation-based inference methods that address model misspecification, irregular observations, and missing data in scientific applications.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.