Array Programming with NumPy
Pith reviewed 2026-05-19 08:27 UTC · model grok-4.3
The pith
NumPy uses a small set of array concepts to create a powerful paradigm for scientific data analysis.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that a few fundamental array concepts lead to a simple and powerful programming paradigm for organizing, exploring, and analyzing scientific data. NumPy is the primary library implementing this in Python and acts as the foundation for the entire scientific Python universe. It increasingly serves as an interoperability layer between new array computation libraries developed for specialized needs.
What carries the argument
The ndarray object and the array programming operations built on top of it, which enable vectorized computations and broadcasting across dimensions.
If this is right
- Scientific workflows in astronomy can incorporate NumPy for tasks like gravitational wave detection.
- New array libraries can interoperate with existing code by adopting NumPy-like interfaces.
- Data analysis in fields such as biology and finance becomes more accessible through consistent array syntax.
- Research pipelines gain efficiency by avoiding low-level data manipulation code.
Where Pith is reading between the lines
- Developers of future scientific software might prioritize compatibility with these array concepts to maximize adoption.
- Teaching scientific computing could focus on array thinking as a primary skill rather than language-specific features.
- If array programming proves this general, similar concepts could be adapted to other programming languages for broader impact.
Load-bearing premise
That the presented fundamental array concepts alone suffice for data handling in all mentioned scientific domains without needing domain-specific additions or performance optimizations.
What would settle it
Finding a scientific analysis task in one of the fields like chemistry or economics that requires structures beyond basic arrays or cannot be expressed efficiently with NumPy operations.
read the original abstract
Array programming provides a powerful, compact, expressive syntax for accessing, manipulating, and operating on data in vectors, matrices, and higher-dimensional arrays. NumPy is the primary array programming library for the Python language. It plays an essential role in research analysis pipelines in fields as diverse as physics, chemistry, astronomy, geoscience, biology, psychology, material science, engineering, finance, and economics. For example, in astronomy, NumPy was an important part of the software stack used in the discovery of gravitational waves and the first imaging of a black hole. Here we show how a few fundamental array concepts lead to a simple and powerful programming paradigm for organizing, exploring, and analyzing scientific data. NumPy is the foundation upon which the entire scientific Python universe is constructed. It is so pervasive that several projects, targeting audiences with specialized needs, have developed their own NumPy-like interfaces and array objects. Because of its central position in the ecosystem, NumPy increasingly plays the role of an interoperability layer between these new array computation libraries.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript is an expository overview of array programming in Python centered on NumPy. It describes how fundamental array concepts (indexing, broadcasting, ufuncs, and structured arrays) yield a compact syntax for data manipulation, positions NumPy as the foundational library for scientific Python across physics, astronomy, biology and other domains, and notes its emerging role as an interoperability layer for domain-specific array libraries. Real-world examples include its use in gravitational-wave detection and black-hole imaging pipelines.
Significance. If the descriptive account holds, the paper supplies a concise, accessible reference that documents NumPy’s design rationale and ecosystem centrality. Its explicit discussion of NumPy-like interfaces in other projects and the interoperability layer function provides a useful framing for future library development. The concrete scientific examples add credibility and illustrate practical impact without requiring new empirical claims.
minor comments (2)
- The abstract and introduction both state that NumPy is 'the foundation upon which the entire scientific Python universe is constructed.' A brief qualifier noting the existence of alternative array back-ends (already mentioned later) would avoid any appearance of overstatement in the opening paragraphs.
- Section on historical development would benefit from one additional sentence clarifying the relationship between the original Numeric and Numarray projects and the final NumPy unification, to help readers new to the ecosystem.
Simulated Author's Rebuttal
We thank the referee for their positive and constructive review. Their summary correctly identifies the manuscript's focus on the core array programming concepts in NumPy and its foundational role across scientific domains. We are pleased that the referee recognizes the value of the interoperability discussion and the concrete scientific examples.
Circularity Check
No significant circularity in derivation chain
full rationale
The manuscript is an expository overview of NumPy's array programming model, its API, and its historical adoption across scientific domains. It contains no derivations, first-principles results, predictions, or mathematical equations that could be inspected for reduction to inputs by construction. Claims regarding NumPy's foundational role are presented descriptively with concrete usage examples rather than as outputs of any fitted model or self-referential argument. No self-citation chains, ansatzes, or uniqueness theorems are invoked as load-bearing steps. The text is therefore self-contained against external benchmarks and receives the default non-circularity finding.
Axiom & Free-Parameter Ledger
axioms (1)
- domain assumption A small set of array shape and operation rules is sufficient to support data work in the listed scientific domains.
Forward citations
Cited by 60 Pith papers
-
GW240925 and GW250207: Astrophysical Calibration of Gravitational-wave Detectors
The first informative astrophysical calibration of gravitational-wave detectors is reported using GW240925 and GW250207.
-
Gravity Echoes from Supermassive Black Hole Binaries
Future microhertz detections combined with nanohertz pulsar terms can serve as gravity echoes to measure supermassive black hole binary inspiral rates from hundreds to thousands of years in the past.
-
Native-resolution retrievals of VHS 1256-1257 b spanning the JWST/NIRSpec wavelength range: Chemical composition of a partially cloudy atmosphere
Native-resolution retrievals on 0.97-5.27 micron JWST spectra of VHS 1256 b find a ~79% cloud deck, solar-like metallicity and C/O, and depleted 18O in a partially cloudy disequilibrium atmosphere.
-
Sampling the Schwinger Model with Gauge-Equivariant Diffusion
A gauge-equivariant diffusion model samples Schwinger model configurations, yielding unbiased observables matching MCMC and qualitatively less topological freezing than HMC.
-
IllustrisTNG50 angular momentum maps: tracing the morpho-kinematic evolution of galaxies
TNG50 stellar disks are grouped into four j-types from sAM surface density maps, revealing a redshift-dependent sequence from irregular to barred forms driven by gas content and V/σ.
-
A robust super-time-stepping scheme for Ohmic and ambipolar diffusion
A Runge-Kutta-Gegenbauer super-time-stepping method for stable, efficient handling of anisotropic non-ideal MHD diffusion.
-
Tests of general relativity at the fourth post-Newtonian order with GW230627 and GW250114
Bayesian analysis of GW230627 and GW250114 finds no deviation from GR at 4PN and 4.5PN orders, setting the first empirical baseline with 90% intervals of order O(1)-O(10).
-
Nonthermal line broadening at solar flare footpoints is primarily field-aligned
Nonthermal line broadening at solar flare footpoints is primarily field-aligned, demonstrated by systematic decrease in line widths from disk center to limb across 4,593 Hinode/EIS spectra from 407 flares.
-
The Origin of Da Scaling: Suppressed Cooling in Fast-Cooling Mixing Layers
Ram-pressure suppression of interface folding in fast-cooling TRMLs produces Ė_cool ∝ Da^{1/4} scaling.
-
Ceci n'est pas une Couche de M\'elange: The Meaning of Resolved Turbulent Radiative Mixing
The resolution independence of cooling rates in TRML simulations is an artifact of opposing numerical effects with no physical basis, and phase structure converges only when the turbulent Field length (where eddy turn...
-
The CRIMSON survey I: super-stellar SiO in the directly imaged companion TWA 5 B from high-resolution M-band spectroscopy
High-resolution M-band spectroscopy detects super-stellar SiO in TWA 5 B, implying no significant magnesium-silicate clouds and formation consistent with core accretion beyond the CO snowline or gravitational instabil...
-
NOEMA$^\rm{3D}$: A deep view of cold gas flows in a barred spiral galaxy at $z\sim1$
Deep interferometric observations of a z≈1.12 barred spiral reveal bar-driven molecular inflows at a rate matching the galaxy's star formation rate of ~36 M⊙/yr.
-
The Causal Bootstrap: Bounding Smeared Spectral Functions from Non-Perturbative Euclidean Data
The causal bootstrap computes rigorous bounds on smeared spectral functions from non-perturbative Euclidean data by optimizing over the convex set of compatible positive spectral densities and reducing dual problems t...
-
From mass-loss histories to lightcurves: a generalised framework for interaction-powered transients
Introduces a generalized fast framework for modeling interaction-powered transients with arbitrary CSM profiles and multi-wavelength outputs.
-
Neural network quantum states in the grand canonical ensemble
A new neural quantum state ansatz for bosons in the grand canonical ensemble achieves competitive variational energies in 1D and 2D systems and provides access to one-body reduced density matrices.
-
Measuring neutrino mass and asymmetry through galaxy pairwise peculiar velocity
Galaxy pairwise peculiar velocities from Cosmicflows-4 yield M_ν = 0.24^{+0.34}_{-0.18} eV and η² = 2.14^{+0.30}_{-0.32} (7σ non-zero asymmetry) in the CMB framework, consistent with prior Planck results.
-
Probing Solar Symmetrons with Direct Detection
Solar tachocline production of symmetrons yields a keV-scale flux at Earth whose absorption in xenon detectors provides new complementary bounds on symmetron parameter space.
-
PlotChain: Deterministic Checkpointed Evaluation of Multimodal LLMs on Engineering Plot Reading
PlotChain benchmark reports top MLLMs reaching ~80% field-level accuracy on engineering plot reading under human-like tolerances, but with persistent failures on frequency-domain tasks like bandpass and FFT spectra.
-
Assembly bias and the redshift evolution of intrinsic alignments for LRGs
FLAMINGO simulation analysis shows IA amplitude for LRGs depends on halo assembly history and exhibits redshift evolution beyond mass effects, yielding an empirical mass-redshift model.
-
The evolution of the galaxy gas-phase mass-metallicity relation from $z=15$ to $z=0$ in the COLIBRE cosmological simulations
COLIBRE simulations find the galaxy gas-phase MZR already in place at z≈10 with little evolution until z≈5, then shallowens at low z, with high-mass turnover set by AGN feedback and low-mass end by core-collapse supernovae.
-
Modeling Gamma-Ray Burst Spectra with Convolutional Neural Networks: Fast-Cooling Synchrotron Emission in a Decaying Magnetic Field
CNN emulator for decaying magnetic field fast-cooling synchrotron spectra is trained on synthetic data and used in Bayesian fits to GRB 231020A, favoring the decaying-field model over the standard version.
-
A nine-member protostellar system forming via filament fragmentation in the high mass protocluster NGC 6334-43
Serendipitous discovery of a bound nine-member protostellar system in NGC 6334-43 formed by filament fragmentation, with outflows from two sources and virial masses derived for three cores.
-
21cmEMUv3: a hybrid diffusion-LSTM emulator of 21cmFAST summary observables
21cmEMUv3 emulates the cylindrical 21cm power spectrum via score-based diffusion and six other 21cmFAST observables via LSTM networks at sub-percent accuracy, then uses the emulator to infer a lower limit on soft-band...
-
RooAgent: An LLM Agent for Root-Based High Energy Physics Analysis
RooAgent provides an LLM agent interface that translates natural-language prompts into calls to PyROOT analysis functions for high energy physics tasks, with support for multiple AI backends and tested on ZH simulatio...
-
CMB Limits on the Absorption of Light Vector and Axial-Vector Dark Matter
Planck CMB data set upper limits on vector and axial-vector dark matter-electron couplings for masses 100 eV to 100 keV via energy injection from inelastic scattering and hydrogen absorption.
-
Effects of magnetically driven shocks on nucleosynthesis and kilonovae from neutron star mergers
Magnetically driven shocks from neutron star merger remnants can reheat ejecta to nuclear statistical equilibrium, alter r-process yields, and produce observable changes in kilonova color and light curves.
-
A data-driven prediction for the primordial deuterium abundance
Gaussian process regression on nuclear data predicts 10^5 D/H = 2.442 ± 0.040, 1.70 sigma below observation and consistent with first-principles calculations.
-
Constraining Inflationary Particle Production with CMB Polarization
No evidence for primordial hotspots in Planck polarization data leads to improved bounds on inflationary particle production couplings for light particles.
-
JWST spectroscopy of galaxies at $z>10$: Damped Ly$\alpha$ absorbers reveal efficient star formation and hidden redshift biases
Analysis of JWST/NIRSpec Prism spectra for 25 z>=10 galaxies finds burstiness correlates with strong UV lines, short depletion times, and DLA-induced redshift biases of 0.39 and 0.14 with marginal impact on UV luminos...
-
The Impact of Non-Gaussian Line Spread Functions on Stellar Kinematic Recovery: Consequences for Dynamical Models
Non-Gaussian LSF shapes bias kinematic extraction from spectra; matching the LSF of templates to the target reduces dispersion bias below 1%.
-
TOA_SP: A Multi-Strategy Framework for Single-Pulse Timing
toa_sp applies multiple single-pulse timing strategies to 688 pulses from RRAT J1913+1330, yielding 1.33 ms weighted RMS residuals (24% better than PSRCHIVE) while keeping all pulses.
-
Signatures of $^{56}$Ni Mixing and Neutron-rich Ejecta in Supernovae
Multi-shell modeling shows outward 56Ni mixing produces faster brighter rises and biases one-zone fits to lower ejecta mass and higher nickel fraction, while r-process signatures in collapsars depend on placement, dis...
-
Accelerating Discovery: Model-Agnostic Likelihoods for the Reinterpretation of Particle Physics Results and their Application to the Belle II $B^{+}\to K^{+}\nu\bar{\nu}$ Measurement
A reweighting method creates model-agnostic likelihoods from histogram analyses, applied to Belle II B+ to K+ nu nubar data for WET constraints and light new physics searches.
-
Kernel transformations and bounds for smeared spectral functions
Framework for exact and approximate kernel transformations between smeared spectral functions, including systematic error bounds computable from input data.
-
AGN-driven BBH mergers: Black hole populations and hierarchical growth across the AGN parameter space
Semi-analytical models show AGN disks produce repeated BBH mergers with a high-mass tail beyond the pair-instability gap, more efficiently at low viscosity, with spin and mass-ratio signatures that can match events li...
-
Satellite compaction pathways: environmental drivers shaping dwarf galaxy corpulence in the TNG50 simulation
In TNG50, compact dwarf satellites (log M_star 8.4-9.2) form via DM-rich gas inflows in low-merger environments, tidal stripping for DM-poor cases, and ram-pressure starbursts for some metal-rich ones.
-
Line-of-sight acceleration in compact binaries with higher harmonics and eccentricity
Implements consistent line-of-sight acceleration corrections in quasi-circular and eccentric GW waveform models, applies them to GWTC-3 events, and reports no substantial evidence for acceleration while warning of bia...
-
Sky-Plane Velocity Distributions of Interstellar Objects and Implications for Their Detection
An analytic sky-motion formula applied to synthetic interstellar object populations indicates that high velocities, particularly for dim objects, may cause many to go undetected, implying a larger galactic population ...
-
Non-linear Dynamical Stability of Magnetic Polytropes
A mean-field magnetic polytrope model shows radiation pressure can unbind an n=3 polytrope when the central overpressure exceeds roughly 0.15 times a mass-dependent factor under small radial perturbations.
-
Biased parameter inference of eccentric, spin-precessing binary black holes
Eccentric BBH signals recovered with quasi-circular precessing models show biases in chirp mass and χ_p; Bayes factors favor eccentric aligned-spin models when both eccentricity and precession are present.
-
Binary black holes in the heat of merger
Develops a frequency-domain approximant for tidal heating in nonspinning black hole binaries that extends to merger and includes horizon parameters.
-
Tests of General Relativity with Binary Black Holes from the second LIGO-Virgo Gravitational-Wave Transient Catalog
No evidence for deviations from general relativity is found in LIGO-Virgo binary black hole events, with improved constraints on waveform parameters, graviton mass, and ringdown properties.
-
SN 2023rve: A Type II Supernova with No Nebular Oxygen
SN 2023rve exhibits absent [O I] nebular lines with inferred 14-18 solar mass progenitor, 0.27e51 erg explosion energy, and 0.0064 solar mass nickel, possibly indicating partial fallback.
-
The ESO SupJup Survey XI. Atmospheric properties of six isolated M- and L-type dwarfs with CRIRES+
Retrievals on six isolated brown dwarfs yield near-solar C/O (0.51-0.63), metallicities, and 12C/13C ratios (91-155) supporting molecular cloud fragmentation origin.
-
Early phases of star formation with SKAO: synchrotron emission from dense starless cores in molecular clouds
SKAO will enable detection of synchrotron emission from prestellar cores to probe their magnetic field properties in nearby star-forming regions.
-
Tracing Large-scale Structure with the MeerKLASS On-the-Fly Survey: Angular Clustering of Radio Sources at 816 MHz
First measurement of angular clustering w(theta) for radio sources at 816 MHz over 800 deg2 yields positive signal and effective bias 1.53-2.0 depending on N(z) prior.
-
Constraints on Cosmic Strings from the Curl-Mode CMB Lensing Power Spectrum measured by ACT DR6
ACT DR6 curl lensing yields 2σ bounds Gμ P^{-1} ≤ 3.5×10^{-5} (small-P) and Gμ ≤ 5.0×10^{-5} (P=1), tightened further with Planck 2013 data.
-
The Effects of Cosmic Ray Protons on Galactic Nonthermal Filaments
MHD simulations of proton- versus lepton-dominated cosmic rays in nonthermal filaments show minimal observable differences and motivate a turbulence-based formation scenario for Galactic Center NTFs.
-
Shape of U: Measuring the Curvature of the Universe with Gravitational Waves
Next-generation GW detector networks can constrain the spatial curvature parameter Ω_k to 1σ uncertainty of 0.029 using intermediate-mass binary black hole bright sirens.
-
AstroSkyFlow: an astronomical sky image flow simulator for time domain survey validation and machine learning
AstroSkyFlow generates simulated time-series astronomical images with realistic noise and variability, outperforming SkyMaker in noise and PSF reproduction while recovering injected signals such as exoplanet transits ...
-
Unitaria: Quantum Linear Algebra via Block Encodings
Unitaria is a new open-source Python library that provides a high-level, composable interface for block encodings in quantum computing, enabling automatic circuit generation and classical simulation-based verification.
-
VIGILant: an automatic classification pipeline for glitches in the Virgo detector
VIGILant applies tree-based models and a ResNet CNN to classify Virgo O3b glitches with 98% accuracy and has been deployed for daily use with an interactive dashboard.
-
Mitigating gain calibration errors from EoR observations with SKA1-Low AA*
Simulations show hybrid foreground mitigation (GPR + PCA combined with avoidance) recovers the HI 21cm signal within 2σ for gain calibration errors ≤1% in SKA1-Low AA* observations over 0.05-0.5 Mpc^{-1} scales.
-
Cosmic Birefringence from the Atacama Cosmology Telescope Data Release 6
Bayesian analysis of ACT DR6 CMB polarization data measures cosmic birefringence angle β = 0.215° ± 0.074° excluding zero at 2.9σ, consistent with prior WMAP and Planck results but limited by unexplained systematics.
-
Comparison of Halo Model and Simulation Predictions for Projected-Field Kinematic Sunyaev-Zel'dovich Cross-Correlations
Halo model predictions match Websky simulations well for Planck filters but differ by ~20% for Simons Observatory filters, exceeding error bars and consistent with missing higher-order terms in the kSZ signal.
-
Validating Prior-informed Fisher-matrix Analyses against GWTC Data
Fisher-matrix methods in GWFish match LIGO/Virgo posteriors reasonably when priors are included, with prior impact scaling with parameter degeneracy, supporting their use for ET forecasts.
-
GWTC-3: Compact Binary Coalescences Observed by LIGO and Virgo During the Second Part of the Third Observing Run
GWTC-3 catalogs 90 compact binary coalescence events with p_astro > 0.5 from LIGO and Virgo's first three observing runs, including the first confident neutron star-black hole binaries.
-
Testing masking effectiveness using multi-line image cubes based on COSMOS2020 for [CII] line intensity mapping at $z_{[CII]} > 3.5$
Simulations from COSMOS2020 show masking recovers [CII] above 300 GHz in ideal conditions but noise prevents useful S/N until near the end of 2000-hour observations.
-
Can current models predict the local black hole merger rate?
Theoretical predictions for local BBH merger rates exceed observations by a factor >10 under conservative SFRD and metallicity assumptions, indicating need for revisions in stellar evolution.
-
Search for Dark Matter in 2HDMS at LHC and future Lepton Colliders
Benchmarks in the 2HDMS model with light to heavy dark matter masses are identified under all constraints and shown to have better discovery prospects at future lepton colliders than at the HL-LHC via cut-and-count analyses.
Reference graph
Works this paper leans on
-
[1]
Notation as a tool of thought,
K. E. Iverson, “Notation as a tool of thought,” Communications of the ACM, vol. 23, p. 444465, Aug. 1980
work page 1980
-
[2]
P. F. Dubois, “Python: Batteries included,” Computing in Science & Engineering , vol. 9, no. 3, pp. 7–9, 2007
work page 2007
-
[3]
Python for scientific com- puting,
T. E. Oliphant, “Python for scientific com- puting,” Computing in Science & Engineering , vol. 9, pp. 10–20, May-June 2007
work page 2007
-
[4]
Python for sci- entists and engineers,
K. J. Millman and M. Aivazis, “Python for sci- entists and engineers,” Computing in Science & Engineering, vol. 13, no. 2, pp. 9–12, 2011
work page 2011
-
[5]
Python: an ecosystem for scientific comput- ing,
F. P´ erez, B. E. Granger, and J. D. Hunter, “Python: an ecosystem for scientific comput- ing,” Computing in Science & Engineering , vol. 13, no. 2, pp. 13–21, 2011
work page 2011
-
[6]
Ob- servation of gravitational waves from a binary black hole merger,
B. P. Abbott, R. Abbott, T. Abbott, M. Aber- nathy, F. Acernese, K. Ackley, C. Adams, T. Adams, P. Addesso, R. Adhikari, et al., “Ob- servation of gravitational waves from a binary black hole merger,” Physical Review Letters , vol. 116, no. 6, p. 061102, 2016
work page 2016
-
[7]
High-resolution linear polarimetric imaging for the event horizon telescope,
A. A. Chael, M. D. Johnson, R. Narayan, S. S. Doeleman, J. F. Wardle, and K. L. Bouman, “High-resolution linear polarimetric imaging for the event horizon telescope,” The Astrophysical Journal, vol. 829, no. 1, p. 11, 2016
work page 2016
-
[8]
P. F. Dubois, K. Hinsen, and J. Hugunin, “Nu- merical Python,” Computers in Physics, vol. 10, no. 3, pp. 262–267, 1996
work page 1996
-
[9]
An open source project: Numerical Python,
D. Ascher, P. F. Dubois, K. Hinsen, J. Hugunin, and T. E. Oliphant, “An open source project: Numerical Python,” 2001. 8
work page 2001
-
[10]
Steering object-oriented scientific computa- tions,
T.-Y. Yang, G. Furnish, and P. F. Dubois, “Steering object-oriented scientific computa- tions,” in Proceedings of TOOLS USA 97. In- ternational Conference on Technology of Object Oriented Systems and Languages , pp. 112–119, IEEE, 1997
work page 1997
-
[11]
numarray: A new scientific array pack- age for Python,
P. Greenfield, J. T. Miller, J. Hsu, and R. L. White, “numarray: A new scientific array pack- age for Python,” PyCon DC, 2003
work page 2003
-
[12]
T. E. Oliphant, Guide to NumPy . Trelgol Pub- lishing USA, 1st ed., 2006
work page 2006
-
[13]
SciPy 1.0—fundamental algorithms for scientific com- puting in Python,
P. Virtanen, R. Gommers, T. E. Oliphant, M. Haberland, T. Reddy, D. Cournapeau, E. Burovski, P. Peterson, W. Weckesser, J. Bright, S. J. van der Walt, M. Brett, J. Wil- son, K. J. Millman, N. Mayorov, A. R. J. Nel- son, E. Jones, R. Kern, E. Larson, C. J. Carey, I. Polat, Y. Feng, E. W. Moore, J. VanderPlas, D. Laxalde, J. Perktold, R. Cimrman, I. Hen- ri...
work page 2020
-
[14]
Matplotlib: A 2D graphics envi- ronment,
J. D. Hunter, “Matplotlib: A 2D graphics envi- ronment,” Computing in Science & Engineering, vol. 9, no. 3, pp. 90–95, 2007
work page 2007
-
[15]
Data structures for statistical computing in Python,
W. McKinney, “Data structures for statistical computing in Python,” in Proceedings of the 9th Python in Science Conference (S. van der Walt and J. Millman, eds.), pp. 51 – 56, 2010
work page 2010
-
[16]
Scikit-learn: Ma- chine learning in Python,
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Van- derplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and ´E. Duchesnay, “Scikit-learn: Ma- chine learning in Python,” Journal of Machine Learning Research, vol. 12, no. Oct, pp. 2825– 2830, 2011
work page 2011
-
[17]
scikit-image: image processing in Python,
S. van der Walt, J. L. Sch¨ onberger, J. Nunez- Iglesias, F. Boulogne, J. D. Warner, N. Yager, E. Gouillart, T. Yu, and the scikit-image con- tributors, “scikit-image: image processing in Python,” PeerJ, vol. 2, p. e453, 2014
work page 2014
-
[18]
The NumPy array: a structure for ef- ficient numerical computation,
S. van der Walt, S. C. Colbert, and G. Varo- quaux, “The NumPy array: a structure for ef- ficient numerical computation,” Computing in Science & Engineering , vol. 13, no. 2, pp. 22– 30, 2011
work page 2011
-
[19]
Augem: automatically generate high perfor- mance dense linear algebra kernels on x86 cpus,
Q. Wang, X. Zhang, Y. Zhang, and Q. Yi, “Augem: automatically generate high perfor- mance dense linear algebra kernels on x86 cpus,” in SC’13: Proceedings of the International Con- ference on High Performance Computing, Net- working, Storage and Analysis , pp. 1–12, IEEE, 2013
work page 2013
-
[20]
Model- driven level 3 blas performance optimization on loongson 3a processor,
Z. Xianyi, W. Qian, and Z. Yunquan, “Model- driven level 3 blas performance optimization on loongson 3a processor,” in 2012 IEEE 18th International Conference on Parallel and Dis- tributed Systems, pp. 684–691, IEEE, 2012
work page 2012
-
[21]
IPython: a system for interactive scientific computing,
F. P´ erez and B. E. Granger, “IPython: a system for interactive scientific computing,” Computing in Science & Engineering , vol. 9, no. 3, pp. 21– 29, 2007
work page 2007
-
[22]
Jupyter Notebooks—a publishing format for repro- ducible computational workflows,
T. Kluyver, B. Ragan-Kelley, F. P´ erez, B. Granger, M. Bussonnier, J. Frederic, K. Kel- ley, J. Hamrick, J. Grout, S. Corlay, P. Ivanov, D. Avila, S. Abdalla, and C. Willing, “Jupyter Notebooks—a publishing format for repro- ducible computational workflows,” in Position- ing and Power in Academic Publishing: Play- ers, Agents and Agendas (F. Loizides and ...
work page 2016
-
[23]
Exploring network structure, dynamics, and function using NetworkX,
A. A. Hagberg, D. A. Schult, and P. J. Swart, “Exploring network structure, dynamics, and function using NetworkX,” in Proceedings of the 7th Python in Science Conference (G. Varo- quaux, T. Vaught, and K. J. Millman, eds.), (Pasadena, CA USA), pp. 11–15, 2008
work page 2008
-
[24]
Astropy: A community Python package for astronomy,
Astropy Collaboration, T. P. Robitaille, E. J. Tollerud, P. Greenfield, M. Droettboom, 9 E. Bray, T. Aldcroft, M. Davis, A. Ginsburg, A. M. Price-Whelan, W. E. Kerzendorf, A. Con- ley, N. Crighton, K. Barbary, D. Muna, H. Fer- guson, F. Grollier, M. M. Parikh, P. H. Nair, H. M. Unther, C. Deil, J. Woillez, S. Con- seil, R. Kramer, J. E. H. Turner, L. Singe...
work page 2013
-
[25]
The Astropy Project: Building an Open- science Project and Status of the v2.0 Core Pack- age,
A. M. Price-Whelan, B. M. Sip˝ ocz, H. M. G¨ unther, P. L. Lim, S. M. Crawford, S. Con- seil, D. L. Shupe, M. W. Craig, N. Dencheva, A. Ginsburg, J. T. VanderPlas, L. D. Bradley, D. P´ erez-Su´ arez, M. de Val-Borro, P. Pa- per Contributors, T. L. Aldcroft, K. L. Cruz, T. P. Robitaille, E. J. Tollerud, A. Coordina- tion Committee, C. Ardelean, T. Babej, Y...
work page 2018
-
[26]
Biopython: freely available Python tools for computational molecular biol- ogy and bioinformatics,
P. J. Cock, T. Antao, J. T. Chang, B. A. Chapman, C. J. Cox, A. Dalke, I. Friedberg, T. Hamelryck, F. Kauff, B. Wilczynski, and M. J. L. de Hoon, “Biopython: freely available Python tools for computational molecular biol- ogy and bioinformatics,” Bioinformatics, vol. 25, no. 11, pp. 1422–1423, 2009
work page 2009
-
[27]
Analysis of func- tional Magnetic Resonance Imaging in Python,
K. J. Millman and M. Brett, “Analysis of func- tional Magnetic Resonance Imaging in Python,” Computing in Science & Engineering , vol. 9, no. 3, pp. 52–55, 2007
work page 2007
-
[28]
SunPy—Python for solar physics,
T. SunPy Community, S. J. Mumford, S. Christe, D. P´ erez-Su´ arez, J. Ireland, A. Y. Shih, A. R. Inglis, S. Liedtke, R. J. Hewett, F. Mayer, K. Hughitt, N. Freij, T. Meszaros, S. M. Bennett, M. Malocha, J. Evans, A. Agrawal, A. J. Leonard, T. P. Robitaille, B. Mampaey, J. Iv´ an Campos-Rozo, and M. S. Kirk, “SunPy—Python for solar physics,” Computational...
work page 2015
-
[29]
Pangeo: A Big-data Ecosystem for Scalable Earth System Science,
J. Hamman, M. Rocklin, and R. Abernathy, “Pangeo: A Big-data Ecosystem for Scalable Earth System Science,” in EGU General Assem- bly Conference Abstracts, EGU General Assem- bly Conference Abstracts, p. 12146, Apr 2018. 10
work page 2018
-
[30]
ehtim: Imaging, analysis, and sim- ulation software for radio interferometry,
A. A. Chael, K. L. Bouman, M. D. Johnson, R. Narayan, S. S. Doeleman, J. F. Wardle, L. L. Blackburn, K. Akiyama, M. Wielgus, C.-k. Chan, et al., “ehtim: Imaging, analysis, and sim- ulation software for radio interferometry,”Astro- physics Source Code Library, 2019
work page 2019
-
[31]
Developing open- source scientific practice,
K. J. Millman and F. P´ erez, “Developing open- source scientific practice,” Implementing Repro- ducible Research. CRC Press, Boca Raton, FL , pp. 149–183, 2014
work page 2014
-
[32]
The SciPy documentation project (technical overview),
S. van der Walt, “The SciPy documentation project (technical overview),” in Proceedings of the 7th Python in Science Conference (SciPy
- [33]
-
[34]
The SciPy documentation project,
J. Harrington, “The SciPy documentation project,” in Proceedings of the 7th Python in Sci- ence Conference (SciPy 2008) (G. Varoquaux, T. Vaught, and K. J. Millman, eds.), pp. 33–35, 2008
work page 2008
-
[35]
Progress re- port: NumPy and SciPy documentation in 2009,
J. Harrington and D. Goldsmith, “Progress re- port: NumPy and SciPy documentation in 2009,” in Proceedings of the 8th Python in Sci- ence Conference (SciPy 2009) (G. Varoquaux, S. van der Walt, and K. J. Millman, eds.), pp. 84–87, 2009
work page 2009
-
[36]
Software carpentry: Getting scien- tists to write better code by making them more productive,
G. Wilson, “Software carpentry: Getting scien- tists to write better code by making them more productive,” Computing in Science & Engineer- ing, November–December 2006
work page 2006
-
[37]
How do scientists develop and use scientific software?,
J. E. Hannay, H. P. Langtangen, C. MacLeod, D. Pfahl, J. Singer, and G. Wilson, “How do scientists develop and use scientific software?,” in Proc. 2009 ICSE Workshop on Software En- gineering for Computational Science and Engi- neering, 2009
work page 2009
-
[38]
Teaching computational repro- ducibility for neuroimaging,
K. J. Millman, M. Brett, R. Barnowski, and J.-B. Poline, “Teaching computational repro- ducibility for neuroimaging,” Frontiers in Neu- roscience, vol. 12, p. 727, 2018
work page 2018
-
[39]
Pytorch: An imper- ative style, high-performance deep learning li- brary,
A. Paszke, S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, L. Antiga, A. Desmaison, A. Kopf, E. Yang, Z. DeVito, M. Raison, A. Te- jani, S. Chilamkurthy, B. Steiner, L. Fang, J. Bai, and S. Chintala, “Pytorch: An imper- ative style, high-performance deep learning li- brary,” in Advances in Neural Information Pro- c...
work page 2019
-
[40]
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
M. Abadi, A. Agarwal, P. Barham, E. Brevdo, Z. Chen, C. Citro, G. S. Corrado, A. Davis, J. Dean, M. Devin, et al. , “Tensorflow: Large-scale machine learning on heteroge- neous distributed systems,” arXiv preprint arXiv:1603.04467, 2016
work page internal anchor Pith review Pith/arXiv arXiv 2016
-
[41]
MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems
T. Chen, M. Li, Y. Li, M. Lin, N. Wang, M. Wang, T. Xiao, B. Xu, C. Zhang, and Z. Zhang, “Mxnet: A flexible and ef- ficient machine learning library for hetero- geneous distributed systems,” arXiv preprint arXiv:1512.01274, 2015
work page internal anchor Pith review Pith/arXiv arXiv 2015
-
[42]
xarray: N-D labeled arrays and datasets in Python,
S. Hoyer and J. Hamman, “xarray: N-D labeled arrays and datasets in Python,” Journal of Open Research Software, vol. 5, no. 1, 2017
work page 2017
-
[43]
Distributed multi-GPU comput- ing with Dask, CuPy and RAPIDS
P. Entschev, “Distributed multi-GPU comput- ing with Dask, CuPy and RAPIDS.” EuroPy- thon 2019, 2019
work page 2019
-
[44]
Cython: The best of both worlds,
S. Behnel, R. Bradshaw, C. Citro, L. Dalcin, D. S. Seljebotn, and K. Smith, “Cython: The best of both worlds,” Computing in Science & Engineering, vol. 13, no. 2, pp. 31–39, 2011
work page 2011
-
[45]
Numba: A LLVM-based Python JIT compiler,
S. K. Lam, A. Pitrou, and S. Seibert, “Numba: A LLVM-based Python JIT compiler,” in Pro- ceedings of the Second Workshop on the LLVM Compiler Infrastructure in HPC , LLVM ’15, (New York, NY, USA), pp. 7:1–7:6, ACM, 2015
work page 2015
-
[46]
Pythran: En- abling static optimization of scientific python 11 programs,
S. Guelton, P. Brunet, M. Amini, A. Merlini, X. Corbillon, and A. Raynaud, “Pythran: En- abling static optimization of scientific python 11 programs,” Computational Science & Discovery, vol. 8, no. 1, p. 014001, 2015
work page 2015
-
[47]
Netlib and na-net: Building a scientific computing community,
J. Dongarra, G. H. Golub, E. Grosse, C. Moler, and K. Moore, “Netlib and na-net: Building a scientific computing community,” IEEE An- nals of the History of Computing , vol. 30, no. 2, pp. 30–41, 2008
work page 2008
-
[48]
P. F. Dubois, “The basis system,” tech. rep., Lawrence Livermore National Laboratory, CA (USA), 1989. UCRL-MA-118543, Parts I-VI
work page 1989
-
[49]
Using the yorick interpreted language,
D. H. Munro and P. F. Dubois, “Using the yorick interpreted language,” Computers in Physics , vol. 9, no. 6, pp. 609–615, 1995
work page 1995
-
[50]
R: a language for data analysis and graphics,
R. Ihaka and R. Gentleman, “R: a language for data analysis and graphics,” Journal of Compu- tational and Graphical Statistics , vol. 5, no. 3, pp. 299–314, 1996
work page 1996
-
[51]
K. E. Iverson, “A programming language,” in Proceedings of the May 1-3, 1962, Spring Joint Computer Conference, pp. 345–351, 1962
work page 1962
-
[52]
Lsst data management software development practices and tools,
T. Jenness, F. Economou, K. Findeisen, F. Her- nandez, J. Hoblitt, K. S. Krughoff, K. Lim, R. H. Lupton, F. Mueller, W. O’Mullane, et al., “Lsst data management software development practices and tools,” in Software and Cyber- infrastructure for Astronomy V , vol. 10707, p. 1070709, International Society for Optics and Photonics, 2018
work page 2018
-
[53]
N. D. Matsakis and F. S. Klock, “The rust lan- guage,” Ada Letters, vol. 34, pp. 103–104, Oct. 2014
work page 2014
-
[54]
Julia: A fresh approach to numer- ical computing,
J. Bezanson, A. Edelman, S. Karpinski, and V. B. Shah, “Julia: A fresh approach to numer- ical computing,” SIAM Review , vol. 59, no. 1, pp. 65–98, 2017
work page 2017
-
[55]
LLVM: A compila- tion framework for lifelong program analysis and transformation,
C. Lattner and V. Adve, “LLVM: A compila- tion framework for lifelong program analysis and transformation,” (San Jose, CA, USA), pp. 75– 88, Mar 2004
work page 2004
-
[56]
F2PY: a tool for connecting For- tran and Python programs,
P. Peterson, “F2PY: a tool for connecting For- tran and Python programs,” International Jour- nal of Computational Science and Engineering , vol. 4, no. 4, pp. 296–305, 2009
work page 2009
-
[57]
The NumPy Project Community, “NumPy project governance,” 2015
work page 2015
- [58]
-
[59]
Pep 427 – the wheel binary package format 1.0,
D. Holth, “Pep 427 – the wheel binary package format 1.0,” 2012
work page 2012
- [60]
-
[61]
NEP 13 – a mechanism for overriding ufuncs,
B. Griffith, P. Virtanen, N. Smith, M. van Kerk- wijk, and S. Hoyer, “NEP 13 – a mechanism for overriding ufuncs,” 2013
work page 2013
-
[62]
NEP 18 – a dispatch mech- anism for numpy’s high level array functions,
S. Hoyer, M. Rocklin, M. van Kerkwijk, H. Ab- basi, and E. Wieser, “NEP 18 – a dispatch mech- anism for numpy’s high level array functions,” 2018
work page 2018
-
[63]
M. E. O’Neill, “Pcg: A family of simple fast space-efficient statistically good algorithms for random number generation,” Tech. Rep. HMC- CS-2014-0905, Harvey Mudd College, Clare- mont, CA, Sept. 2014
work page 2014
-
[64]
Parallel random numbers: As easy as 1, 2, 3,
J. K. Salmon, M. A. Moraes, R. O. Dror, and D. E. Shaw, “Parallel random numbers: As easy as 1, 2, 3,” in Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis, SC ’11, (New York, NY, USA), pp. 16:1–16:12, ACM, 2011
work page 2011
- [65]
-
[66]
Mersenne Twister: A 623-dimensionally equidistributed uniform pseudo-random number generator,
M. Matsumoto and T. Nishimura, “Mersenne Twister: A 623-dimensionally equidistributed uniform pseudo-random number generator,” ACM Transactions on Modeling and Computer Simulation, vol. 8, pp. 3–30, Jan. 1998
work page 1998
-
[67]
bashtage/randomgen: Release 1.16.2,
K. Sheppard, B. Duvenhage, P. de Buyl, and D. A. Ham, “bashtage/randomgen: Release 1.16.2,” Apr. 2019. 12
work page 2019
-
[68]
The ziggurat method for generating random variables,
G. Marsaglia and W. W. Tsang, “The ziggurat method for generating random variables,” Jour- nal of Statistical Software, Articles, vol. 5, no. 8, pp. 1–7, 2000
work page 2000
-
[69]
Fast random integer generation in an interval,
D. Lemire, “Fast random integer generation in an interval,” ACM Transactions on Modeling and Computer Simulation, vol. 29, pp. 1–12, Jan 2019
work page 2019
- [70]
- [71]
- [72]
- [73]
-
[74]
Pep 599 – the manylinux2014 platform tag,
Dustin Ingram, “Pep 599 – the manylinux2014 platform tag,” 2019. Methods We use Git for version control and GitHub as the public hosting service for our official upstream reposi- tory (https://github.com/numpy/numpy). We each work in our own copy (or fork) of the project and use the upstream repository as our integration point. To get new code into the upst...
work page 2019
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.