Gregory G. Davidson

Massively Parallel, Three-Dimensional Transport Solutions for the k-Eigenvalue Problem

Abstract We have implemented a new multilevel parallel decomposition in the Denovo discrete ordinates radiation transport code. In concert with Krylov subspace iterative solvers, the multilevel decomposition allows concurrency over energy in addition to space-angle, enabling scalability beyond the limits imposed by the traditional Koch-Baker-Alcouffe (KBA) space-angle partitioning. Furthermore, a new Arnoldi-based k-eigenvalue solver has been implemented. The added phase-space concurrency combined with the high-performance Krylov and Arnoldi solvers has enabled weak scaling to O(105) cores on the Titan XK7 supercomputer. The multilevel decomposition provides a mechanism for scaling to exascale computing and beyond.

Multigrid in energy preconditioner for Krylov solvers

We have added a new multigrid in energy (MGE) preconditioner to the Denovo discrete-ordinates radiation transport code. This preconditioner takes advantage of a new multilevel parallel decomposition. A multigroup Krylov subspace iterative solver that is decomposed in energy as well as space-angle forms the backbone of the transport solves in Denovo. The space-angle-energy decomposition facilitates scaling to hundreds of thousands of cores. The multigrid in energy preconditioner scales well in the energy dimension and significantly reduces the number of Krylov iterations required for convergence. This preconditioner is well-suited for use with advanced eigenvalue solvers such as Rayleigh Quotient Iteration and Arnoldi.

High performance radiation transport simulations: preparing for Titan

In this paper we describe the Denovo code system. Denovo solves the six-dimensional, steady-state, linear Boltzmann transport equation, of central importance to nuclear technology applications such as reactor core analysis (neutronics), radiation shielding, nuclear forensics and radiation detection. The code features multiple spatial differencing schemes, state-of-the-art linear solvers, the Koch-Baker-Alcouffe (KBA) parallel-wavefront sweep algorithm for inverting the transport operator, a new multilevel energy decomposition method scaling to hundreds of thousands of processing cores, and a modern, novel code architecture that supports straightforward integration of new features. In this paper we discuss the performance of Denovo on the 20+ petaflop ORNL GPU-based system, Titan. We describe algorithms and techniques used to exploit the capabilities of Titans heterogeneous compute node architecture and the challenges of obtaining good parallel performance for this sparse hyperbolic PDE solver containing inherently sequential computations. Numerical results demonstrating Denovo performance on early Titan hardware are presented.

Full core reactor analysis: Running Denovo on Jaguar

Abstract Fully consistent, full core, three-dimensional, deterministic neutron transport simulations using the orthogonal mesh code Denovo were run on the massively parallel computing architecture Jaguar XT5. Using energy and spatial parallelization schemes, Denovo was able to efficiently scale to more than 160 000 processors. Cell-homogenized cross sections were used with step characteristics, linear discontinuous finite element, and trilinear discontinuous finite element spatial methods. It was determined that using the finite element methods gave considerably more accurate eigenvalue solutions for large–aspect ratio meshes than using step characteristics.

Finite element transport using Wachspress rational basis functions on quadrilaterals in diffusive regions

Abstract In 1975, Wachspress developed basis functions that can be constructed upon very general zone shapes, including convex polygons and polyhedra, as well as certain zone shapes with curved sides and faces. Additionally, Adams has recently shown that weight functions with certain properties will produce solutions with full resolution, meaning that they are capable of producing physically meaningful solutions in the diffusive limit. Wachspress rational functions (WRFs) possess these necessary properties. Here, we present methods to construct and integrate WRFs on quadrilaterals. We also present an asymptotic analysis of a discontinuous finite element discretization on quadrilaterals, and we present numerical results.

Hot zero power reactor calculations using the Insilico code

In this paper we describe the reactor physics simulation capabilities of the Insilico code. A description of the various capabilities of the code is provided, including detailed discussion of the geometry, meshing, cross section processing, and neutron transport options. Numerical results demonstrate that Insilico using an SPN solver with pin-homogenized cross section generation is capable of delivering highly accurate full-core simulation of various pressurized water reactor problems. Comparison to both Monte Carlo calculations and measured plant data is provided.

Multiagency Urban Search Experiment Detector and Algorithm Test Bed

In order to provide benchmark data sets for radiation detector and algorithm development, a particle transport test bed has been created using experimental data as model input and validation. A detailed radiation measurement campaign at the Combined Arms Collective Training Facility in Fort Indiantown Gap, PA (FTIG), USA, provides sample background radiation levels for a variety of materials present at the site (including cinder block, gravel, asphalt, and soil) using long dwell high-purity germanium (HPGe) measurements. In addition, detailed light detection and ranging data and ground-truth measurements inform model geometry. This paper describes the collected data and the application of these data to create background and injected source synthetic data for an arbitrary gamma-ray detection system using particle transport model detector response calculations and statistical sampling. In the methodology presented here, HPGe measurements inform model source terms while detector response calculations are validated via long dwell measurements using 2”

A C5 Benchmark Problem with the Discrete Ordinates Radiation Transport Code Denovo

\times 4

Implementation, capabilities, and benchmarking of Shift, a massively parallel Monte Carlo radiation transport code

”

Three-Dimensional Full Core Power Calculations for Pressurized Water Reactors

\times 16