Tom Goodale

The cactus framework and toolkit: design and applications

We describe Cactus, a framework for building a variety of computing applications in science and engineering, including astrophysics, relativity and chemical engineering.We first motivate by example the need for such frameworks to support multi-platform, high performance applications across diverse communities. We then describe the design of the latest release of Cactus (Version 4.0) a complete rewrite of earlier versions, which enables highly modular, multi-language, parallel applications to be developed by single researchers and large collaborations alike. Making extensive use of abstractions, we detail how we are able to provide the latest advances in computational science, such as interchangeable parallel data distribution and high performance IO layers, while hiding most details of the underlying computational libraries from the application developer. We survey how Cactus 4.0 is being used by various application communities, and describe how it will also enable these applications to run on the computational Grids of the near future.

Enabling Applications on the Grid: A Gridlab Overview

Grid technology is widely emerging. Still, there is an eminent shortage of real Grid users, mostly due to the lack of a “critical mass” of widely deployed and reliable higher-level Grid services, tailored to application needs. The GridLab project aims to provide fundamentally new capabilities for applications to exploit the power of Grid computing, thus bridging the gap between application needs and existing Grid middleware. We present an overview of GridLab, a large-scale, EU-funded Grid project spanning over a dozen groups in Europe and the US. We first outline our vision of Grid-empowered applications and then discuss GridLab’s general architecture and its Grid Application Toolkit (GAT). We illustrate how applications can be Grid-enabled with the GAT and discuss GridLab’s scheduler as an example of GAT services.

The Cactus Code: a problem solving environment for the grid

Cactus is an open source problem solving environment designed for scientists and engineers. Its modular structure facilitates parallel computation across different architectures and collaborative code development between different groups. The Cactus Code originated in the academic research community, where it has been developed and used over many years by a large international collaboration of physicists and computational scientists. We discuss how the intensive computing requirements of physics applications now using the Cactus Code encourage the use of distributed and metacomputing, describe the development and experiments which have already been performed with Cactus, and detail how its design makes it an ideal application test-bed for Grid computing.

Cactus Tools for Grid Applications

Cactus is an open source problem solving environment designed for scientists and engineers. Its modular structure facilitates parallel computation across different architectures and collaborative code development between different groups. The Cactus Code originated in the academic research community, where it has been developed and used over many years by a large international collaboration of physicists and computational scientists. We discuss here how the intensive computing requirements of physics applications now using the Cactus Code encourage the use of distributed and metacomputing, and detail how its design makes it an ideal application test-bed for Grid computing. We describe the development of tools, and the experiments which have already been performed in a Grid environment with Cactus, including distributed simulations, remote monitoring and steering, and data handling and visualization. Finally, we discuss how Grid portals, such as those already developed for Cactus, will open the door to global computing resources for scientific users.

Three-dimensional numerical general relativistic hydrodynamics. II. Long-term dynamics of single relativistic stars

This is the second in a series of papers on the construction and validation of a three-dimensional code for the solution of the coupled system of the Einstein equations and of the general relativistic hydrodynamic equations, and on the application of this code to problems in general relativistic astrophysics. In particular, we report on the accuracy of our code in the long-term dynamical evolution of relativistic stars and on some new physics results obtained in the process of code testing. The following aspects of our code have been validated: the generation of initial data representing perturbed general relativistic polytropic models ~both rotating and nonrotating!, the long-term evolution of relativistic stellar models, and the coupling of our evolution code to analysis modules providing, for instance, the detection of apparent horizons or the extraction of gravitational waveforms. The tests involve single nonrotating stars in stable equilibrium, nonrotating stars undergoing radial and quadrupolar oscillations, nonrotating stars on the unstable branch of the equilibrium configurations migrating to the stable branch, nonrotating stars undergoing gravitational collapse to a black hole, and rapidly rotating stars in stable equilibrium and undergoing quasiradial oscillations. We have carried out evolutions in full general relativity and compared the results to those obtained either with perturbation techniques, or with lower dimensional numerical codes, or in the Cowling approximation ~in which all the perturbations of the spacetime are neglected!. In all cases an excellent agreement has been found. The numerical evolutions have been carried out using different types of polytropic equations of state using either the rest-mass density only, or the rest-mass density and the internal energy as independent variables. New variants of the spacetime evolution and new high resolution shock capturing treatments based on Riemann solvers and slope limiters have been implemented and the results compared with those obtained from previous methods. In particular, we have found the ‘‘monotonized central differencing’’ limiter to be particularly effective in evolving the relativistic stellar models considered. Finally, we have obtained the first eigenfrequencies of rotating stars in full general relativity and rapid rotation. A long standing problem, such frequencies have not been obtained by other methods. Overall, and to the best of our knowledge, the results presented in this paper represent the most accurate long-term three-dimensional evolutions of relativistic stars available to date.

Solving Einstein's equations on supercomputers

In 1916, Albert Einstein published his famous general theory of relativity, which contains the rules of gravity and provides the basis for modern theories of astrophysics and cosmology. For many years, physicists, astrophysicists and mathematicians have striven to develop techniques for unlocking the secrets contained in Einsteins theory of gravity; more recently, computational science research groups have added their expertise to the endeavor. Because the underlying scientific project provides such a demanding and rich system for computational science, techniques developed to solve Einsteins equations will apply immediately to a large family of scientific and engineering problems. The authors have developed a collaborative computational framework that allows remote monitoring and visualization of simulations, at the center of which lies a community code called Cactus. Many researchers in the general scientific computing community have already adopted Cactus, as have numerical relativists and astrophysicists. In June 1999, an international team of researchers at various sites ran some of the largest such simulations in numerical relativity yet undertaken, using a 256-processor SGI Origin 2000 supercomputer at the National Center for Supercomputing Applications (NCSA). Other globally distributed scientific teams are running visual simulations of Einsteins equations on the gravitational effects of colliding black holes.

Towards standard testbeds for numerical relativity

In recent years, many different numerical evolution schemes for Einsteins equations have been proposed to address stability and accuracy problems that have plagued the numerical relativity community for decades. Some of these approaches have been tested on different spacetimes, and conclusions have been drawn based on these tests. However, differences in results originate from many sources, including not only formulations of the equations, but also gauges, boundary conditions, numerical methods and so on. We propose to build up a suite of standardized testbeds for comparing approaches to the numerical evolution of Einsteins equations that are designed to both probe their strengths and weaknesses and to separate out different effects, and their causes, seen in the results. We discuss general design principles of suitable testbeds, and we present an initial round of simple tests with periodic boundary conditions. This is a pivotal first step towards building a suite of testbeds to serve the numerical relativists and researchers from related fields who wish to assess the capabilities of numerical relativity codes. We present some examples of how these tests can be quite effective in revealing various limitations of different approaches, and illustrating their differences. The tests are presently limited to vacuum spacetimes, can be run on modest computational resources and can be used with many different approaches used in the relativity community.

GridLab: Enabling Applications on the Grid

Grid technology is widely emerging. Still, there is an eminent shortage of real Grid users, due to the absence of two important catalysts: First, a widely accepted vision on how applications can substantially benefit from Grids, and second a toolkit of higher-level Grid services, tailored to application needs. The GridLab project aims to provide fundamentally new capabilities for applications to exploit the power of Grid computing, thus bridging the gap between application needs and existing Grid middleware. We present an overview of GridLab, a largescale, EU-funded Grid project spanning over a dozen groups in Europe and the US. We first outline our vision of Grid-empowered applications and then discuss GridLabs general architecture.

Cactus Grid Computing: Review of Current Development

Cactus is an open source problem solving environment designed for scientists and engineers. Its modular structure facilitates parallel computation across different architectures and collaborative code development between different groups. Here we detail some of the various Grid Tools which have been developed around Cactus, and describe Grid experiments which have been performed to test their application.

Component specification in the Cactus Framework: The Cactus Configuration Language

Component frameworks are complex systems that rely on many layers of abstraction to function properly. One essential requirement is a consistent means of describing each individual component and how it relates to both other components and the whole framework. As component frameworks are designed to be flexible by nature, the description method should be simultaneously powerful, lead to efficient code, and be easy to use, so that new users can quickly adapt their own code to work with the framework. In this paper, we discuss the Cactus Configuration Language (CCL) which is used to describe components (“thorns”) in the Cactus Framework. The CCL provides a description language for the variables, parameters, functions, scheduling and compilation of a component and includes concepts such as interface and implementation which allow thorns providing the same capabilities to be easily interchanged. We include several application examples which illustrate how community toolkits use the CCL and Cactus and identify needed additions to the language.