Thomas Radke

The cactus framework and toolkit: design and applications

We describe Cactus, a framework for building a variety of computing applications in science and engineering, including astrophysics, relativity and chemical engineering.We first motivate by example the need for such frameworks to support multi-platform, high performance applications across diverse communities. We then describe the design of the latest release of Cactus (Version 4.0) a complete rewrite of earlier versions, which enables highly modular, multi-language, parallel applications to be developed by single researchers and large collaborations alike. Making extensive use of abstractions, we detail how we are able to provide the latest advances in computational science, such as interchangeable parallel data distribution and high performance IO layers, while hiding most details of the underlying computational libraries from the application developer. We survey how Cactus 4.0 is being used by various application communities, and describe how it will also enable these applications to run on the computational Grids of the near future.

The Cactus Worm: Experiments with Dynamic Resource Discovery and Allocation in a Grid Environment

The ability to harness heterogeneous, dynamically available grid resources is attractive to typically resource-starved computational scientists and engineers, as in principle it can increase, by significant factors, the number of cycles that can be delivered to applications. However, new adaptive application structures and dynamic runtime system mechanisms are required if we are to operate effectively in grid environments. To explore some of these issues in a practical setting, the authors are developing an experimental framework, called Cactus, that incorporates both adaptive application structures for dealing with changing resource characteristics and adaptive resource selection mechanisms that allow applications to change their resource allocations (e.g., via migration) when performance falls outside specified limits. The authors describe the adaptive resource selection mechanisms and describe how they are used to achieve automatic application migration to “better” resources following performance degradation. The results provide insights into the architectural structures required to support adaptive resource selection. In addition, the authors suggest that the Cactus Worm affords many opportunities for grid computing.

Enabling Applications on the Grid: A Gridlab Overview

Grid technology is widely emerging. Still, there is an eminent shortage of real Grid users, mostly due to the lack of a “critical mass” of widely deployed and reliable higher-level Grid services, tailored to application needs. The GridLab project aims to provide fundamentally new capabilities for applications to exploit the power of Grid computing, thus bridging the gap between application needs and existing Grid middleware. We present an overview of GridLab, a large-scale, EU-funded Grid project spanning over a dozen groups in Europe and the US. We first outline our vision of Grid-empowered applications and then discuss GridLab’s general architecture and its Grid Application Toolkit (GAT). We illustrate how applications can be Grid-enabled with the GAT and discuss GridLab’s scheduler as an example of GAT services.

The Cactus Code: a problem solving environment for the grid

Cactus is an open source problem solving environment designed for scientists and engineers. Its modular structure facilitates parallel computation across different architectures and collaborative code development between different groups. The Cactus Code originated in the academic research community, where it has been developed and used over many years by a large international collaboration of physicists and computational scientists. We discuss how the intensive computing requirements of physics applications now using the Cactus Code encourage the use of distributed and metacomputing, describe the development and experiments which have already been performed with Cactus, and detail how its design makes it an ideal application test-bed for Grid computing.

Cactus Tools for Grid Applications

Cactus is an open source problem solving environment designed for scientists and engineers. Its modular structure facilitates parallel computation across different architectures and collaborative code development between different groups. The Cactus Code originated in the academic research community, where it has been developed and used over many years by a large international collaboration of physicists and computational scientists. We discuss here how the intensive computing requirements of physics applications now using the Cactus Code encourage the use of distributed and metacomputing, and detail how its design makes it an ideal application test-bed for Grid computing. We describe the development of tools, and the experiments which have already been performed in a Grid environment with Cactus, including distributed simulations, remote monitoring and steering, and data handling and visualization. Finally, we discuss how Grid portals, such as those already developed for Cactus, will open the door to global computing resources for scientific users.

Solving Einstein's equations on supercomputers

In 1916, Albert Einstein published his famous general theory of relativity, which contains the rules of gravity and provides the basis for modern theories of astrophysics and cosmology. For many years, physicists, astrophysicists and mathematicians have striven to develop techniques for unlocking the secrets contained in Einsteins theory of gravity; more recently, computational science research groups have added their expertise to the endeavor. Because the underlying scientific project provides such a demanding and rich system for computational science, techniques developed to solve Einsteins equations will apply immediately to a large family of scientific and engineering problems. The authors have developed a collaborative computational framework that allows remote monitoring and visualization of simulations, at the center of which lies a community code called Cactus. Many researchers in the general scientific computing community have already adopted Cactus, as have numerical relativists and astrophysicists. In June 1999, an international team of researchers at various sites ran some of the largest such simulations in numerical relativity yet undertaken, using a 256-processor SGI Origin 2000 supercomputer at the National Center for Supercomputing Applications (NCSA). Other globally distributed scientific teams are running visual simulations of Einsteins equations on the gravitational effects of colliding black holes.

GridLab: Enabling Applications on the Grid

Grid technology is widely emerging. Still, there is an eminent shortage of real Grid users, due to the absence of two important catalysts: First, a widely accepted vision on how applications can substantially benefit from Grids, and second a toolkit of higher-level Grid services, tailored to application needs. The GridLab project aims to provide fundamentally new capabilities for applications to exploit the power of Grid computing, thus bridging the gap between application needs and existing Grid middleware. We present an overview of GridLab, a largescale, EU-funded Grid project spanning over a dozen groups in Europe and the US. We first outline our vision of Grid-empowered applications and then discuss GridLabs general architecture.

Cactus Grid Computing: Review of Current Development

Cactus is an open source problem solving environment designed for scientists and engineers. Its modular structure facilitates parallel computation across different architectures and collaborative code development between different groups. Here we detail some of the various Grid Tools which have been developed around Cactus, and describe Grid experiments which have been performed to test their application.

The GridLab grid application toolkit

We present a synopsis of the Grid Application Toolkit, under development in the EU GridLab project, along with some of the new application scenarios which it will enable.

Nomadic Migration: Fault Tolerance in a Disruptive Grid Environment

Nomadic Migration describes a technology, which provides an application with the ability to seek out and exploit remote computing resources by migrating tasks from site to site, dynamically adapting the application to a changing Grid environment. By automating the detection and usage of free resources in a global Grid, we achieve a significantly faster throughput than by manually interfacing with these resources. In this Paper we discuss the Peer-To-Peer strategy as an approach to provide a fault tolerant service infrastructure, required for a stable Grid Migration Service in an intrinsically disruptive Grid environment. The migration technology presented here is e.g. used with large-scale, Cactus based HPC simulations.