Michael J. Mineter

From stand-alone programs towards grid-aware services and components: a case study in agricultural modelling with interpolated climate data

Abstract We identify three key issues to be taken into account when designing the next generation of software environments for agricultural modelling. There is a burgeoning need to support collaborative research in a search for answers to big research questions, to integrate the work of data providers and model developers and to provide more generic systems. We describe the concepts of software design of a framework, designed with these points in mind, which facilitates the integration of point-based agricultural models with methods to interpolate climate data. Our approach allows the inter-working of model and interpolation through Fortran functions that are invoked from a central framework. We advocate that the framework code remains open to collaborators, such that it may be adapted to different classes of application, whilst recognising that some module developers need to retain their control on individual elements of the software. The rationale presented within the paper continues a major move away from the stand-alone programs that still dominate agricultural models and interpolation methods. Secondly, the paper considers how these approaches are extendable to exploit opportunities in the emerging Web Service and Grid context. The emerging technology of the Grid allows geographically distributed resources in hardware, software, data and network to be co-ordinated to meet the needs of “virtual organisations.” We explore how the modularity of our existing code can be exploited in the Grid environment, whilst noting the pre-requisite of a co-operative culture in which both software developers and data providers seek to deliver services to the widest possible community of users.

Parallel processing for geographical applications: A layered approach

Abstract. Significant trends in the processing of geographical data require increasingly powerful software and hardware, consistent with the exploitation of parallel computing. Despite recent progress in technology, exploiting parallel processing is still difficult so that few applications have been developed in the environmental and geographical domains. Key issues which must be addressed in the design of parallel geographical software are described with reference to designs for three examples which use grid and raster data. The implications for parallel processing with vector-topological data are then explored. The emphasis is upon MIMD architectures using strategies of decomposition into subareas, and upon the need to facilitate development of parallel geographical applications by encapsulating the parallelism in a low-level layer of software, forming a skeletal framework upon which application algorithms can be built. The parallel layer will support distribution of datasets across the multiple processors, and the creation and collation of datasets from those processors.

Towards a framework for High Performance Geocomputation: Handling Vector Topology within a Distributed Service Environment

This paper lays out a framework, based on the emerging Open GIS standards, which will allow the integration of parallel computing technology such that it becomes a viable component of a new generation of geographical information system (GIS) software. The significant costs of parallel re-implementation have thus far acted as a major disincentive to software vendors taking advantage of parallel technology to solve performance problems. These problems will be thrown into sharp focus by the demands of web-based geographical information services. Designs for a series of software libraries, which are subject to a prototype implementation involving the use of a sophisticated data format (Neutral Transfer Format Level 4), are examined with a view to re-implementation making use of the Open GIS Abstract Specification Model. A range of services are envisaged, which can provide functions at various levels from data retrieval, spatial analysis and map generation to specialist environmental models, which are made available over the Internet. Parallelism is seen as an important route for accelerating individual transactions. These services can equally be based on large specialised parallel servers or a co-operating set of under-used workstations. The implementation strategy involves insulating standard serial algorithms from parallelism through support libraries. These libraries handle, for example, the decomposition of the data, thus effectively encapsulating the parallelism within one component of the software and allowing the creation of high-performance software components which are compatible with the Open GIS service architecture.

A software framework to create vector-topology in parallel GIS operations

Parallel processing comprises the concurrent use of multiple processors to speed execution of one operation. Although techniques suited to most of the common geographical data models have been prototyped, the prominent exception has been vector-topology. This paper explores whether operations that create a vector-topological dataset can benefit from parallelisation. It describes techniques for using multiple processors concurrently to create vector-topology for multiple sub-areas, and for stitching these sub-areas together to form the resultant dataset. To achieve performance gains over sequential processing, the overhead of the stitching must be less than the gains from the parallel processing of sub-areas. These methods are tested in the context of the conversion of raster data to polygonal vector-topology. Speed-up in comparison to single-processor performance is achieved on both a 4-processor shared-memory Sun server and using up to 15 processors of a Cray T3E. The approach taken hides the parallelism and the management of the vector-topology in a software framework that simplifies the task of parallel application development.

Towards a HPC Framework for Integrated Processing of Geographical Data: Encapsulating the Complexity of Parallel Algorithms

High-performance computing (HPC) techniques are still considered an esoteric research branch of GI processing. They are complex to use, deterring both academic modellers and commercial software developers. Yet the use of many environmental models is constrained by computation times. Furthermore, as remote sensing, environmental modelling and GIS converge, so the need for parallel computing becomes more apparent. Several case studies, parallelising the processing of raster, grid and vector-topology, demonstrate that scope exists for encapsulating the complexity of the parallelism in software frameworks, with strategies of spatial decomposition into sub-areas maximising the re-use of code from sequential algorithms. We show that parallel software frameworks can speed both the development and the execution of new applications. Based upon these case studies, the parallelisation of both interpolation and modelling in one software system is considered, with reference to pest infestation models, using both task and data Transactions in GIS, 2000, 4(3): 245±262 ß 2000 Blackwell Publishers, 108 Cowley Road, Oxford OX4 1JF, UK and 350 Main Street, Malden, MA 02148, USA. Address for correspondence: Michael J. Mineter, Parallel Architectures Laboratory for GIS, Department of Geography, University of Edinburgh, Drummond Street, Edinburgh EH8 9XP, United Kingdom. E-mail: mjm@geo.ed.ac.uk parallelism. We discuss some of the requirements of a parallel software framework to underpin the integrated analysis of geographical data and environmental models.

Can Top-of-Atmosphere Radiation Measurements Constrain Climate Predictions? Part I: Tuning

AbstractPerturbed physics configurations of version 3 of the Hadley Centre Atmosphere Model (HadAM3) driven with observed sea surface temperatures (SST) and sea ice were tuned to outgoing radiation observations using a Gauss–Newton line search optimization algorithm to adjust the model parameters. Four key parameters that previous research found affected climate sensitivity were adjusted to several different target values including two sets of observations. The observations used were the global average reflected shortwave radiation (RSR) and outgoing longwave radiation (OLR) from the Clouds and the Earths Radiant Energy System instruments combined with observations of ocean heat content. Using the same method, configurations were also generated that were consistent with the earlier Earth Radiation Budget Experiment results. Many, though not all, tuning experiments were successful, with about 2500 configurations being generated and the changes in simulated outgoing radiation largely due to changes in clou...

Can Top-of-Atmosphere Radiation Measurements Constrain Climate Predictions? Part II: Climate Sensitivity

AbstractA large number of perturbed-physics simulations of version 3 of the Hadley Centre Atmosphere Model (HadAM3) were compared with the Clouds and the Earths Radiant Energy System (CERES) estimates of outgoing longwave radiation (OLR) and reflected shortwave radiation (RSR) as well as OLR and RSR from the earlier Earth Radiation Budget Experiment (ERBE) estimates. The model configurations were produced from several independent optimization experiments in which four parameters were adjusted. Model–observation uncertainty was estimated by combining uncertainty arising from satellite measurements, observational radiation imbalance, total solar irradiance, radiative forcing, natural aerosol, internal climate variability, and sea surface temperature and that arising from parameters that were not varied. Using an emulator built from 14 001 “slab” model evaluations carried out using the climateprediction.net ensemble, the climate sensitivity for each configuration was estimated. Combining different prior pro...

“Agro-meteorological indices and climate model uncertainty over the UK”

Five stakeholder-relevant indices of agro-meteorological change were analysed for the UK, over past (1961–1990) and future (2061–2090) periods. Accumulated Frosts, Dry Days, Growing Season Length, Plant Heat Stress and Start of Field Operations were calculated from the E-Obs (European Observational) and HadRM3 (Hadley Regional Climate Model) PPE (perturbed physics ensemble) data sets. Indices were compared directly and examined for current and future uncertainty. Biases are quantified in terms of ensemble member climate sensitivity and regional aggregation. Maps of spatial change then provide an appropriate metric for end-users both in terms of their requirements and statistical robustness. A future UK is described with fewer frosts, fewer years with a large number of frosts, an earlier start to field operations (e.g., tillage), fewer occurrences of sporadic rainfall, more instances of high temperatures (in both the mean and upper range), and a much longer growing season.

Partitioning of Vector-Topological Data for Parallel GIS Operations: Assessment and Performance Analysis

Geographical Information Systems (GIS) are able to manipulate spatial data. Such spatial data can be available in a variety of formats, one of the most important of which is the vector-topological. This format retains the topological relationships between geographical features and is commonly used in a range of geographical data analyses. This paper describes the implementation and performance of a parallel data partitioning algorithm for the input of vector-topological data to parallel processes.

Parallel processing for finite-difference modelling of ice sheets

Improved modelling of ice sheets, by use of high resolution and with representation of more physical processes, is constrained by long run-times even on the latest single-processor workstation. Parallel processing therefore has a role to play. This paper describes techniques for the parallel processing of ice sheet models and presents design approaches for both the Cray T3 series and other parallel architectures. An implementation of a fully coupled, thermodynamic, 3D ice sheet model is described for the Cray T3D and is shown to be scaleable and efficient.