Donald F. McMullen

The common instrument middleware architecture: overview of goals and implementation

Instruments and sensors and their accompanying actuators are essential to the conduct of scientific research. In many cases they provide observations in electronic format and can be connected to computer networks with varying degrees of remote interactivity. These devices vary in their architectures and type of data they capture and may generate data at various rates. In this paper we present an overview of the design goals and initial implementation of the common instrument middleware architecture (CIMA), a framework for making instruments and sensors network accessible in a standards-based, uniform way, and for interacting remotely with instruments and the data they produce. Some of the issues CIMA addresses include: flexibility in network transport, efficient and high throughput data transport, the availability (or lack of) computational, storage and networking resources at the instrument or sensor platform, evolution of instrument design, and reuse of data acquisition and processing codes

Instrument monitoring, data sharing, and archiving using Common Instrument Middleware Architecture (CIMA).

The Common Instrument Middleware Architecture (CIMA) aims at Grid-enabling a wide range of scientific instruments and sensors to enable easy access to and sharing and storage of data produced by these instruments and sensors. This paper describes the implementation of CIMA applied to the field of single-crystal X-ray crystallography. To allow the researchers to easily view the current and past data streams from the instruments or sensors in a laboratory, a crystallography portal and associated portlets were developed for this application. The CIMA-based crystallography system provides an opportunity for anyone with Web access to observe and use crystallographic and other data from laboratories that previously had only limited access.

Web 2.0 for Grids and e-Science

Web 2.0-style services and capabilities collectively define a comprehensive distributed computing environment that may be considered an alternative or supplement to existing Grid computing approaches for e-Science. Web 2.0 is briefly summarized as building upon network-enabled, stateless services with simple message formats and message exchange patterns to build rich client interfaces, mash-ups (custom, composite, Web applications), and online communities. In this article, we review several of our activities in these areas: service architectures for Chemical Informatics; Web 2.0 approaches for managing real-time data from online experiments; management and federation of digital entities and their metadata obtained from multiple services; and the use of tagging and social bookmarking to foster scientific networking at minority serving institutions. We conclude with a discussion of further research opportunities in the application of Web 2.0 to e-Science.

CIMA Based Remote Instrument and Data Access: An Extension into the Australian e-Science Environment

The Common Instrument Middleware Architecture (CIMA) is being used as a core component of a portal based remote instrument access system being developed as an Australian e-Science project. The CIMA model is being enhanced to use federated Grid storage infrastructure (SRB), and the Kepler workflow system to, as much as possible, automate data management, and the facile extraction and generation of instrument and experimental metadata. The Personal Grid Library is introduced as a user friendly portlet interface to SRB data and metadata, and which supports customisable metadata schemas. An Instrument Instruction Module has been introduced as a CIMA plug-in for instrument control. A virtual instrument portlet provides a simulation of the instrument during a data collection. The system is being further augmented with a tool for collaborative data visualisation and evaluation.

Connecting users to instruments and sensors: portals as multi‐user GUIs for instrument and sensor facilities

The Common Instrument Middleware Architecture (CIMA) aims at integrating instruments and sensors into computing and storage Grids through a standard interface methodology that existing and future instrument facilities can provide. This instrument interface provides a base which data acquisition and reduction applications can rely on as the design of the underlying facilities evolves and changes. After connecting instruments and sensors in a reliable and secure manner to applications, the next step is to integrate instruments, data acquisition, reduction and analysis applications with community provided resources such as application servers, temporary and archival storage. Practices and workflows at the instrument facilities also need to be captured and presented to users. Portals provide a natural approach to a ‘community’ interface to instrument and sensor facilities. Here we describe the CIMA Crystallography portal, a portal based on GridSphere that provides a user interface to equipment and workflows for a global federation of crystallography laboratories. Copyright

Providing Portlet-Based Client Access to CIMA-Enabled Crystallographic Instruments, Sensors, and Data

The Common Instrument Middleware Architecture (CIMA) project, supported by the NSF Middleware Initiative, aims at making scientific instruments and sensors remotely accessible by providing a general solution for services and user interfaces to remotely access data from instruments and to remotely monitor experiments. X-ray crystallography is one of several motivating applications for the development of CIMA. Data such as CCD frames and sensor readings may be accessed by portals through middleware services as they are being acquired or through persistent archives. CIMA software may be used to federate online instruments in multiple labs, so this project must also address problems in data management and data sharing. This paper describes a collaboration between the CIMA and the Open Grid Computing Environments (OGCE) project to enable remote users to monitor instruments and interact with data gathered from CIMA-enabled crystallography laboratories through various Web portal components (portlets) running within a standards-compliant portal container. We also discuss an approach taken to develop portlets that use Web services for data management and solutions for managing distributed identity and access control

Toward Standards for Integration of Instruments into Grid Computing Environments

Instruments and sensors are the primary sources of data driving science and the development and refinement of theory. A critical component of eresearch yet to be clarified is the role of instruments in cyberinfrastructure. Are instruments, sensors and other real-time data sources to be mediated by file systems, or can they be fully integrated into computing and storage grids with appropriate protocol standards? Our position is that they can and must become regular grid resources and that standards for doing so represent an important research topic. Our approach, the Common Instrument Middleware Architecture, and a model application, X-ray crystallography, are described here in order to stimulate a broader discussion of requirements for grid-enabling instruments and sensors.

Remote instrument control with CIMA Web services and Web 2.0 technology

The Common Instrument Middleware Architecture (CIMA) model for Web services based monitoring of remote scientific instruments is being extended and enhanced to provide a capability for remote instrument control. X-ray diffraction has been selected as an ideal domain for prototype development, with the goal being a comprehensive and feature rich portal system for access to remote instruments and their data. The system has two principle components, one of which serves the instrument and data, and the second serves the client user. Plugin modules are used to provide flexibility and re-use, and the notion of plugin control is being developed. The architecture supports remote access to multiple instruments from a single portal. The use of Web 2.0 Pushlet and AJAX technologies has been introduced for push based portlet refresh and updating. An X3D based 3D virtual representation of the instrument provides data collection simulation and (pseudo) real time instrument representation.

Portal Services for Collaborative Remote Instrument Control, Monitoring and Data Access

A two component portal system is being developed for collaborative remote instrument and data control and monitoring. The system builds on and enhances the common instrument middleware architecture (CIMA) model for Web services based monitoring of remote scientific instruments and sensors. The architecture supports remote access to multiple instruments from a single portal. Plugin modules are used to provide flexibility and re-use, and the notion of plugin control is being developed. The use of Web 2.0 Pushlet and AJAX technologies has been introduced for push based portlet refresh and updating. An X3D based 3D virtual representation of the instrument provides data collection simulation and (pseudo) real time instrument representation. An important component of the system is a Webs services driven portlet for collaborative image viewing.