Janet Deponte Evans

The Chandra X-ray Observatory calibration database (CalDB): building, planning, and improving

The calibration database implemented for the Chandra X-ray Observatory is the most detailed and extensive CalDB of its kind to date. Built according to the NASA High Energy Astrophysics Science Archive Research Center (HEASARC) CalDB prescription, the Chandra CalDB provides indexed, selectable calibration data for detector responses, mirror effective areas, grating efficiencies, instrument geometries, default source aim points, CCD characteristics, and quantum efficiencies, among many others. The combined index comprises approximately 500 entries. A standard FTOOLS parametric interface allows users and tools to access the index. Unique dataset selection requires certain input calibration parameters such as mission, instrument, detector, UTC date and time, and certain ranged parameter values. The goals of the HEASARC CalDB design are (1) to separate software upgrades from calibration upgrades, (2) to allow multi-mission use of analysis software (for missions with a compliant CalDB) and (3) to facilitate the use of multiple software packages for the same data. While we have been able to meet the multivariate needs of Chandra with the current CalDB implementation from HEASARC, certain requirements and desirable enhancements have been identified that raise the prospect of a developmental rewrite of the CalDB system. The explicit goal is to meet Chandras specific needs better, but such upgrades may also provide significant advantages to CalDB planning for future missions. In particular we believe we will introduce important features aiding in the development of mission-independent analysis software. We report our current plans and progress.

STATISTICAL CHARACTERIZATION OF THE CHANDRA SOURCE CATALOG

The first release of the Chandra Source Catalog (CSC) contains ~95,000 X-ray sources in a total area of 0.75% of the entire sky, using data from ~3900 separate ACIS observations of a multitude of different types of X-ray sources. In order to maximize the scientific benefit of such a large, heterogeneous data set, careful characterization of the statistical properties of the catalog, i.e., completeness, sensitivity, false source rate, and accuracy of source properties, is required. Characterization efforts of other large Chandra catalogs, such as the ChaMP Point Source Catalog or the 2 Mega-second Deep Field Surveys, while informative, cannot serve this purpose, since the CSC analysis procedures are significantly different and the range of allowable data is much less restrictive. We describe here the characterization process for the CSC. This process includes both a comparison of real CSC results with those of other, deeper Chandra catalogs of the same targets and extensive simulations of blank-sky and point-source populations.

The Chandra X-ray Observatory data processing system

Raw data from the Chandra X-ray Observatory are processed by a set of standard data processing pipelines to create scientifically useful data products appropriate for further analysis by end users. Fully automated pipelines read the dumped raw telemetry byte stream from the spacecraft and perform the common reductions and calibrations necessary to remove spacecraft and instrumental signatures and convert the data into physically meaningful quantities that can be further analyzed by observers. The resulting data products are subject to automated validation to ensure correct pipeline processing and verify that the spacecraft configuration and scheduling matched the observers request and any constraints. In addition, pipeline processing monitors science and engineering data for anomalous indications and trending, and triggers alerts if appropriate. Data products are ingested and stored in the Chandra Data Archive, where they are made available for downloading by users. In this paper, we describe the architecture of the data processing system, including the scientific algorithms that are applied to the data, and interfaces to other subsystems. We place particular emphasis on the impacts of design choices on system integrity and maintainability. We review areas where algorithmic improvements or changes in instrument characteristics have required significant enhancements, and the mechanisms used to effect these changes while assuring continued scientific integrity and robustness. We discuss major enhancements to the data processing system that are currently being developed to automate production of the Chandra Source Catalog.

Iris: an Extensible Application for Building and Analyzing Spectral Energy Distributions

Iris is an extensible application that provides astronomers with a user-friendly interface capable of ingesting broad-band data from many different sources in order to build, explore, and model spectral energy distributions (SEDs). Iris takes advantage of the standards defined by the International Virtual Observatory Alliance, but hides the technicalities of such standards by implementing different layers of abstraction on top of them. Such intermediate layers provide hooks that users and developers can exploit in order to extend the capabilities provided by Iris. For instance, custom Python models can be combined in arbitrary ways with the Iris built-in models or with other custom functions. As such, Iris offers a platform for the development and integration of SED data, services, and applications, either from the users system or from the web. In this paper we describe the built-in features provided by Iris for building and analyzing SEDs. We also explore in some detail the Iris framework and software development kit, showing how astronomers and software developers can plug their code into an integrated SED analysis environment.

Managing distributed software development in the Virtual Astronomical Observatory

The U.S. Virtual Astronomical Observatory (VAO) is a product-driven organization that provides new scientific research capabilities to the astronomical community. Software development for the VAO follows a lightweight framework that guides development of science applications and infrastructure. Challenges to be overcome include distributed development teams, part-time efforts, and highly constrained schedules. We describe the process we followed to conquer these challenges while developing Iris, the VAO application for analysis of 1-D astronomical spectral energy distributions (SEDs). Iris was successfully built and released in less than a year with a team distributed across four institutions. The project followed existing International Virtual Observatory Alliance inter-operability standards for spectral data and contributed a SED library as a by-product of the project. We emphasize lessons learned that will be folded into future development efforts. In our experience, a well-defined process that provides guidelines to ensure the project is cohesive and stays on track is key to success. Internal product deliveries with a planned test and feedback loop are critical. Release candidates are measured against use cases established early in the process, and provide the opportunity to assess priorities and make course corrections during development. Also key is the participation of a stakeholder such as a lead scientist who manages the technical questions, advises on priorities, and is actively involved as a lead tester. Finally, frequent scheduled communications (for example a bi-weekly tele-conference) assure issues are resolved quickly and the team is working toward a common vision.

Planning and developing the Chandra Source Catalog

The Chandra Source Catalog, presently being developed by the Chandra X-ray Center, will be the definitive catalog of all X-ray sources detected by the Chandra X-ray Observatory. The catalog interface will provide users with a simple mechanism to perform advanced queries on the data content of the archival holdings on a source-by-source basis for X-ray sources matching user-specified search criteria, and is intended to satisfy the needs of a broad-based group of scientists, including those who may be less familiar with astronomical data analysis in the X-ray regime. For each detected X-ray source, the catalog will record commonly tabulated quantities that can be queried, including source position, dimensions, multi-band fluxes, hardness ratios, and variability statistics, derived from all of the observations that include the source within the field of view. However, in addition to these traditional catalog elements, for each X-ray source the catalog will include an extensive set of file-based data products that can be manipulated interactively by the catalog user, including source images, event lists, light curves, and spectra from each observation in which a source is detected. In this paper, we emphasize the design and development of the Chandra Source Catalog. We describe the evaluation process used to plan the data content of the catalog, and the selection of the tabular properties and file-based data products to be provided to the user. We discuss our approach for managing catalog updates derived from either additional data from new observations or from improvements to calibrations and/or analysis algorithms.

The software development process at the Chandra X-ray Center

Software development for the Chandra X-ray Center Data System began in the mid 1990s, and the waterfall model of development was mandated by our documents. Although we initially tried this approach, we found that a process with elements of the spiral model worked better in our science-based environment. High-level science requirements are usually established by scientists, and provided to the software development group. We follow with review and refinement of those requirements prior to the design phase. Design reviews are conducted for substantial projects within the development team, and include scientists whenever appropriate. Development follows agreed upon schedules that include several internal releases of the task before completion. Feedback from science testing early in the process helps to identify and resolve misunderstandings present in the detailed requirements, and allows review of intangible requirements. The development process includes specific testing of requirements, developer and user documentation, and support after deployment to operations or to users. We discuss the process we follow at the Chandra X-ray Center (CXC) to develop software and support operations. We review the role of the science and development staff from conception to release of software, and some lessons learned from managing CXC software development for over a decade.

The preliminary design of the G-CLEF spectrograph instrument device control system

The Giant Magellan Telescope (GMT)-Consortium Large Earth Finder (G-CLEF) is a fiber-fed, precision radial velocity optical echelle spectrograph. The preliminary software design incorporates a hierarchical, multi-level state machine. At the lowest level, the state machine utilizes GMT-provided frameworks to communicate with the hardware. At higher levels of abstraction, the design makes extensive use of State Chart Extensible Markup Language (SCXML) representations to define the operation of the instrument. The functionality of the design can be validated by executing these representations. The incorporation of an interpreter to directly execute the SCXML as a component of the control system is being investigated. The approaches used to develop the preliminary software design concept are described, the use and utility of SCXML for instrument control is discussed, and the application of the preliminary design to a subset of G-CLEF subsystems is demonstrated.

Precision thermal control of the GMT-Consortium Large Earth Finder (G-CLEF)

The GMT-Consortium Large Earth Finder (G-CLEF) will be part of the first generation instrumentation suite for the Giant Magellan Telescope (GMT). G-CLEF will be a general purpose optical passband echelle spectrograph with a precision radial velocity (PRV) capability of 10 cm/sec, a requirement necessary for the detection of Earth analogues. The instrument will be particularly sensitive to thermal effects and the necessary stability cannot be achieved through the use of low CTE materials alone. It is the combination of low CTE materials and exquisite thermal control which will enable the instrument to achieve its precision requirements. G-CLEF will complete its Critical Design phase in mid-2018. In this paper, we discuss the precision thermal control systems which enable milli-Kelvin-level stability of the spectrograph and its red and blue focal planes. The measurement electronics and thermal control strategies used in the spectrograph are described. Of particular importance is the development of a continuous LN2 flow cryo-cooler system used to maintain the focal planes at stable cryogenic operational temperatures. This system has been validated with a prototyping effort completed during the instrument’s design phase. We also review G-CLEF’s insulated enclosure which simultaneously maintains the spectrograph a stable temperature and limits the maximum thermal leakage into the telescope dome. This work has been supported by the GMTO Corporation, a non-profit organization operated on behalf of an international consortium of universities and institutions: Arizona State University, Astronomy Australia Ltd, the Australian National University, the Carnegie Institution for Science, Harvard University, the Korea Astronomy and Space Science Institute, the São Paulo Research Foundation, the Smithsonian Institution, the University of Texas at Austin, Texas AM University, the University of Arizona, and the University of Chicago.

The opto-mechanical design of the GMT-Consortium Large Earth Finder (G-CLEF)

The GMT-Consortium Large Earth Finder (G-CLEF) will be part of the first generation instrumentation suite for the Giant Magellan Telescope (GMT). G-CLEF is a general purpose echelle spectrograph operating in the optical passband with precision radial velocity (PRV) capability. The measurement precision goal of G-CLEF is 10 cm/sec; necessary for the detection of Earth analogues. This goal imposes challenging stability requirements on the optical mounts and spectrograph support structures especially when considering the instrument’s operational environment. G-CLEF’s accuracy will be influenced by changes in temperature and ambient air pressure, vibration, and micro gravity-vector variations caused by normal telescope motions. For these reasons we have chosen to enclose G-CLEF’s spectrograph in a wellinsulated, vibration-isolated vacuum chamber in a gravity invariant location on GMT’s azimuth platform. Additional design constraints posed by the GMT telescope include; a limited space envelope, a thermal leakage ceiling, and a maximum weight allowance. Other factors, such as manufacturability, serviceability, available technology, and budget are also significant design drivers. G-CLEF will complete its Critical Design phase in mid-2018. In this paper, we discuss the design of GCLEF’s optical mounts and support structures including the choice of a low-CTE carbon-fiber optical bench. We discuss the vacuum chamber and vacuum systems. We discuss the design of G-CLEF’s insulated enclosure and thermal control systems which simultaneously maintain the spectrograph at milli-Kelvin level stability and limit thermal leakage into the telescope dome. Also discussed are micro gravity-vector variations caused by normal telescope slewing, their uncorrected influence on image motion, and how they are dealt with in the design. We discuss G-CLEF’s front-end assembly and fiber-feed system as well as other interface, integration and servicing challenges presented by the telescope, enclosure, and neighboring instrumentation. This work has been supported by the GMTO Corporation, a non-profit organization operated on behalf of an international consortium of universities and institutions: Arizona State University, Astronomy Australia Ltd, the Australian National University, the Carnegie Institution for Science, Harvard University, the Korea Astronomy and Space Science Institute, the São Paulo Research Foundation, the Smithsonian Institution, the University of Texas at Austin, Texas AM University, the University of Arizona, and the University of Chicago.