Jan David Mol

The LOFAR radio environment

Aims: This paper discusses the spectral occupancy for performing radio astronomy with the Low-Frequency Array (LOFAR), with a focus on imaging observations. Methods: We have analysed the radio-frequency interference (RFI) situation in two 24-h surveys with Dutch LOFAR stations, covering 30-78 MHz with low-band antennas and 115-163 MHz with high-band antennas. This is a subset of the full frequency range of LOFAR. The surveys have been observed with a 0.76 kHz / 1 s resolution. Results: We measured the RFI occupancy in the low and high frequency sets to be 1.8% and 3.2% respectively. These values are found to be representative values for the LOFAR radio environment. Between day and night, there is no significant difference in the radio environment. We find that lowering the current observational time and frequency resolutions of LOFAR results in a slight loss of flagging accuracy. At LOFARs nominal resolution of 0.76 kHz and 1 s, the false-positives rate is about 0.5%. This rate increases approximately linearly when decreasing the data frequency resolution. Conclusions: Currently, by using an automated RFI detection strategy, the LOFAR radio environment poses no perceivable problems for sensitive observing. It remains to be seen if this is still true for very deep observations that integrate over tens of nights, but the situation looks promising. Reasons for the low impact of RFI are the high spectral and time resolution of LOFAR; accurate detection methods; strong filters and high receiver linearity; and the proximity of the antennas to the ground. We discuss some strategies that can be used once low-level RFI starts to become apparent. It is important that the frequency range of LOFAR remains free of broadband interference, such as DAB stations and windmills.

The LOFAR correlator: implementation and performance analysis

LOFAR is the first of a new generation of radio telescopes.Rather than using expensive dishes, it forms a distributed sensor network that combines the signals from many thousands of simple antennas. Its revolutionary design allows observations in a frequency range that has hardly been studied before. Another novel feature of LOFAR is the elaborate use of software to process data, where traditional telescopes use customized hardware. This dramatically increases flexibility and substantially reduces costs, but the high processing and bandwidth requirements compel the use of a supercomputer. The antenna signals are centrally combined, filtered, optionally beam-formed, and correlated by an IBM Blue Gene/P. This paper describes the implementation of the so-called correlator. To meet the real-time requirements, the application is highly optimized, and reaches exceptionally high computational and I/O efficiencies. Additionally, we study the scalability of the system, and show that it scales well beyond the requirements. The optimizations allows us to use only half the planned amount of resources, and process 50% more telescope data, significantly improving the effectiveness of the entire telescope.

LOFAR detections of low-frequency radio recombination lines towards Cassiopeia A

Cassiopeia A was observed using the low-band antennas of the LOw Frequency ARray (LOFAR) with high spectral resolution. This allowed a search for radio recombination lines (RRLs) along the line-of-sight to this source. Five carbon α RRLs were detected in absorption between 40 and 50 MHz with a signal-to-noise ratio of >5 from two independent LOFAR data sets. The derived line velocities (vLSR ~ − 50 km s-1) and integrated optical depths (~13 s-1) of the RRLs in our spectra, extracted over the whole supernova remnant, are consistent within each LOFAR data set and with those previously reported. For the first time, we are able to extract spectra against the brightest hotspot of the remnant at frequencies below 330 MHz. These spectra show significantly higher (15–80 percent) integrated optical depths, indicating that there is small-scale angular structure of the order of ~1 pc in the absorbing gas distribution over the face of the remnant. We also place an upper limit of 3 × 10-4 on the peak optical depths of hydrogen and helium RRLs. These results demonstrate that LOFAR has the desired spectral stability and sensitivity to study faint recombination lines in the decameter band.

Initial deep LOFAR observations of epoch of reionization windows. I. The north celestial pole

Aims. The aim of the LOFAR epoch of reionization (EoR) project is to detect the spectral fluctuations of the redshifted HI 21 cm signal. This signal is weaker by several orders of magnitude than the astrophysical foreground signals and hence, in order to achieve this, very long integrations, accurate calibration for stations and ionosphere and reliable foreground removal are essential. Methods. One of the prospective observing windows for the LOFAR EoR project will be centered at the north celestial pole (NCP). We present results from observations of the NCP window using the LOFAR highband antenna (HBA) array in the frequency range 115 MHz to 163 MHz. The data were obtained in April 2011 during the commissioning phase of LOFAR. We used baselines up to about 30 km. The data was processed using a dedicated processing pipeline which is an enhanced version of the standard LOFAR processing pipeline. Results. With about 3 nights, of 6 h each, effective integration we have achieved a noise level of about 100 mu Jy/PSF in the NCP window. Close to the NCP, the noise level increases to about 180 mu Jy/PSF, mainly due to additional contamination from unsubtracted nearby sources. We estimate that in our best night, we have reached a noise level only a factor of 1.4 above the thermal limit set by the noise from our Galaxy and the receivers. Our continuum images are several times deeper than have been achieved previously using the WSRT and GMRT arrays. We derive an analytical explanation for the excess noise that we believe to be mainly due to sources at large angular separation from the NCP. We present some details of the data processing challenges and how we solved them. Conclusions. Although many LOFAR stations were, at the time of the observations, in a still poorly calibrated state we have seen no artefacts in our images which would prevent us from producing deeper images in much longer integrations on the NCP window which are about to commence. The limitations present in our current results are mainly due to sidelobe noise from the large number of distant sources, as well as errors related to station beam variations and rapid ionospheric phase fluctuations acting on bright sources. We are confident that we can improve our results with refined processing.

Radio Astronomy Beam Forming on Many-Core Architectures

Traditional radio telescopes use large steel dishes to observe radio sources. The largest radio telescope in the world, LOFAR, uses tens of thousands of fixed, omni-directional antennas instead, a novel design that promises ground-breaking research in astronomy. Where traditional tele-scopes use custom-built hardware, LOFAR uses software to do signal processing in real time. This leads to an instrument that is inherently more flexible. However, the enormous data rates and processing requirements (tens to hundreds of teraflops) make this extremely challenging. The next-generation telescope, the SKA, will require exaflops. Unlike traditional instruments, LOFAR and SKA can observe in hundreds of directions simultaneously, using beam forming. This is useful, for example, to search the sky for pulsars (i.e. rapidly rotating highly magnetized neutron stars). Beam forming is an important technique in signal processing: it is also used in WIFI and 4G cellular networks, radar systems, and health-care microwave imaging instruments. We propose the use of many-core architectures, such as 48-core CPU systems and Graphics Processing Units (GPUs), to accelerate beam forming. We use two different frameworks for GPUs, CUDA and Open CL, and present results for hardware from different vendors (i.e. AMD and NVIDIA). Additionally, we implement the LOFAR beam former on multi-core CPUs, using Open MP with SSE vector instructions. We use auto-tuning to support different architectures and implementation frameworks, achieving both platform and performance portability. Finally, we compare our results with the production implementation, written in assembly and running on an IBM Blue Gene/P supercomputer. We compare both computational and power efficiency, since power usage is one of the fundamental challenges modern radio telescopes face. Compared to the production implementation, our auto-tuned beam former is 45-50 times faster on GPUs, and 2-8 times more power efficient. Our experimental results lead to the conclusion that GPUs are an attractive solution to accelerate beam forming.

Processing LOFAR telescope data in real time on a Blue Gene/P supercomputer

This paper gives an overview of the LOFAR correlator. Unlike traditional telescopes, the correlator is implemented in software, yielding a very flexible and reconfigurable instrument. The term “correlator” understates its capabilities: it filters, corrects, coherently or incoherently beam forms, dedisperses, and transforms the data as well. It supports several observation modes, even simultaneously. The high data rates and processing requirements compel the use of a supercomputer; we use a Blue Gene/P. The software is highly optimized and achieves extremely good computational performance and bandwidths, increasing the performance of the entire LOFAR telescope.

The LOFAR beam former: implementation and performance analysis

Traditional radio telescopes use large, steel dishes to observe radio sources. The LOFAR radio telescope is different, and uses tens of thousands of fixed, non-movable antennas instead, a novel design that promises groundbreaking research in astronomy. The antennas observe omnidirectionally, and sky sources are observed by signal-processing techniques that combine the data from all antennas. Another new feature of LOFAR is the elaborate use of software to do signal processing in real time, where traditional telescopes use custom-built hardware. The use of software leads to an instrument that is inherently more flexible. However, the enormous data rate (198 Gb/s of input data) and processing requirements compel the use of a supercomputer: we use an IBM Blue Gene/P. This paper presents a collection of new processing pipelines, collectively called the beam-forming pipelines, that greatly enhance the functionality of the telescope. Where our first pipeline could only correlate data to create sky images, the new pipelines allow the discovery of unknown pulsars, observations of known pulsars, and (in the future), to observe cosmic rays and study transient events. Unlike traditional telescopes, we can observe in hundreds of directions simultaneously. This is useful, for example, to search the sky for new pulsars. The use of software allows us to quickly add new functionality and to adapt to new insights that fully exploit the novel features and the power of our unique instrument. We also describe our optimisations to use the Blue Gene/P at very high efficiencies, maximising the effectiveness of the entire telescope. A thorough performance study identifies the limits of our system.

Initial deep LOFAR observations of epoch of reionization windows

Aims. The aim of the LOFAR epoch of reionization (EoR) project is to detect the spectral fluctuations of the redshifted HI 21 cm signal. This signal is weaker by several orders of magnitude than the astrophysical foreground signals and hence, in order to achieve this, very long integrations, accurate calibration for stations and ionosphere and reliable foreground removal are essential. Methods. One of the prospective observing windows for the LOFAR EoR project will be centered at the north celestial pole (NCP). We present results from observations of the NCP window using the LOFAR highband antenna (HBA) array in the frequency range 115 MHz to 163 MHz. The data were obtained in April 2011 during the commissioning phase of LOFAR. We used baselines up to about 30 km. The data was processed using a dedicated processing pipeline which is an enhanced version of the standard LOFAR processing pipeline. Results. With about 3 nights, of 6 h each, effective integration we have achieved a noise level of about 100 mu Jy/PSF in the NCP window. Close to the NCP, the noise level increases to about 180 mu Jy/PSF, mainly due to additional contamination from unsubtracted nearby sources. We estimate that in our best night, we have reached a noise level only a factor of 1.4 above the thermal limit set by the noise from our Galaxy and the receivers. Our continuum images are several times deeper than have been achieved previously using the WSRT and GMRT arrays. We derive an analytical explanation for the excess noise that we believe to be mainly due to sources at large angular separation from the NCP. We present some details of the data processing challenges and how we solved them. Conclusions. Although many LOFAR stations were, at the time of the observations, in a still poorly calibrated state we have seen no artefacts in our images which would prevent us from producing deeper images in much longer integrations on the NCP window which are about to commence. The limitations present in our current results are mainly due to sidelobe noise from the large number of distant sources, as well as errors related to station beam variations and rapid ionospheric phase fluctuations acting on bright sources. We are confident that we can improve our results with refined processing.

Initial deep LOFAR observations of epoch of reionization windows. I. The north celestial pole : I. The north celestial pole

Aims. The aim of the LOFAR epoch of reionization (EoR) project is to detect the spectral fluctuations of the redshifted HI 21 cm signal. This signal is weaker by several orders of magnitude than the astrophysical foreground signals and hence, in order to achieve this, very long integrations, accurate calibration for stations and ionosphere and reliable foreground removal are essential. Methods. One of the prospective observing windows for the LOFAR EoR project will be centered at the north celestial pole (NCP). We present results from observations of the NCP window using the LOFAR highband antenna (HBA) array in the frequency range 115 MHz to 163 MHz. The data were obtained in April 2011 during the commissioning phase of LOFAR. We used baselines up to about 30 km. The data was processed using a dedicated processing pipeline which is an enhanced version of the standard LOFAR processing pipeline. Results. With about 3 nights, of 6 h each, effective integration we have achieved a noise level of about 100 mu Jy/PSF in the NCP window. Close to the NCP, the noise level increases to about 180 mu Jy/PSF, mainly due to additional contamination from unsubtracted nearby sources. We estimate that in our best night, we have reached a noise level only a factor of 1.4 above the thermal limit set by the noise from our Galaxy and the receivers. Our continuum images are several times deeper than have been achieved previously using the WSRT and GMRT arrays. We derive an analytical explanation for the excess noise that we believe to be mainly due to sources at large angular separation from the NCP. We present some details of the data processing challenges and how we solved them. Conclusions. Although many LOFAR stations were, at the time of the observations, in a still poorly calibrated state we have seen no artefacts in our images which would prevent us from producing deeper images in much longer integrations on the NCP window which are about to commence. The limitations present in our current results are mainly due to sidelobe noise from the large number of distant sources, as well as errors related to station beam variations and rapid ionospheric phase fluctuations acting on bright sources. We are confident that we can improve our results with refined processing.