Hady Salloum

Concurrent use of satellite imaging and passive acoustics for maritime domain awareness

The research being conducted in the Center for Secure and Resilient Maritime Commerce (CSR), a DHS National Center of Excellence for Port Security examines some basic science issues and emerging technologies to improve the security of ports and inland waterways, as well as coastal and offshore operations. This research follows a layered approach utilizing above water and underwater surveillance techniques. The investigated layers include satellite-based wide area surveillance; HF Radar systems providing over-the-horizon monitoring; and nearshore and harbor passive acoustic surveillance. Integration of these systems is aimed at achieving vessel detection, classification, identification, and tracking. In this paper, we present the results of sea tests where satellite imagery was combined with concurrent passive acoustic surveillance. The wide area sensing was provided by the University of Miami CSTARS facilitys electro-optical (EO) and synthetic aperture radar (SAR) satellite imaging capabilities. Satellites detected the ships using a panchromatic EO sensor FormoSat-2 and SAR from the COSMO-SkyMed constellation. The Stevens Passive Acoustic System was used for detecting sound produced by the same ships that were detected by satellites. Concurrent Satellite — Acoustic measurements provide the following advantages: 1. Increasing the probability of small vessel detection and decreasing false alarms. 2. The joint systems can provide redundant detection and classification in conditions where one of the systems fails. For example, EO satellite imaging does not work at night and in fog and cloudy conditions while acoustic detection has limits during stormy weather due to ambient noise. SAR imaging can detect vessels in all weather, but provides less detail about a specific vessel. 3. Acoustics can provide target classification and bearing and satellites can give target localization and heading. SAR data can be used to estimate vessel speed in some cases. 4. Satellite imaging is helpful for the acoustic detection of an underwater target in cases when satellite information allows separation of surface and underwater targets. 5. Joint measurements provide more data (information) for target classification. Several tests were conducted in New York Harbor, where the satellite images and acoustic signatures of the same boats were recorded. The satellite registered a number of small boats. The small boats were acoustically detected at distances up to 4 km and the signal generated by a passenger ferry was observed at a distance up to 7 km.

Acoustic detection, tracking and classification of Low Flying Aircraft

Low Flying Aircraft (LFA) may be used to smuggle illicit drugs or illegal immigrants across borders. Sound radiated by LFA was used for their detection, tracking and classification by the developed Acousto Seismic Air Detection (ASAD) system. ASAD consists of several nodes, where each node has five microphone clusters and three geophones. Single ASAD node can detect aircraft sound, determine their bearing, and classify the target. Two or mode nodes provide target localization. Extended tests of various small aircraft flying according to planned test patterns were conducted in difficult mountainous areas. The comparison of acoustic detection and tracking with ground truth from the GPS carried by the targets allowed the estimation of acoustic detection, bearing and localization distances and their accuracy.

Towards a passive acoustic underwater system for protecting harbours against intruders

The international rules for the protection of harbors against threats and intruders typically apply to threats emanating from the land side. Protection against actions and threats from the water side is much less regulated, apart from some individual cases. Potential threats from the water side may consist of intruders including divers with and without delivery vehicles, swimmers, small submarines, small vessels or unmanned underwater vehicles. To increase the level of readiness against underwater threats in harbors, the Netherlands Organization for Applied Scientific Research (TNO) and the Stevens Institute of Technology have recently combined their long-standing expertise on observation systems and sonar technology and are developing an integrated system that can be used to protect harbors from both surface and underwater intruders. In the fall of 2010, TNO and Stevens will initiate joint experiments in a harbour in The Netherlands, where passive acoustic systems from both parties will be combined. In this paper, potential performance of the experimental system is illustrated via simulations. Initial experimental results will be presented at the conference.

Stevens Passive Acoustic system for surface and underwater threat detection

The ability to safeguard domestic shipping and waterside facilities from threats associated with surface and underwater threats (vessels as well as divers) is critical to ensuring security for the maritime domain. Stevens Institute of Technology has been conducting numerous studies and associated field experiments of passive acoustic sensor applications for the detection, characterization, and tracking of surface and underwater threats, which lead to the development of the Stevens Passive Acoustic Detection System (SPADES). The extended diver detection tests were conducted in Newport, Rhode Island and in Den Helder, The Netherlands. Tests involving surface boats were conducted in various locations, including the New York Harbor, Miami, and San Diego. Acoustic tests in Lake Hopatcong, NJ were also conducted in controlled conditions using six distinct boats, including a Panga, a Go Fast boat, a jet ski, and a quiet electrical boat.

Satellite imaging and passive acoustics in layered approach for small boat detection and classification

Emerging technologies to improve the security of ports and inland waterways, as well as coastal and offshore operations, are examined in research being conducted by the Center for Secure and Resilient Maritime Commerce, a Department of Homeland Security National Center of Excellent for Port Security. A layered approach is followed, using above-water and underwater surveillance techniques. High-frequency radar systems providing over-the-horizon monitoring, satellite-based wide-area surveillance, and nearshore and harbor passive acoustic surveillance are included in the investigated layers. A brief review of the Stevens Institute of Technology research in passive acoustics aimed at achieving underwater and surface targets detection, classification, and tracking is presented. The University of Miami Center for Spatial Technologies and Remote Sensing (CSTARS) facilitys electro-optical and synthetic aperture radar satellite imaging provided satellite imagery which was combined with the passive acoustic data. An analysis of the advantages of concurrent use of satellite imagery with passive acoustics for maritime domain awareness is also presented.

Acoustic methods of invasive species detection in agriculture shipments

Stevens Institute of Technology in cooperation with the DHS Science and Technology Directorate and the U.S. Customs and Border Protection has been investigating engineering solutions to augment the current inspection process at ports of entry in an effort to minimize the threat posed by invasive species. This paper presents the initial results of acoustic sensors application detection of rodents and small insects in grains with the goal of improving the accuracy and effectiveness of current manual inspection methods.

Mice ultrasonic detection and localization in laboratory environment

The acoustic detection and localization of mice movement by monitoring their ultrasonic vocalization has been demonstrated in laboratory environment using ultrasonic system with three microphones that provides recording of ultrasound up to 120 kHz. The tests were approved by Stony Brook University Institutional Animal Care and Use Committee protocol. Signals were recorded in a set of discrete sequences over several hours. The locomotor activity was characterized by durations up to 3000 ms and wide spectral content, while the syllable vocalization constituted shorter 200 ms events, with a set of identifiable up and down frequency modulated tones between 3 kHz and 55 kHz. The Time Difference of Arrival (TDOA) to various microphones was calculated using cross correlation method and was applied for estimation for mice location. Mice are among the invasive species that have a potential of crossing borders of United States unnoticed in containers. This study demonstrates the feasibility of using acoustic method...

Passive acoustic localization of small aircraft

Stevens Institute of Technology has built the Acoustic Aircraft Detection (AAD) system for the detection, tracking and classification of Low Flying Aircraft (LFA). LFA may be of concern as they have been used for illicit operations. The AAD consists of several nodes deployed in a wide area, where each node acquires signals from a cluster of five microphones. The calculation of the cross-correlation function of acoustic signals received by various microphone pairs is applied for finding the direction of the signal arrival. Fusion of time difference of arrival estimates from several pairs of acoustic sensors has resulted in the improvement of angle estimation accuracy. Triangulation of the direction of arrival estimates from two or more nodes was applied for determining the target position and altitude. Kalman filtering was used for smoothing the target tracks and decreasing the localization uncertainties. Software for predicting the performance was developed and was used to inform sensor placement in the f...

Improvement of the Detection of Envelope Modulation on Noise (DEMON) and its application to small boats

The Detection of Envelope Modulation on Noise (DEMON) algorithm is popular for the identification of vessels from passive acoustic data. We suggest several improvements to the DEMON algorithm: First, an extension of the DEMON algorithm for determining time delay of arrival of an acoustic signal based on the phase delay of DEMON spectral components from two hydrophones. Then we show the DEMON spectra of a variety of small vessels measured in controlled conditions. Their various characteristics are discussed in the context of vessel classification from DEMON spectra. Finally, the dependence of the DEMON spectra on the passband of propeller noise were investigated using the Cyclic Modulation Spectrum, and optimum frequencies for demodulation were found.

Experimental security surveillance system for an Island-based facility

A test bed was developed for Plum Island, NY experimental multi-sensor security surveillance. The system includes broadband radars, cameras, an Automatic Identification System receiver, geophones and underwater passive acoustic sensors. The sensors were grouped into nodes connected to a Command and Control Center via a Wi-Fi network. Some sensors are COTS, some were developed and built by Stevens Institute of Technology. Sensor network was tested for the detection of potential surface and underwater intruders. This paper presents a system description and sensor performance estimations for various targets, including jet skis, small boats, kayaks, and divers. The system design performance versus cost considerations and methods of sensor integration are discussed.