Mohammad H. Rahimi

Cyclops: in situ image sensing and interpretation in wireless sensor networks

Despite their increasing sophistication, wireless sensor networks still do not exploit the most powerful of the human senses: vision. Indeed, vision provides humans with unmatched capabilities to distinguish objects and identify their importance. Our work seeks to provide sensor networks with similar capabilities by exploiting emerging, cheap, low-power and small form factor CMOS imaging technology. In fact, we can go beyond the stereo capabilities of human vision, and exploit the large scale of sensor networks to provide multiple, widely different perspectives of the physical phenomena.To this end, we have developed a small camera device called Cyclops that bridges the gap between the computationally constrained wireless sensor nodes such as Motes, and CMOS imagers which, while low power and inexpensive, are nevertheless designed to mate with resource-rich hosts. Cyclops enables development of new class of vision applications that span across wireless sensor network. We describe our hardware and software architecture, its temporal and power characteristics and present some representative applications.

Robomote: enabling mobility in sensor networks

Severe energy limitations, and a paucity of computation pose a set of difficult design challenges for sensor networks. Recent progress in two seemingly disparate research areas namely, distributed robotics and low power embedded systems has led to the creation of mobile (or robotic) sensor networks. Autonomous node mobility brings with it its own challenges, but also alleviates some of the traditional problems associated with static sensor networks. We illustrate this by presenting the design of the robomote, a robot platform that functions as a single mobile node in a mobile sensor network. We briefly describe two case studies where the robomote has been used for table top experiments with a mobile sensor network.

Call and response: experiments in sampling the environment

Monitoring of environmental phenomena with embedded networked sensing confronts the challenges of both unpredictable variability in the spatial distribution of phenomena, coupled with demands for a high spatial sampling rate in three dimensions. For example, low distortion mapping of critical solar radiation properties in forest environments may require two-dimensional spatial sampling rates of greater than 10 samples/m2 over transects exceeding 1000 m2. Clearly, adequate sampling coverage of such a transect requires an impractically large number of sensing nodes. This paper describes a new approach where the deployment of a combination of autonomous-articulated and static sensor nodes enables sufficient spatiotemporal sampling densityo ver large transects to meet a general set of environmental mapping demands. To achieve this we have developed an embedded networked sensor architecture that merges sensing and articulation with adaptive algorithms that are responsive to both variabilityin environmental phenomena discovered bythe mobile sensors and to discrete events discovered byst atic sensors. We begin byde scribing the class of important driving applications, the statistical foundations for this new approach, and task allocation. We then describe our experimental implementation of adaptive, event aware, exploration algorithms, which exploit our wireless, articulated sensors operating with deterministic motion over large areas. Results of experimental measurements and the relationship among sampling methods, event arrival rate, and sampling performance are presented.

Adaptive sampling for environmental robotics

The capabilities and distributed nature of networked sensors are uniquely suited to the characterization of distributed phenomena in the natural environment. However, environmental characterization by fixed distributed sensors encounters challenges in complex environments. In this paper we describe Networked Infomechanical Systems (NIMS), a new distributed, robotic sensor methodology developed for applications including characterization of environmental structure and phenomena. NIMS exploits deployed infrastructure that provides the benefits of precise motion, aerial suspension, and low energy sustainable operations in complex environments. NIMS nodes may explore a three-dimensional environment and enable the deployment of sensor nodes at diverse locations and viewing perspectives. NIMS characterization of phenomena in a three dimensional space must now consider the selection of sensor sampling points in both time and space. Thus, we introduce a new approach of mobile node adaptive sampling with the objective of minimizing error between the actual and reconstructed spatiotemporal behavior of environmental variables while minimizing required motion. In this approach, the NIMS node first explores as an agent, gathering a statistical description of phenomena using a nested stratified random sampling approach. By iteratively increasing sampling resolution, guided adaptively by the measurement results themselves, this NIMS sampling enables reconstruction of phenomena with a systematic method for balancing accuracy with sampling resource cost in time and motion. This adaptive sampling method is described analytically and also tested with simulated environmental data. Experimental evaluations of adaptive sampling algorithms have also been completed. Specifically, NIMS experimental systems have been developed for monitoring of spatiotemporal variation of atmospheric climate phenomena. A NIMS system has been deployed at a field biology station to map phenomena in a 50m width and 50m span transect in a forest environment. In addition, deployments have occurred in testbed environments allowing additional detailed characterization of sampling algorithms. Environmental variable mapping of temperature, humidity, and solar illumination have been acquired and used to evaluate the adaptive sampling methods reported here. These new methods have been shown to provide a significant advance for efficient mapping of spatially distributed phenomena by NIMS environmental robotics.

Networked infomechanical systems: a mobile embedded networked sensor platform

Networked infomechanical systems (NIMS) introduces a new actuation capability for embedded networked sensing. By exploiting a constrained actuation method based on rapidly deployable infrastructure, NIMS suspends a network of wireless mobile and fixed sensor nodes in three-dimensional space. This permits run-time adaptation with variable sensing location, perspective, and even sensor type. Discoveries in NIMS environmental investigations have raised requirements for 1) new embedded platforms integrating many diverse sensors with actuators, and 2) advances for in-network sensor data processing. This is addressed with a new and generally applicable processor-preprocessor architecture described in this paper. Also this paper describes the successful integration of R, a powerful statistical computing environment, into the embedded NIMS node platform.

Controlled mobility for sustainable wireless sensor networks

A key challenge in sensor networks is ensuring the sustainability of the system at the required performance level, in an autonomous manner. Sustainability is a major concern because of severe resource constraints in terms of energy, bandwidth and sensing capabilities in the system. In this paper, we envision the use of a new design dimension to enhance sustainability in sensor networks - the use of controlled mobility. We argue that this capability can alleviate resource limitations and improve system performance by adapting to deployment demands. While opportunistic use of external mobility has been considered before, the use of controlled mobility is largely unexplored. We also outline the research issues associated with effectively utilizing this new design dimension. Two system prototypes are described to present first steps towards realizing the proposed vision.

Energy-Efficient Image Compression for Resource-Constrained Platforms

One of the most important goals of current and future sensor networks is energy-efficient communication of images. This paper presents a quantitative comparison between the energy costs associated with 1) direct transmission of uncompressed images and 2) sensor platform-based JPEG compression followed by transmission of the compressed image data. JPEG compression computations are mapped onto various resource-constrained platforms using a design environment that allows computation using the minimum integer and fractional bit-widths needed in view of other approximations inherent in the compression process and choice of image quality parameters. Advanced applications of JPEG, such as region of interest coding and successive/progressive transmission, are also examined. Detailed experimental results examining the tradeoffs in processor resources, processing/transmission time, bandwidth utilization, image quality, and overall energy consumption are presented.

Adaptive sampling for environmental field estimation using robotic sensors

Monitoring environmental phenomena by distributed sensor sampling confronts the challenge of unpredictable variability in the spatial distribution of phenomena often coupled with demands for a high spatial sampling rate. The introduction of actuation-enabled robotics sensors permits a system to optimize the sampling distribution through runtime adaptation. However, such systems must efficiently dispense sampling points or otherwise suffer from poor temporal response. In this paper, we propose and characterize an active modeling system. In our approach, as the robotic sensor acquires measurement samples of the environment, it builds a model of the phenomenon. Our algorithm is based on an incremental optimization process where the robot supports a continuous, iterative process of 1) collecting samples with maximal coverage in the design space; 2) building the environmental model; 3) predicting sampling point locations that contribute the greatest certainty regarding the phenomenon; and 4) sampling the environment based on a combined measure of information gain and navigation and sampling cost. This can provide significant reductions in the magnitude of field estimation error with a modest navigational trajectory time. We evaluate our algorithm through a simulation, using a combination of static and mobile sensors sampling light illumination field.

Heartbeat of a nest: Using imagers as biological sensors

We present a scalable end-to-end system for vision-based monitoring of natural environments, and illustrate its use for the analysis of avian nesting cycles. Our system enables automated analysis of thousands of images, where manual processing would be infeasible. We automate the analysis of raw imaging data using statistics that are tailored to the task of interest. These “features” are a representation to be fed to classifiers that exploit spatial and temporal consistencies. Our testbed can detect the presence or absence of a bird with an accuracy of 82%, count eggs with an accuracy of 84%, and detect the inception of the nesting stage within a day. Our results demonstrate the challenges and potential benefits of using imagers as biological sensors. An exploration of system performance under varying image resolution and frame rate suggest that an in situ adaptive vision system is technically feasible.

Cyclops, image sensing and interpretation in wireless networks

Technological progress in integrated, low power CMOS imaging [1] and maturing low power wireless sensor network platforms, motivate a new and rich design space exploiting in network dense imaging. In particular, by combining comparably low power CMOS cameras and low power wireless sensor nodes, and implementing on board compression and image analysis techniques, we can greatly enhance the application of dense wireless sensor networks to phenomena that are most readily observed in the optical domain. In this demonstration we will introduce Cyclops. Cyclops (see Figure 1) is a joint project between Agilent Technology and the Center for Embedded Networked Sensing (CENS). It is a low power CMOS imager with a local frame grabber and local computation. It behaves like a sensor for a host and can do local computation and inference, acting as a more capable sensor. Inference can be based on a color histogram, statistical characteristics of images, or a hypothesis such as the existence of motion or a specific template in the scene. The demonstration will showcase the functionality of the first generation of Cyclops, including low duty cycle image capture and participation in a sensor network via an attached Crossbow Mica2. Performance studies will also be presented, along with outstanding challenges and foreseeable opportunities.