Bodhi Priyantha

FM-based indoor localization

The major challenge for accurate fingerprint-based indoor localization is the design of robust and discriminative wireless signatures. Even though WiFi RSSI signatures are widely available indoors, they vary significantly over time and are susceptible to human presence, multipath, and fading due to the high operating frequency. To overcome these limitations, we propose to use FM broadcast radio signals for robust indoor fingerprinting. Because of the lower frequency, FM signals are less susceptible to human presence, multipath and fading, they exhibit exceptional indoor penetration, and according to our experimental study they vary less over time when compared to WiFi signals. In this work, we demonstrate through a detailed experimental study in 3 different buildings across the US, that FM radio signal RSSI values can be used to achieve room-level indoor localization with similar or better accuracy to the one achieved by WiFi signals. Furthermore, we propose to use additional signal quality indicators at the physical layer (i.e., SNR, multipath etc.) to augment the wireless signature, and show that localization accuracy can be further improved by more than 5%. More importantly, we experimentally demonstrate that the localization errors of FM andWiFi signals are independent. When FM and WiFi signals are combined to generate wireless fingerprints, the localization accuracy increases as much as 83% (when accounting for wireless signal temporal variations) compared to when WiFi RSSI only is used as a signature.

LittleRock: Enabling Energy-Efficient Continuous Sensing on Mobile Phones

Todays mobile phones come with a rich set of built-in sensors such as accelerometers, ambient light sensors, compasses, and pressure sensors, which can measure various phenomena on and around the phone. Gathering user context such as user activity, geographic location, and location type requires continuous sampling of sensor data. However, such sampling shortens a phones battery life because of the associated energy overhead. This article examines the root causes of this energy overhead and shows that energy-efficient continuous sensing can be achieved through proper system design.

SpeakerSense: energy efficient unobtrusive speaker identification on mobile phones

Automatically identifying the person you are talking with using continuous audio sensing has the potential to enable many pervasive computing applications from memory assistance to annotating life logging data. However, a number of challenges, including energy efficiency and training data acquisition, must be addressed before unobtrusive audio sensing is practical on mobile devices. We built SpeakerSense, a speaker identification prototype that uses a heterogeneous multi-processor hardware architecture that splits computation between a low power processor and the phones application processor to enable continuous background sensing with minimal power requirements. Using SpeakerSense, we benchmarked several system parameters (sampling rate, GMM complexity, smoothing window size, and amount of training data needed) to identify thresholds that balance computation cost with performance. We also investigated channel compensation methods that make it feasible to acquire training data from phone calls and an automatic segmentation method for training speaker models based on one-to-one conversations.

Energy efficient GPS sensing with cloud offloading

Location is a fundamental service for mobile computing. Typical GPS receivers, although widely available, consume too much energy to be useful for many applications. Observing that in many sensing scenarios, the location information can be post-processed when the data is uploaded to a server, we design a Cloud-Offloaded GPS (CO-GPS) solution that allows a sensing device to aggressively duty-cycle its GPS receiver and log just enough raw GPS signal for post-processing. Leveraging publicly available information such as GNSS satellite ephemeris and an Earth elevation database, a cloud service can derive good quality GPS locations from a few milliseconds of raw data. Using our design of a portable sensing device platform called CLEO, we evaluate the accuracy and efficiency of the solution. Compared to more than 30 seconds of heavy signal processing on standalone GPS receivers, we can achieve three orders of magnitude lower energy consumption per location tagging.

Energy characterization and optimization of image sensing toward continuous mobile vision

A major hurdle to frequently performing mobile computer vision tasks is the high power consumption of image sensing. In this work, we report the first publicly known experimental and analytical characterization of CMOS image sensors. We find that modern image sensors are not energy-proportional: energy per pixel is in fact inversely proportional to frame rate and resolution of image capture, and thus image sensor systems fail to provide an important principle of energy-aware system design: trading quality for energy efficiency. We reveal two energy-proportional mechanisms, supported by current image sensors but unused by mobile systems: (i) using an optimal clock frequency reduces the power up to 50% or 30% for low-quality single frame (photo) and sequential frame (video) capturing, respectively; (ii) by entering low-power standby mode between frames, an image sensor achieves almost constant energy per pixel for video capture at low frame rates, resulting in an additional 40% power reduction. We also propose architectural modifications to the image sensor that would further improve operational efficiency. Finally, we use computer vision benchmarks to show the performance and efficiency tradeoffs that can be achieved with existing image sensors. For image registration, a key primitive for image mosaicking and depth estimation, we can achieve a 96% success rate at 3 FPS and 0.1 MP resolution. At these quality metrics, an optimal clock frequency reduces image sensor power consumption by 36% and aggressive standby mode reduces power consumption by 95%.

Indoor Localization Using FM Signals

The major challenge for accurate fingerprint-based indoor localization is the design of robust and discriminative wireless signatures. Even though WiFi received signal strength indicator (RSSI) signatures are widely available indoors, they vary significantly over time and are susceptible to human presence, multipath, and fading due to the high operating frequency. To overcome these limitations, we propose to use FM broadcast radio signals for robust indoor fingerprinting. Because of the lower frequency, FM signals are less susceptible to human presence, multipath, and fading, they exhibit exceptional indoor penetration, and according to our experimental study they vary less over time when compared to WiFi signals. In this paper, we demonstrate through a detailed experimental study in three different buildings across the US, that FM radio signal RSSI values can be used to achieve room-level indoor localization with similar or better accuracy to the one achieved by WiFi signals. Furthermore, we propose to use additional signal quality indicators at the physical layer (i.e., SNR, multipath, etc.) to augment the wireless signature, and show that localization accuracy can be further improved by more than 5 percent. More importantly, we experimentally demonstrate that the localization errors of FM and WiFi signals are independent. When FM and WiFi signals are combined to generate wireless fingerprints, the localization accuracy increases as much as 83 percent (when accounting for wireless signal temporal variations) compared to when WiFi RSSI only is used as a signature.

Energy-optimal software partitioning in heterogeneous multiprocessor embedded systems

Embedded systems with heterogeneous processors extend the energy/timing trade-off flexibility and provide the opportunity to fine tune resource utilization for particular applications. In this paper, we present a resource model that considers the time and energy costs of run-time mode switching, which considerably improves the accuracy of existing models. Given an application, the software partitioning problem then becomes an optimization over energy cost given deadline constraints, which can be formulate as an integer linear programming (ILP) problem. We apply the resource modeling and software partitioning techniques to a multi- module embedded sensing device, the mPlatform, and present a case study of configuring the platform for a real-time sound source localization application on a stack of MSP430 and ARM7 processor based sensing and processing boards.

Improving energy efficiency of personal sensing applications with heterogeneous multi-processors

The availability of multiple sensors on mobile devices offers a significant new capability to enable rich user and context aware applications. Many of these applications run in the background to continuously sense user context. However, running these applications on mobile devices can impose a significant stress on the battery life, and the use of supplementary low-power processors has been proposed on mobile devices for continuous background activities. In this paper, we experimentally and analytically investigate the design considerations that arise in the efficient use of the low power processor and provide a thorough understanding of the problem space. We answer fundamental questions such as which segments of the application are most efficient to be hosted on the low power processor, and how to select an appropriate low power processor. We discuss our measurements, analysis, and results using multiple low power processors and existing phone platforms.

COIN-GPS: indoor localization from direct GPS receiving

Due to poor signal strength, multipath effects, and limited on-device computation power, common GPS receivers do not work indoors. This work addresses these challenges by using a steerable, high-gain directional antenna as the front-end of a GPS receiver along with a robust signal processing step and a novel location estimation technique to achieve direct GPS-based indoor localization. By leveraging the computing power of the cloud, we accommodate longer signals for acquisition, and remove the requirement of decoding timestamps or ephemeris data from GPS signals. We have tested our system in 31 randomly chosen spots inside five single-story, indoor environments such as stores, warehouses and shopping centers. Our experiments show that the system is capable of obtaining location fixes from 20 of these spots with a median error of less than 10 m, where all normal GPS receivers fail.

Enabling energy efficient continuous sensing on mobile phones with LittleRock

Although mobile phones are ideal platforms for continuous human centric sensing, the state of the art phone architectures today have not been designed to support continuous sensing applications. Currently, sampling and processing sensor data on the phone requires the main processor and associated components to be continuously on, creating a large energy overhead that can severely impact the battery lifetime of the phone. We will demonstrate Little Rock, a novel sensing architecture for mobile phones, where sampling and, when possible, processing of sensor data is offloaded to a dedicated low-power processor. This approach enables the phone to perform continuous sensing three orders of magnitude more energy efficiently compared to the normal approaches.