Edward Sazonov

Monitoring of Posture Allocations and Activities by a Shoe-Based Wearable Sensor

Monitoring of posture allocations and activities enables accurate estimation of energy expenditure and may aid in obesity prevention and treatment. At present, accurate devices rely on multiple sensors distributed on the body and thus may be too obtrusive for everyday use. This paper presents a novel wearable sensor, which is capable of very accurate recognition of common postures and activities. The patterns of heel acceleration and plantar pressure uniquely characterize postures and typical activities while requiring minimal preprocessing and no feature extraction. The shoe sensor was tested in nine adults performing sitting and standing postures and while walking, running, stair ascent/descent and cycling. Support vector machines (SVMs) were used for classification. A fourfold validation of a six-class subject-independent group model showed 95.2% average accuracy of posture/activity classification on full sensor set and over 98% on optimized sensor set. Using a combination of acceleration/pressure also enabled a pronounced reduction of the sampling frequency (25 to 1 Hz) with out significant loss of accuracy (98% versus 93%). Subjects had shoe sizes (US) M9.5-11 and W7-9 and body mass index from 18.1 to 39.4 kg/m2 and thus suggesting that the device can be used by individuals with varying anthropometric characteristics.

Self-Powered Sensors for Monitoring of Highway Bridges

The task of structural health monitoring (SHM) of aging highway bridges and overpasses is important not only from the point of preventing economic losses from traffic delays and detours but also is a matter of preventing catastrophic failures and loss of human life. In recent years, wireless sensor technologies have been used extensively to develop SHM platforms for bridges. A limitation of wireless sensors is the finite life span of batteries and high cost of battery replacements, which make such systems prohibitively expensive in many cases. Energy harvesting is a solution capable to alleviate this problem. A novel wireless sensor system is presented that harvests vibrations of the bridge created by passing traffic, which is converted into usable electrical energy by means of a linear electromagnetic generator. Utilization of an electromagnetic generator allows harvesting of up to 12.5 mW of power in the resonant mode with the frequency of excitation at 3.1 Hz, in this particular design. The novelty of the system also includes tight integration of the power generator and a smart algorithm for energy conversion that switches between the low-power mode and the impedance matching mode. Finally, results of field experiments are presented in which the wireless system is operated exclusively by the harvested energy of vibration on a rural highway bridge with low traffic volume.

Non-invasive monitoring of chewing and swallowing for objective quantification of ingestive behavior

A methodology of studying of ingestive behavior by non-invasive monitoring of swallowing (deglutition) and chewing (mastication) has been developed. The target application for the developed methodology is to study the behavioral patterns of food consumption and producing volumetric and weight estimates of energy intake. Monitoring is non-invasive based on detecting swallowing by a sound sensor located over laryngopharynx or by a bone-conduction microphone and detecting chewing through a below-the-ear strain sensor. Proposed sensors may be implemented in a wearable monitoring device, thus enabling monitoring of ingestive behavior in free-living individuals. In this paper, the goals in the development of this methodology are two-fold. First, a system comprising sensors, related hardware and software for multi-modal data capture is designed for data collection in a controlled environment. Second, a protocol is developed for manual scoring of chewing and swallowing for use as a gold standard. The multi-modal data capture was tested by measuring chewing and swallowing in 21 volunteers during periods of food intake and quiet sitting (no food intake). Video footage and sensor signals were manually scored by trained raters. Inter-rater reliability study for three raters conducted on the sample set of five subjects resulted in high average intra-class correlation coefficients of 0.996 for bites, 0.988 for chews and 0.98 for swallows. The collected sensor signals and the resulting manual scores will be used in future research as a gold standard for further assessment of sensor design, development of automatic pattern recognition routines and study of the relationship between swallowing/chewing and ingestive behavior.

Automatic Detection of Swallowing Events by Acoustical Means for Applications of Monitoring of Ingestive Behavior

Our understanding of etiology of obesity and overweight is incomplete due to lack of objective and accurate methods for monitoring of ingestive behavior (MIB) in the free-living population. Our research has shown that frequency of swallowing may serve as a predictor for detecting food intake, differentiating liquids and solids, and estimating ingested mass. This paper proposes and compares two methods of acoustical swallowing detection from sounds contaminated by motion artifacts, speech, and external noise. Methods based on mel-scale Fourier spectrum, wavelet packets, and support vector machines are studied considering the effects of epoch size, level of decomposition, and lagging on classification accuracy. The methodology was tested on a large dataset (64.5 h with a total of 9966 swallows) collected from 20 human subjects with various degrees of adiposity. Average weighted epoch-recognition accuracy for intravisit individual models was 96.8%, which resulted in 84.7% average weighted accuracy in detection of swallowing events. These results suggest high efficiency of the proposed methodology in separation of swallowing sounds from artifacts that originate from respiration, intrinsic speech, head movements, food ingestion, and ambient noise. The recognition accuracy was not related to body mass index, suggesting that the methodology is suitable for obese individuals.

Wireless intelligent sensor network for autonomous structural health monitoring

Life cycle monitoring of civil infrastructure such as bridges and buildings is critical to the long-term operational cost and safety of aging structures. The widespread use of Structural Health Monitoring (SHM) systems is limited due to unavailability of specialized data acquisition equipment, high cost of generic equipment, and absence of fully automatic decision support systems. The goals of the presented project include: first, design of a Wireless Intelligent Sensor and Actuator Network (WISAN) and creation of an inexpensive set of instrumentation for the tasks of structural health monitoring; second, development of a SHM method, which is suitable for autonomous structural health monitoring. The design of the wireless sensor network is aimed at applications of structural health monitoring, addressing the issues of achieving a low cost per sensor, higher reliability, sources of energy for the network nodes, energy-efficient distribution of the computational load, security and coexistence in the ISM radio bands. The practical applicability of the sensor network is increased through utilization of computational intelligence and support of signal generation capabilities. The automated SHM method is based on the method of modal strain energy, though other SHM methods will be supported as well. The automation tasks include automation of the modal identification through ambient vibrations, classification of the acquired mode shapes, and automatic evaluation of the structural health.

A comparison of energy expenditure estimation of several physical activity monitors.

INTRODUCTION Accurately and precisely estimating free-living energy expenditure (EE) is important for monitoring energy balance and quantifying physical activity. Recently, single and multisensor devices have been developed that can classify physical activities, potentially resulting in improved estimates of EE. PURPOSE This study aimed to determine the validity of EE estimation of a footwear-based physical activity monitor and to compare this validity against a variety of research and consumer physical activity monitors. METHODS Nineteen healthy young adults (10 men, 9 women) completed a 4-h stay in a room calorimeter. Participants wore a footwear-based physical activity monitor as well as Actical, ActiGraph, IDEEA, DirectLife, and Fitbit devices. Each individual performed a series of postures/activities. We developed models to estimate EE from the footwear-based device, and we used the manufacturers software to estimate EE for all other devices. RESULTS Estimated EE using the shoe-based device was not significantly different than measured EE (mean ± SE; 476 ± 20 vs 478 ± 18 kcal, respectively) and had a root-mean-square error of 29.6 kcal (6.2%). The IDEEA and the DirectLlife estimates of EE were not significantly different than the measured EE, but the ActiGraph and the Fitbit devices significantly underestimated EE. Root-mean-square errors were 93.5 (19%), 62.1 kcal (14%), 88.2 kcal (18%), 136.6 kcal (27%), 130.1 kcal (26%), and 143.2 kcal (28%) for Actical, DirectLife, IDEEA, ActiGraph, and Fitbit, respectively. CONCLUSIONS The shoe-based physical activity monitor provides a valid estimate of EE, whereas the other physical activity monitors tested have a wide range of validity when estimating EE. Our results also demonstrate that estimating EE based on classification of physical activities can be more accurate and precise than estimating EE based on total physical activity.

A Sensor System for Automatic Detection of Food Intake Through Non-Invasive Monitoring of Chewing

Objective and automatic sensor systems to monitor ingestive behavior of individuals arise as a potential solution to replace inaccurate method of self-report. This paper presents a simple sensor system and related signal processing and pattern recognition methodologies to detect periods of food intake based on non-invasive monitoring of chewing. A piezoelectric strain gauge sensor was used to capture movement of the lower jaw from 20 volunteers during periods of quiet sitting, talking and food consumption. These signals were segmented into non-overlapping epochs of fixed length and processed to extract a set of 250 time and frequency domain features for each epoch. A forward feature selection procedure was implemented to choose the most relevant features, identifying from 4 to 11 features most critical for food intake detection. Support vector machine classifiers were trained to create food intake detection models. Twenty-fold cross-validation demonstrated per-epoch classification accuracy of 80.98% and a fine time resolution of 30 s. The simplicity of the chewing strain sensor may result in a less intrusive and simpler way to detect food intake. The proposed methodology could lead to the development of a wearable sensor system to assess eating behaviors of individuals.

Automatic Ingestion Monitor: A Novel Wearable Device for Monitoring of Ingestive Behavior

Objective monitoring of food intake and ingestive behavior in a free-living environment remains an open problem that has significant implications in study and treatment of obesity and eating disorders. In this paper, a novel wearable sensor system (automatic ingestion monitor, AIM) is presented for objective monitoring of ingestive behavior in free living. The proposed device integrates three sensor modalities that wirelessly interface to a smartphone: a jaw motion sensor, a hand gesture sensor, and an accelerometer. A novel sensor fusion and pattern recognition method was developed for subject-independent food intake recognition. The device and the methodology were validated with data collected from 12 subjects wearing AIM during the course of 24 h in which both the daily activities and the food intake of the subjects were not restricted in any way. Results showed that the system was able to detect food intake with an average accuracy of 89.8%, which suggests that AIM can potentially be used as an instrument to monitor ingestive behavior in free-living individuals.

The effect of time synchronization of wireless sensors on the modal analysis of structures

Driven by the need to reduce the installation cost and maintenance cost of structural health monitoring (SHM) systems, wireless sensor networks (WSNs) are becoming increasingly popular. Perfect time synchronization amongst the wireless sensors is a key factor enabling the use of low-cost, low-power WSNs for structural health monitoring applications based on output-only modal analysis of structures. In this paper we present a theoretical framework for analysis of the impact created by time delays in the measured system response on the reconstruction of mode shapes using the popular frequency domain decomposition (FDD) technique. This methodology directly estimates the change in mode shape values based on sensor synchronicity. We confirm the proposed theoretical model by experimental validation in modal identification experiments performed on an aluminum beam. The experimental validation was performed using a wireless intelligent sensor and actuator network (WISAN) which allows for close time synchronization between sensors (0.6‐10 μ si n the tested configuration) and guarantees lossless data delivery under normal conditions. The experimental results closely match theoretical predictions and show that even very small delays in output response impact the mode shapes. (Some figures in this article are in colour only in the electronic version)

Automatic Detection of Temporal Gait Parameters in Poststroke Individuals

Approximately one-third of people who recover from a stroke require some form of assistance to walk. Repetitive task-oriented rehabilitation interventions have been shown to improve motor control and function in people with stroke. Our long-term goal is to design and test an intensive task-oriented intervention that will utilize the two primary components of constrained-induced movement therapy: massed, task-oriented training and behavioral methods to increase use of the affected limb in the real world. The technological component of the intervention is based on a wearable footwear-based sensor system that monitors relative activity levels, functional utilization, and gait parameters of affected and unaffected lower extremities. The purpose of this study is to describe a methodology to automatically identify temporal gait parameters of poststroke individuals to be used in assessment of functional utilization of the affected lower extremity as a part of behavior enhancing feedback. An algorithm accounting for intersubject variability is capable of achieving estimation error in the range of 2.6-18.6% producing comparable results for healthy and poststroke subjects. The proposed methodology is based on inexpensive and user-friendly technology that will enable research and clinical applications for rehabilitation of people who have experienced a stroke.