Milan Z. Bjelica

A human detection method f or residential smart energy systems based on Zigbee RSSI changes

In this article, the device-free human presence detection method based on radio signal strength variations is proposed. The method exploits the known fact that human body interferes with radio signals by causing fading and shadowing effects. Introduced irregularities in the radio propagation pattern indicate possible presence of a human. The proposed method is incorporated into the existing platform for intelligent residential energy management. As opposed to conventional solutions which utilize a complex set of sensors for human detection, the proposed approach achieves the same only by analyzing and quantifying radio signal strength variations incorporated in messages exchanged between 2.4 GHz radio transceivers. One of the key benefits of the proposed solution is the integration of the detection algorithm into the smart power outlets and smart light switches. Such an approach improves interactions in smart home systems, enables intelligent power consumption management and low installation cost.

System Design for Passive Human Detection Using Principal Components of the Signal Strength Space

Radio irregularity phenomenon is often considered as a shortcoming of wireless sensor networks. In this paper, the radio irregularity is regarded as a benefit of wireless networks. The proposed novel method for human presence detection, applied to the monitoring system for residential energy management, utilizes radio irregularity for an efficient human presence detection which increases user awareness and automates the power control. The method monitors 2.4GHz wireless (Zigbee) smart outlets and the communication signals between them to detect changes of the received signal strength indicator (RSSI) and its variations compared to the expected mean values. The signal strength variation is significantly increased due to human presence within the signal propagation path. By applying the algorithm for principal components analysis to the set of RSSI samples obtained from radio communication links within the detection area, it is possible to recognize a human presence. There is no need for additional presence sensors installation, because the proposed method applied to the smart outlets network is quite satisfactory to extend the entire system with the detection capability. Compared to the conventional sensor networks, the presented solution preserves the pervasiveness of smart energy and smart home systems, high level of sensorial intelligence, simplicity and low installation costs.

Set-top box-based home controller

In this paper we present a novel software-based home control platform as an add-on to a set-top box (STB) for digital television. By means of using merely a remote controller, traditional STB users become able to control lights, appliances and media playback in their homes. Intelligence and awareness is achieved with a support for execution of recipes — pre-prepared scripts that define timely actions and respond to triggers obtained from sensors. Software abstraction layer facilitates integration of any desired communication protocol. In our prototype, we supported Zigbee and DMX for light control, X10 for light/appliances control over power line, as well as Ethernet-based optical cameras as motion / presence sensors and UPnP / DLNA based equipment for distributed media playback.

Cloud-based framework for QoS monitoring and provisioning in consumer devices

The purpose of this paper is to provide a framework for a scalable, adaptable and efficient Quality of Service (QoS) monitoring system for consumer devices. The system is set in the Cloud environment and based on TR-069 remote management protocol. The proposed solution allows the development of secure, cloud-based network provisioning and management applications. Cloud access interfaces provide all needed information for the development of web-based or mobile applications which allow visualization of acquired QoS parameters.

Gesture based hardware interface for RF lighting control

Human interaction with wearable computers is a challenging research issue, especially when combined with augmented reality applications. Natural and unobtrusive interaction with various devices should be simple and at the same time intuitive for any user. This paper represents the design and implementation of a novel interactive hardware which recognizes certain hand gestures and responds in a way of controlling a remote light source. The hardware is made as a “sensing glove” which provides 3-dimensional light control for switching the light on/off or dimming to a desired level. Control parameters are calculated by an accelerometer mounted on the glove, which detects positions of a users palm in a 3D space. Slow palm rotation is translated into commands for the light dimming, whereas specific hand movements control the light switching. RF transmitter connected to the accelerometer sends the current palm and hand coordinates to the remote luminary. The luminary is managed by an RF receiver and a module for the light control which translates the received data into lighting commands.

Reaching the next level of indoor human presence detection: An RF based solution

The presence of a human in the vicinity of radio transceivers results in radio signal strength variations at the receivers input. Therefore, human presence in an indoor environment can be recognized by analyzing and quantifying irregularities in the radio signature. In order to quantify the information in terms of human presence, we present a novel human presence detection method based on information entropy extracted from a sequence of received signal strength samples. As opposed to existing smart home solutions that incorporate a complex set of sensors for human detection, the proposed method is solely based on radio irregularity phenomenon, without modifying the original environment. An additional level of sensor intelligence is introduced without sensors and installation costs, or specific training procedures for end-consumers.

Using radio irregularity for increasing residential energy awareness

Radio irregularity phenomenon is often considered as a shortcoming of wireless networks. In this paper we present the method of using radio irregularity as an efficient human presence detection sensor which increases user awareness in smart homes. The idea is based on monitoring the received signal strength indicator (RSSI) between stationary wireless (2.4 GHz — Zigbee) power outlets. When a human enters into the existing radio communication field, the signal can be absorbed, scattered or reflected by the body what results in strong variations of RSSI. Based on the detected changes compared to the initial values, the system detects human presence and responds with the automatic control of any appliance connected to outlets. Compared to conventional sensors, the proposed solution preserves the sensorial intelligence, simplicity and low installation costs without need for additional devices integration.

Evaluation of the available scripting languages for home automation networks: Real world case study

Ever increasing demand for the solutions that can help automate everyday tasks inside a household has resulted in various systems, devices and applications working towards the fulfilment of that goal. The majority of systems use scripting languages to define the behaviour of automated devices in the home. In this paper we present the results of the analysis of several major scripting languages used within a real home automation system, which we extended with several different script interpreters. In the scope of our discussions scripting languages Lua, XML and SMIL are covered.

Multi-purpose user awareness kit for consumer electronic devices

Making systems user-aware can be a daunting task. Problems that should be attended range from sensing a complex environment and recognizing user activity, to prediction and personalization of system services. This paper proposes a User Awareness Kit (UAK) that can be used as a slave system with a variety of consumer electronic devices. UAK combines sensor inputs (passive infrared sensor, microphone array, time of flight camera) with behavior models based on system attentiveness and user-system interference concepts, to provide information of the ecosystem of users to its host. UAK is designed as a system on chip (SoC) that shares that information by using a simple interprocessor protocol. As a result, host device would be able to anticipate user actions and adapt accordingly. We argue that equipping consumer electronic devices with UAK can mitigate risks of device rejection by users. Due to the all-growing number of electronic products that people use, carry around and even depend on reducing the impact on their attention and time should be an ultimate goal.

An integrated environment and development framework for social gaming using mobile devices, digital TV and Internet

The amount of digital multimedia devices in a modern day household capable of connecting to the Internet has increased dramatically over the last years, including mobile devices such as smart phones and tablets as well as digital TV sets and set-top boxes. Since these devices are readily available and allow customization through software they can be easily used to support and enhance traditional social activities in the living room. This paper presents an integrated environment of mobile devices and digital TVs connected to the Internet used as a platform for exploring both traditional and novel gaming concepts in either a single living room or across different homes connecting multiple living rooms. To create such an environment a framework was developed enabling the implementation of distributed social games, using the digital TV as a display showing game content public to all players and using the available personal mobile devices as controllers and displays showing private portions of the game. The framework also allows the innovative use of broadcast related information and social media during game play. Five different games were developed using the framework. The framework effectiveness was evaluated by comparing TV-centric games developed with and without the framework using size and complexity metrics, additionally application responsiveness was measured using a game developed without and with the framework and compared with a state-of-the-art game controller. The experience of playing the developed games was obtained by collecting and analyzing self-reported data using a questionnaire combined with additional observations from volunteers and researchers.