Zhihan Lv

Multimodal Hand and Foot Gesture Interaction for Handheld Devices

We present a hand-and-foot-based multimodal interaction approach for handheld devices. Our method combines input modalities (i.e., hand and foot) and provides a coordinated output to both modalities along with audio and video. Human foot gesture is detected and tracked using contour-based template detection (CTD) and Tracking-Learning-Detection (TLD) algorithm. 3D foot pose is estimated from passive homography matrix of the camera. 3D stereoscopic and vibrotactile are used to enhance the immersive feeling. We developed a multimodal football game based on the multimodal approach as a proof-of-concept. We confirm our systems user satisfaction through a user study.

Touch-less interactive augmented reality game on vision-based wearable device

Abstract There is an increasing interest in creating pervasive games based on emerging interaction technologies. In order to develop touch-less, interactive and augmented reality games on vision-based wearable device, a touch-less motion interaction technology is designed and evaluated in this work. Users interact with the augmented reality games with dynamic hands/feet gestures in front of the camera, which triggers the interaction event to interact with the virtual object in the scene. Three primitive augmented reality games with eleven dynamic gestures are developed based on the proposed touch-less interaction technology as proof. At last, a comparing evaluation is proposed to demonstrate the social acceptability and usability of the touch-less approach, running on a hybrid wearable framework or with Google Glass, as well as workload assessment, user’s emotions and satisfaction.

Collaborative Multi-hop Routing in Cognitive Wireless Networks

The collaboration of nodes in cognitive wireless networks is a large challenge. This paper studies the collaborative multi-hop routing in cognitive networks. We propose a new algorithm to construct the collaborative routing in multi-hop cognitive networks. Our algorithm takes into account the interference among nodes including primary and secondary users. The clustering and collaboration are exploited to improve the performance of collaborative routing in multi-hop cognitive wireless networks with multiple primary and secondary users. By analyzing the maximum transmission distance, collaborations, transmission angle control and power control, and channel allocation, we propose a new clustering-based collaborative multi-hop cognitive routing algorithm to attain better network performance. Simulation results show that our approach is feasible and effective.

A Self-Assessment Stereo Capture Model Applicable to the Internet of Things.

The realization of the Internet of Things greatly depends on the information communication among physical terminal devices and informationalized platforms, such as smart sensors, embedded systems and intelligent networks. Playing an important role in information acquisition, sensors for stereo capture have gained extensive attention in various fields. In this paper, we concentrate on promoting such sensors in an intelligent system with self-assessment capability to deal with the distortion and impairment in long-distance shooting applications. The core design is the establishment of the objective evaluation criteria that can reliably predict shooting quality with different camera configurations. Two types of stereo capture systems—toed-in camera configuration and parallel camera configuration—are taken into consideration respectively. The experimental results show that the proposed evaluation criteria can effectively predict the visual perception of stereo capture quality for long-distance shooting.

Multimedia cloud transmission and storage system based on internet of things

For the issues of large space and storage security of multimedia files, we analyzed the impact of access control and cloud storage on multimedia file, and proposed a mixed security cloud storage framework based on Internet of Things. This paper introduced the concept of multimedia protection into the method based on role access control. Moreover, we also adopted a scheme based on the combination of multimedia data state and role access control. At the same time, all input and output devices were connected to this system. Internet of Things is used to judge whether circuits are connected and whether the devices are normally operated, so as to improve the access efficiency. On this basis, we also described in detail the complete process of registration, role assignment, multimedia file owner’s request for data encryption, and user login and access to multimedia file. According to the result, this scheme can be used to resist the known attacks. It guarantees security of multimedia files.

Change detection method for remote sensing images based on an improved Markov random field

The fixed weights between the center pixel and neighboring pixels are used in the traditional Markov random field for change detection, which will easily cause the overuse of spatial neighborhood information. Besides the traditional label field cannot accurately identify the spatial relations between neighborhood pixels. To solve these problems, this study proposes a change detection method based on an improved MRF. Linear weights are designed for dividing unchanged, uncertain and changed pixels of the difference image, and spatial attraction model is introduced to refine the spatial neighborhood relations, which aims to enhance the accuracy of spatial information in MRF. The experimental results indicate that the proposed method can effectively enhance the accuracy of change detection.

Towards a face recognition method based on uncorrelated discriminant sparse preserving projection

Feature extraction has always been an important step in face recognition, the quality of which directly determines recognition result. Based on making full use of advantages of Sparse Preserving Projection (SPP) on feature extraction, the discriminant information was introduced into SPP to arrive at a novel supervised feather extraction method that named Uncorrelated Discriminant SPP (UDSPP) algorithm. The obtained projection with the method by sparse preserving intra-class and maximizing distance inter-class can effectively express discriminant information, while preserving local neighbor relationship. Moreover, statistics uncorrelated constraint was also added to decrease redundancy among feature vectors so as to obtain more information as possible with little vectors as possible. The experimental results show that the recognition rate improved compared with SPP. The method is also superior to recognition methods based on Euclidean distance in processing face database in light.

Extending touch-less interaction on vision based wearable device

A touch-less interaction technology on vision based wearable device is designed and evaluated. Users interact with the application with dynamic hands/feet gestures in front of the camera. Several proof-of-concept prototypes with eleven dynamic gestures are developed based on the touch-less interaction. At last, a comparing user study evaluation is proposed to demonstrate the usability of the touch-less approach, as well as the impact on users emotion, running on a wearable framework or Google Glass.

A multicast delivery approach with minimum energy consumption for wireless multi-hop networks

Multicast delivery in wireless multi-hop networks has become the popular research topic and holds the important applications such as sensor and tactical networks. However, how to minimize multicast energy consumption and prolong the lifetime of multicast connection in wireless multi-hop networks with limited energy is a challenge at present. This paper presents a new approach to solve this problem by considering the cognitive ability of nodes. Above all, we exploit the directional reception antennas to propose a directional reception two-step reconstruction routing scheme to set up multicast tree for wireless multi-hop networks. Different from previous methods, we grant the cognitive ability to each node so that they can obtain the minimum transmission power by sensing, learning, acting, and deciding. We propose two algorithms to find the minimum transmission power of all the nodes in the multicast tree built above. And a global optimal multicast delivery algorithm with the minimum energy consumption is proposed to implement effective multicast communication for wireless multi-hop networks with energy limited. Numerical experiments show that the proposed approach can significantly improve the multicast performance of wireless multi-hop networks with energy limited such as the lifetime of multicast connection and transmission power.

Wearable Smartphone: Wearable Hybrid Framework for Hand and Foot Gesture Interaction on Smartphone

There is a increasing interest in creating wearable smartphone interaction technologies. A novel smartphone wearable hybrid interaction framework based on mixed low-cost hardware and software is proposed in this work. The software application renders touch-less application graphics and status information using smart phones screen. Augmented reality image rendering technology is employed for a convenient hand/foot and phone interaction. The users interact with the application using hand/foot gesture motion behind the camera, which trigger the interaction event and generate activity sequences for interactive buffers. The touch-less algorithm provides a core support for hand/foot-gesture interaction by accurately detecting and tracking the hand/foot gesture. Four proof-of-concept application prototypes are developed based on the wearable hybrid framework. The user study evaluation demonstrates the social acceptability of the designed hand/foot gestures and the usability of the applications on proposed wearable hybrid framework with touch-less interaction approach.