Mehran Roshandel

MagiTact: interaction with mobile devices based on compass (magnetic) sensor

In this work, we present a new technique for efficient use of 3D space around a mobile device for interaction with the device. Around Device Interaction (ADI) enables extending interaction space of small mobile and tangible devices beyond their physical boundary. Our proposed method is based on using compass (magnetic field) sensor integrated in mobile devices (e.g. iPhone 3GS, G1 Android). In this method, a properly shaped permanent magnet (e.g. in the shape of a rod, pen or a ring) is used for interaction. The user makes coarse gestures in the 3D space around the device using the magnet. Movement of the magnet affects the magnetic field sensed by the compass sensor integrated in the device. The temporal pattern of the gesture is then used as a basis for sending different interaction commands to the mobile device. Zooming, turning pages, accepting/rejecting calls, clicking items, controlling a music player, and game interaction are some example use cases. The proposed method does not impose changes in hardware specifications of the mobile device, and unlike optical methods is not limited by occlusion problems.

MagiWrite: towards touchless digit entry using 3D space around mobile devices

In this work, we present a new approach for text (mainly digit) entry based on digit shaped gestures created in 3D space around a mobile device. Some new mobile devices such as Apple iPhone 3GS and Google Android are equipped with magnetic (compass) sensor. The main idea is to influence the magnetic sensor using a magnet taken in hand. The user draws (writes) digits in the 3D space around the device using the magnet taken in hand. Movement of the magnet changes temporal pattern of magnetic field around the device which is sensed and registered by the magnetic (compass) sensor. The registered pattern is then compared against already recorded templates for different digits. Such a text (digit) entry approach can be especially useful for small mobile devices in which it is hard to operate small buttons or touch screen. Using our technique, the text entry space extends beyond physical boundaries of the device. A demonstrator for this approach is implemented on Apple iPhone 3GS platform. It demonstrates registering a few templates for different digits, and recognizing digits written in the space around the device

Towards using embedded magnetic field sensor for around mobile device 3D interaction

We present a new technique based on using embedded compass (magnetic) sensor for efficient use of 3D space around a mobile device for interaction with the device. Around Device Interaction (ADI) enables extending interaction space of small mobile and tangible devices beyond their physical boundary. Our proposed method is based on using compass (magnetic field) sensor integrated in new mobile devices (e.g. iPhone 3GS, G1/2 Android). In this method, a properly shaped permanent magnet (e.g. a rod, pen or a ring) is used for interaction. The user makes coarse gestures in 3D space around the device using the magnet. Movement of the magnet affects magnetic field sensed by the compass sensor integrated in the device. The temporal pattern of the gesture is then used as a basis for sending different interaction commands to the mobile device. The proposed method does not impose changes in hardware and physical specifications of the mobile device, and unlike optical methods is not limited by occlusion problems. Therefore, it allows for efficient use of 3D space around device, including back of device. Zooming, turning pages, accepting/rejecting calls, clicking items, controlling a music player, and mobile game interaction are some example use cases. Initial evaluation of our algorithm using a prototype application developed for iPhone shows convincing gesture classification results.

Towards digital music performance for mobile devices based on magnetic interaction

Digital music performance require high degree of interaction using natural, intuitive input controllers that provide fast feedback on users action. One of the primary considerations of professional artists is a powerful and creative tool that minimizes the number of steps required for the speed-demanding processes. Most of the musical performance applications, which are designed for mobile devices, use touch-screen or accelerometer as interaction modalities. In this work, we present a novel interface for musical performance that is based on the magnetic field sensor embedded in recent mobile devices. The proposed method, at this point, promises a new independent ground for inputting momentary data during music composition and manipulation process. Giving the opportunity to freely, fully and quickly utilize the surrounding 3D space, it possesses the potential to bring a wide-spectrum of unique options for production and performance process of music.

Multi-sensor Finger Ring for Authentication Based on 3D Signatures

Traditional methods of authenticating a user, including password, a Personal Identification Number (PIN), or a more secure PIN entry method (A PIN entry method resilient against shoulder surfing [14]), can be stolen or accessed easily and, therefore, make the authentication unsecure. In this work, we present the usability of our multi-sensor based and standalone finger ring called Pingu in providing a highly secure access system. Specifically, Pingu allows users to make a 3D signature and record the temporal pattern of the signature via an advanced set of sensors. As a result, the user creates a 3D signature in air using his finger. Our approach has two main contributions: (1) Compared to other wearable devices, a finger ring is more socially acceptable, and (2) signatures created via a finger in the air or on a surface leaves no visible track and, thus, are extremely hard to forge. In other words, a 3D signature allows much higher flexibility in choosing a safe signature. Our experiment shows that the proposed hardware and methodology could result in a very high level of user authentication/identification performance.

Multi-sensor Based Gestures Recognition with a Smart Finger Ring

Recently several optical and non-optical sensors based gesture recognition techniques have been developed to interact with computing devices. However, these techniques mostly suffer from problems such as occlusion and noise. In this work, we present Pingu, a multi-sensor based framework that is capable of recognizing simple, sharp, and tiny gestures without the problems mentioned above. Pingu has been calibrated in the form of a wearable finger ring, capable of interacting even when the device is not in the vicinity of the user. An advanced set of sensors, wireless connectivity, and feedback facilities enable Pingu for a wide range of potential applications, from novel gestures to social computing. In this paper, we present our results based on experiments conducted to explore Pingu’s use as a general gestural interaction device. Our analysis, based on simple machine learning algorithms, shows that simple and sharp gestures performed by a finger can be detected with a high accuracy, thereby, stablishing Pingu as a wearable ring to control a smart environment effectively.

On practical selective jamming of Bluetooth Low Energy advertising

Bluetooth Low Energy (BLE) Advertising is an important component of BLE as it is used to broadcast connection information to other devices nearby, usually smartphones. Furthermore, it is the foundation of a variety of services, such as indoor localization. We present a selective jammer against BLE beacons. The jammer selectively jams only BLE advertising beacons for which it was configured (API) on just the BLE advertising channels actually being used (narrowband). Such a jammer is hard to detect and hence requires a sophisticated Intrusion Detection System (IDS). The prototypic implementation uses off-the-shelf embedded hardware which is low-cost, small-size and very power efficient. Experiment results demonstrate the feasibility of the proposed solution and reveal the impact of the distance between jammer and receiver on the advertising success rate. At short distances the jammer is able to successfully corrupt all BLE advertisement beacon frames making the BLE beacon source undiscoverable.