Alin Moldoveanu

Designing sensory-substitution devices: Principles, pitfalls and potential1

An exciting possibility for compensating for loss of sensory function is to augment deficient senses by conveying missing information through an intact sense. Here we present an overview of techniques that have been developed for sensory substitution (SS) for the blind, through both touch and audition, with special emphasis on the importance of training for the use of such devices, while highlighting potential pitfalls in their design. One example of a pitfall is how conveying extra information about the environment risks sensory overload. Related to this, the limits of attentional capacity make it important to focus on key information and avoid redundancies. Also, differences in processing characteristics and bandwidth between sensory systems severely constrain the information that can be conveyed. Furthermore, perception is a continuous process and does not involve a snapshot of the environment. Design of sensory substitution devices therefore requires assessment of the nature of spatiotemporal continuity for the different senses. Basic psychophysical and neuroscientific research into representations of the environment and the most effective ways of conveying information should lead to better design of sensory substitution systems. Sensory substitution devices should emphasize usability, and should not interfere with other inter- or intramodal perceptual function. Devices should be task-focused since in many cases it may be impractical to convey too many aspects of the environment. Evidence for multisensory integration in the representation of the environment suggests that researchers should not limit themselves to a single modality in their design. Finally, we recommend active training on devices, especially since it allows for externalization, where proximal sensory stimulation is attributed to a distinct exterior object.

Architectural Design of a Real-Time Augmented Feedback System for Neuromotor Rehabilitation

This work presents the design aspects of TRAVEE, a neuromotor rehabilitation system. The TRAVEE system relies on innovative concepts for improving the rehabilitation process and increasing the patient recovery rate. One such concept is to present the patient an augmented feedback as part of a learning process based on neuroplasticity. Most of the rehabilitation exercises are based on visual feedback aimed at restoring the brain function for upper limbs control. This feedback is provided in a virtual reality setting by presenting the patient with a virtual model of his/her body. The movements executed by the patient are augmented in the virtual reality. Assisting the patient by a virtual therapist when executing the recovery exercises is another original feature of the proposed system. TRAVEE is a complex system, that integrates virtual reality, robotics, electrical stimulation, electromyography and brain-computer interfaces to boost the rehabilitation process. The challenges posed to the architectural design of TRAVEE reside in the complexity of its functioning in a setup that integrates a variety of devices, with real-time operation constraints and requirements of keeping the system at accessible costs, easy to install and use. In this paper, we present the proposed hardware and software architecture for TRAVEE. We analyze and discuss the advantages of our approach and the mechanisms that address the various constraints in TRAVEE.

Mixed reality to support new learning paradigms

Mixed reality (MR) concepts gained significant importance in recent years, tending to be more and more domain-specific. The current paper presents a survey on MR educational applications and debates whether they are suitable or not to support several new learning paradigms. The technological specifications and challenges of each analyzed application are provided, in the context of current trends of MR and technological developments. Among others, the innovative criterion of virtual-real merging degree is introduced. Also, the benefits and drawbacks of exploiting MR to implement such paradigms are underlined.

Human motion tracking & evaluation using Kinect V2 sensor

Microsoft Kinect V2 sensor is a motion sensing device that provides to the users a facility to interact with computers and game consoles through many ways like natural movement, gestures or spoken commands. This technology allowed many researchers and companies to develop real-time applications in various fields like healthcare, sports training, facial emotion detection, gaming, security, 3D reconstruction, motion recognition and many other. In this paper, we presented an approach to handle the problem of human body motion skeletal tracking with application in medical rehabilitation and sports training by using capabilities of the latest version of the Microsoft Kinect sensor.

Navigational 3D audio-based game-training towards rich auditory spatial representation of the environment

As the number of people suffering from visual impairments continuously increases, there is strong need for efficient sensory substitution devices, that can support creating a rich mental spatial depiction of the environment. The use of the auditory sense has proved to be an effective approach towards creating a method of interaction with the elements of the surrounding space in a way which resembles the natural 3D visual representation of normal sighted people. Training is an essential component in the process of employing an auditory-based visual substitution device for blind people, as it helps them to learn and become proficient to process and decode the audio information and convert it into spatial mental representation. Taking into account the well-known advantages of game based learning, we propose a new method of training, consisting in a navigational 3D audio-based game. In this exploratory, goal-directed application, the player has to perform route-navigational tasks under different conditions, with the purpose of training and testing their orientation and mobility skills, relying exclusively on the perception of 3D audio cues. Experimental results showed that this game-based learning strategy leads to substantial improvements and can be a starting point for developing more enhanced sound-based navigational applications. The ludic-oriented, motivational training approach achieved straightforward immersion and concentration on the cognitive depiction of the environment, ensuring behavioral gains in the sound-directed spatial orientation.

3D Visualization in IT Systems Used for Post Stroke Recovery: Rehabilitation Based on Virtual Reality

In the last decade Virtual Reality proved to be an efficient alternative for the traditional rehabilitation method for stroke survivors, which is based mainly on kinesiotherapy. A high number of IT systems that are focusing on post stroke recovery are available at this moment. This paper contains a short description of two solutions available on the market followed by the technical details of a new idea. The solutions are analyzed, looking at their strong points, areas of improvement and common characteristics. The analysis is based not only on the design of the virtual environment and applicability in rehabilitation and is also based on the dependent libraries regarding their usability, scalability and extensibility. The principles behind the methods used for 3D visualization of the virtual reality environments, in neuromotor rehabilitation, can advance in design and implementation for creating effective solutions to help the post stroke survivors in their rehabilitation process.

Natural orifice translumenal endoscopic surgery (NOTES) second-look peritoneoscopy for staging of limited peritoneal carcinomatosis

BACKGROUND Over the past decades, staging laparoscopy evolved as a useful tool in multimodality treatment of patients with abdominal malignancies, especially for detection of incurable peritoneal and liver metastasis. Natural orifice translumenal endoscopic surgery (NOTES) is a new, evolving technique which represents the next logical progression in minimally invasive surgery and has theoretical advantages in comparison with standard laparoscopic surgery. A review of the current literature revealed a continuous increasing number of fundamental and clinical studies addressing NOTES approach in multimodal management of oncologic patients. Technical possibility to use this new minimally invasive approach for oncological resection of abdominal malignancies was proved by some investigators. HYPOTHESIS NOTES can be used as an alternative method for staging patients with limited peritoneal carcinomatosis and may have better results compared to current imaging techniques for small diameter metastatic disease. CONCLUSIONS With the continuous development of the NOTES techniques and technology, the second-look peritoneoscopy by NOTES may become an alternative method for staging in patients with peritoneal carcinomatosis. Nevertheless, NOTES is at a very early stage of its development, and its implementation in oncologic surgery should be made very caution, and only after careful evaluation.

Real-time hand hygiene monitoring system for HAI prevention

When healthy people such as visitors and medical staff members or resident patients get an infection from the hospital or from each other; this situation is identified as a Hospital Acquired Infection (HAI). HAI is a key issue of current hospitals; it requires high fiscal expenditure rate for combating the problem, and it causes high mortality rate and prolongs the time of treatment in hospitals. In this paper, we analyze the existing HAI prevention solutions, and then we describe in detail our own system for HAI prevention.

A visual comparison between voltage and power wave reflection coefficients of microwave circuits

This paper analyzes and compares voltage and power wave reflection coefficients using a visual representation which fully exploits that both coefficients are directly related to the geometry of direct inversive transformations in the extended impedance plane. In order to compare the two concepts for complex impedance ports, the 3D Smith chart tool is used in premiere. The paper gives a geometrical and more intuitive insight of these two parameters and proposes a novel tool for handling both types of reflection coefficients.

Sound of Vision - Spatial Audio Output and Sonification Approaches

The paper summarizes a number of audio-related studies conducted by the Sound of Vision consortium, which focuses on the construction of a new prototype electronic travel aid for the blind. Different solutions for spatial audio were compared by testing sound localization accuracy in a number of setups, comparing plain stereo panning with generic and individual HRTFs, as well as testing different types of stereo headphones vs custom designed quadrophonic proximaural headphones. A number of proposed sonification approaches were tested by sighted and blind volunteers for accuracy and efficiency in representing simple virtual environments.