Pawel Pyk

An artificial moth: Chemical source localization using a robot based neuronal model of moth optomotor anemotactic search

Robots have been used to model nature, while nature in turn can contribute to the real-world artifacts we construct. One particular domain of interest is chemical search where a number of efforts are underway to construct mobile chemical search and localization systems. We report on a project that aims at constructing such a system based on our understanding of the pheromone communication system of the moth. Based on an overview of the peripheral processing of chemical cues by the moth and its role in the organization of behavior we emphasize the multimodal aspects of chemical search, i.e. optomotor anemotactic chemical search. We present a model of this behavior that we test in combination with a novel thin metal oxide sensor and custom build mobile robots. We show that the sensor is able to detect the odor cue, ethanol, under varying flow conditions. Subsequently we show that the standard model of insect chemical search, consisting of a surge and cast phases, provides for robust search and localization performance. The same holds when it is augmented with an optomotor collision avoidance model based on the Lobula Giant Movement Detector (LGMD) neuron of the locust. We compare our results to others who have used the moth as inspiration for the construction of odor robots.

Interactive visuo-motor therapy system for stroke rehabilitation

We present a virtual reality (VR)-based motor neurorehabilitation system for stroke patients with upper limb paresis. It is based on two hypotheses: (1) observed actions correlated with self-generated or intended actions engage cortical motor observation, planning and execution areas (“mirror neurons”); (2) activation in damaged parts of motor cortex can be enhanced by viewing mirrored movements of non-paretic limbs. We postulate that our approach, applied during the acute post-stroke phase, facilitates motor re-learning and improves functional recovery. The patient controls a first-person view of virtual arms in tasks varying from simple (hitting objects) to complex (grasping and moving objects). The therapist adjusts weighting factors in the non-paretic limb to move the paretic virtual limb, thereby stimulating the mirror neuron system and optimizing patient motivation through graded task success. We present the system’s neuroscientific background, technical details and preliminary results.

Virtual reality-based paediatric interactive therapy system (PITS) for improvement of arm and hand function in children with motor impairment—a pilot study

Objective: Rehabilitation of upper-limb sensorimotor function in children with motor dysfunctions is primarily based on movement training. This study developed a virtual-reality based, paediatric interactive therapy system (PITS) that allows children to practice specific movements of the upper limbs with immediate feedback about their motor performance. Methods: The system was tested on five children with motor dysfunctions over 3 weeks of training. Pre- and post-assessment was conducted before and after the training period. Results: Results of the pilot study show improvements of hand function in the test scores (except one patient). Patient motivation was high and maintained over the course of the therapy sessions. Conclusion: PITS is an applicable VR-system which can be feasibly applied during the rehabilitation of children with upper limb motor dysfunctions. Further investigation is necessary to determine if the system provides significantly improved results compared to conventional therapies, both in terms of motor function outcomes and patient motivation.

A fly-locust based neuronal control system applied to an unmanned aerial vehicle: the invertebrate neuronal principles for course stabilization, altitude control and collision avoidance

The most versatile and robust flying machines are still those produced by nature through evolution. The solutions to the 6 DOF control problem faced by these machines are implemented in extremely small neuronal structures comprising thousands of neurons. Hence, the biological principles of flight control are not only very effective but also efficient in terms of their implementation. An important question is to what extent these principles can be generalized to man-made flying platforms. Here, this question is investigated in relation to the computational and behavioral principles of the opto-motor system of the fly and locust. The aim is to provide a control infrastructure based only on biologically plausible and realistic neuronal models of the insect opto-motor system. It is shown that relying solely on vision, biologically constrained neuronal models of the fly visual system suffice for course stabilization and altitude control of a blimp-based UAV. Moreover, the system is augmented with a collision avoidance model based on the Lobula Giant Movement Detector neuron of the Locust. It is shown that the biologically constrained course stabilization model is highly robust and that the combined model is able to perform autonomous indoor flight.

Virtual Reality–Augmented Neurorehabilitation Improves Motor Function and Reduces Neuropathic Pain in Patients With Incomplete Spinal Cord Injury:

Background. Neurorehabilitation interventions to improve lower limb function and neuropathic pain have had limited success in people with chronic, incomplete spinal cord injury (iSCI). Objective. We hypothesized that intense virtual reality (VR)–augmented training of observed and executed leg movements would improve limb function and neuropathic pain. Methods. Patients used a VR system with a first-person view of virtual lower limbs, controlled via movement sensors fitted to the patient’s own shoes. Four tasks were used to deliver intensive training of individual muscles (tibialis anterior, quadriceps, leg ad-/abductors). The tasks engaged motivation through feedback of task success. Fourteen chronic iSCI patients were treated over 4 weeks in 16 to 20 sessions of 45 minutes. Outcome measures were 10 Meter Walking Test, Berg Balance Scale, Lower Extremity Motor Score, Spinal Cord Independence Measure, Locomotion and Neuropathic Pain Scale (NPS), obtained at the start and at 4 to 6 weeks before intervention. Results. In addition to positive changes reported by the patients (Patients’ Global Impression of Change), measures of walking capacity, balance, and strength revealed improvements in lower limb function. Intensity and unpleasantness of neuropathic pain in half of the affected participants were reduced on the NPS test. Overall findings remained stable 12 to 16 weeks after termination of the training. Conclusions. In a pretest/posttest, uncontrolled design, VR-augmented training was associated with improvements in motor function and neuropathic pain in persons with chronic iSCI, several of which reached the level of a minimal clinically important change. A controlled trial is needed to compare this intervention to active training alone or in combination.

A Biologically Based Chemo-Sensing UAV for Humanitarian Demining:

Antipersonnel mines, weapons of cheap manufacture but lethal effect, have a high impact on the population even decades after the conflicts have finished. Here we investigate the use of a chemo-sensing Unmanned Aerial Vehicle (cUAV) for demining tasks. We developed a blimp based UAV that is equipped with a broadly tuned metal-thin oxide chemo-sensor. A number of chemical mapping strategies were investigated including two biologically based localization strategies derived from the moth chemical search that can optimize the efficiency of the detection and localization of explosives and therefore be used in the demining process. Additionally, we developed a control layer that allows for both fully autonomous and manual controlled flight, as well as for the scheduling of a fleet of cUAVs. Our results confirm the feasibility of this technology for demining in real-world scenarios and give further support to a biologically based approach where the understanding of biological systems is used to solve difficult engineering problems.

New Technologies and Concepts for Rehabilitation in the Acute Phase of Stroke: A Collaborative Matrix

The process of developing a successful stroke rehabilitation methodology requires four key components: a good understanding of the pathophysiological mechanisms underlying this brain disease, clear neuroscientific hypotheses to guide therapy, adequate clinical assessments of its efficacy on multiple timescales, and a systematic approach to the application of modern technologies to assist in the everyday work of therapists. Achieving this goal requires collaboration between neuroscientists, technologists and clinicians to develop well-founded systems and clinical protocols that are able to provide quantitatively validated improvements in patient rehabilitation outcomes. In this article we present three new applications of complementary technologies developed in an interdisciplinary matrix for acute-phase upper limb stroke rehabilitation – functional electrical stimulation, arm robot-assisted therapy and virtual reality-based cognitive therapy. We also outline the neuroscientific basis of our approach, present our detailed clinical assessment protocol and provide preliminary results from patient testing of each of the three systems showing their viability for patient use.

Virtual reality rehabilitation system for neuropathic pain and motor dysfunction in spinal cord injury patients

Spinal cord injury (SCI) causes both lower limb motor dysfunction and associated neuropathic pain. Although these two conditions share related cortical mechanisms, different interventions are currently used to treat each condition. With intensive training using entertaining virtual reality (VR) scenarios, it may be possible to reshape cortical networks thereby reducing neuropathic pain and improving motor function. We have created the first VR training system combining action observation and execution addressing lower limb function in incomplete SCI (iSCI) patients. A particular feature of the system is the use of size-adjustable shoes with integrated motion sensors. A pilot single-case clinical study is currently being conducted on six iSCI patients. Two patients tested to date were highly motivated to perform and reported improved physical well-being. They improved in playing skill and in controlling the virtual lower limbs. There were post-intervention indications of neuropathic pain decrease, muscle strength increase, faster walking speed and improved performance on items relevant for ambulation. In addition functional MRI before and after treatment revealed a decreased activation pattern. We interpret this result as an improvement of neuronal synergies for this task. These results suggest that our VR system may be beneficial for both reducing neuropathic pain and improving motor function in iSCI patients.

A Paediatric Interactive Therapy System for arm and hand rehabilitation

Paediatric rehabilitation using virtual reality systems pose unique usability challenges distinct from those in adult rehabilitation. These challenges relate to the different epidemiology and aetiology of childrenpsilas disorders requiring rehabilitation and the physical design of interactive virtual reality hardware for children of varying sizes. Just as importantly, children need highly entertaining interactive scenarios that suit their differing levels of cognitive development and thus their differing abilities to comprehend gaming scenarios. In this paper we present our virtual reality-based Paediatric Interactive Therapy System (PITS) designed specifically for upper arm rehabilitation in children aged from five years of age upwards. It incorporates a range of interchangeable position sensing devices (compass, bend sensor, pressure sensor and camera tracking) that can be adjusted to a large range of different hand sizes, and interactive gaming scenarios specifically designed for maximum entertainment value for children. We describe the neuroscientific principles behind our system, the technical details of the hardware components and the design of the interactive scenarios. An initial usability and patient acceptance pilot study has been conducted at the Rehabilitation Centre Affoltern of the University Childrenpsilas Hospital Zurich. To date all patients have accepted the system, and trained in reaching and grasping tasks at a far higher rate than in conventional occupational therapy. The system thus promises to be a valuable complement to conventional therapeutic programs offered in rehabilitation clinics.

Intensive virtual reality-based training for upper limb motor function in chronic stroke: a feasibility study using a single case experimental design and fMRI

Abstract Purpose: To evaluate feasibility and neurophysiological changes after virtual reality (VR)-based training of upper limb (UL) movements. Method: Single-case A-B-A-design with two male stroke patients (P1:67 y and 50 y, 3.5 and 3 y after onset) with UL motor impairments, 45-min therapy sessions 5×/week over 4 weeks. Patients facing screen, used bimanual data gloves to control virtual arms. Three applications trained bimanual reaching, grasping, hand opening. Assessments during 2-week baseline, weekly during intervention, at 3-month follow-up (FU): Goal Attainment Scale (GAS), Chedoke Arm and Hand Activity Inventory (CAHAI), Chedoke-McMaster Stroke Assessment (CMSA), Extended Barthel Index (EBI), Motor Activity Log (MAL). Functional magnetic resonance imaging scans (FMRI) before, immediately after treatment and at FU. Results: P1 executed 5478 grasps (paretic arm). Improvements in CAHAI (+4) were maintained at FU. GAS changed to +1 post-test and +2 at FU. P2 executed 9835 grasps (paretic arm). CAHAI improvements (+13) were maintained at FU. GAS scores changed to −1 post-test and +1 at FU. MAL scores changed from 3.7 at pre-test to 5.5 post-test and 3.3 at FU. Conclusion: The VR-based intervention was feasible, safe, and intense. Adjustable application settings maintained training challenge and patient motivation. ADL-relevant UL functional improvements persisted at FU and were related to changed cortical activation patterns. Implications for Rehabilitation YouGrabber trains uni- and bimanual upper motor function. Its application is feasible, safe, and intense. The control of the virtual arms can be done in three main ways: (a) normal (b) virtual mirror therapy, or (c) virtual following. The mirroring feature provides an illusion of affected limb movements during the period when the affected upper limb (UL) is resting. The YouGrabber training led to ADL-relevant UL functional improvements that were still assessable 12 weeks after intervention finalization and were related to changed cortical activation patterns.