Jan Babič

Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach

We propose an approach to efficiently teach robots how to perform dynamic manipulation tasks in cooperation with a human partner. The approach utilises human sensorimotor learning ability where the human tutor controls the robot through a multi-modal interface to make it perform the desired task. During the tutoring, the robot simultaneously learns the action policy of the tutor and through time gains full autonomy. We demonstrate our approach by an experiment where we taught a robot how to perform a wood sawing task with a human partner using a two-person cross-cut saw. The challenge of this experiment is that it requires precise coordination of the robot’s motion and compliance according to the partner’s actions. To transfer the sawing skill from the tutor to the robot we used Locally Weighted Regression for trajectory generalisation, and adaptive oscillators for adaptation of the robot to the partner’s motion.

Effects of Robotic Knee Exoskeleton on Human Energy Expenditure

A number of studies discuss the design and control of various exoskeleton mechanisms, yet relatively few address the effect on the energy expenditure of the user. In this paper, we discuss the effect of a performance augmenting exoskeleton on the metabolic cost of an able-bodied user/pilot during periodic squatting. We investigated whether an exoskeleton device will significantly reduce the metabolic cost and what is the influence of the chosen device control strategy. By measuring oxygen consumption, minute ventilation, heart rate, blood oxygenation, and muscle EMG during 5-min squatting series, at one squat every 2 s, we show the effects of using a prototype robotic knee exoskeleton under three different noninvasive control approaches: gravity compensation approach, position-based approach, and a novel oscillator-based approach. The latter proposes a novel control that ensures synchronization of the device and the user. Statistically significant decrease in physiological responses can be observed when using the robotic knee exoskeleton under gravity compensation and oscillator-based control. On the other hand, the effects of position-based control were not significant in all parameters although all approaches significantly reduced the energy expenditure during squatting.

Adaptive Control of Exoskeleton Robots for Periodic Assistive Behaviours Based on EMG Feedback Minimisation

In this paper we propose an exoskeleton control method for adaptive learning of assistive joint torque profiles in periodic tasks. We use human muscle activity as feedback to adapt the assistive joint torque behaviour in a way that the muscle activity is minimised. The user can then relax while the exoskeleton takes over the task execution. If the task is altered and the existing assistive behaviour becomes inadequate, the exoskeleton gradually adapts to the new task execution so that the increased muscle activity caused by the new desired task can be reduced. The advantage of the proposed method is that it does not require biomechanical or dynamical models. Our proposed learning system uses Dynamical Movement Primitives (DMPs) as a trajectory generator and parameters of DMPs are modulated using Locally Weighted Regression. Then, the learning system is combined with adaptive oscillators that determine the phase and frequency of motion according to measured Electromyography (EMG) signals. We tested the method with real robot experiments where subjects wearing an elbow exoskeleton had to move an object of an unknown mass according to a predefined reference motion. We further evaluated the proposed approach on a whole-arm exoskeleton to show that it is able to adaptively derive assistive torques even for multiple-joint motion.

Human sensorimotor learning for humanoid robot skill synthesis

Humans are very skilled at learning new control tasks, and in particular, the use of novel tools. In this article we propose a paradigm that utilizes this sensorimotor learning capacity to obtain robot behaviors, which would otherwise require manual programming by experts. The concept is to consider the target robot platform as a tool to be controlled intuitively by a human. The human is therefore provided with an interface designed to make the control of the robot intuitive, and learns to perform a given task using the robot. This is akin to the stage where a beginner learns to drive a car. After human learning, the skilled control of the robot is used to build an autonomous controller so that the robot can perform the task without human guidance. We demonstrate the feasibility of this proposal for humanoid robot skill synthesis by showing how a statically stable reaching skill can be obtained by means of this framework. In addition, we analyze the feedback interface component of this paradigm by examining a dynamics task, in which a human learns to use the motion of the body to control the posture of an inverted pendulum that approximates a humanoid robot, so that it stays upright.

Human-in-the-loop approach for teaching robot assembly tasks using impedance control interface

In this paper we propose a human-in-the-loop approach for teaching robots how to solve part assembly tasks. In the proposed setup the human tutor controls the robot through a haptic interface and a hand-held impedance control interface. The impedance control interface is based on a linear spring-return potentiometer that maps the button position to the robot arm stiffness. This setup allows the tutor to modulate the robot compliance based on the given task requirements. The demonstrated motion and stiffness trajectories are encoded using Dynamical Movement Primitives and learnt using Locally Weight Regression. To validate the proposed approach we performed experiments using Kuka Light Weight Robot and HapticMaster robot. The task of the experiment was to teach the robot how to perform an assembly task involving sliding a bolt fitting inside a groove in order to mount two parts together. Different stiffness was required in different stages of the task execution to accommodate the interaction of the robot with the environment and possible human-robot cooperation.

Learning of compliant human–robot interaction using full-body haptic interface

We present a novel approach where a human demonstrator can intuitively teach robot full-body skills. The aim of this approach is to exploit human sensorimotor ability to learn how to operate a humanoid robot in real time to perform tasks involving interaction with the environment. The human skill is then used to design a controller to autonomously control the robot. To provide the demonstrator with the robot’s state suitable for the full-body motion control, we developed a novel method that transforms robot’s sensory readings into feedback appropriate for the human. This method was implemented through a haptic interface that was designed to exert forces on the demonstrator’s centre of mass corresponding to the state of the robot’s centre of mass. To evaluate the feasibility of this approach, we performed an experiment where the human demonstrator taught the robot how to compliantly interact with another human. The results of the experiment showed that the proposed approach allowed the human to intuitively teach the robot how to compliantly interact with a human.

Stability analysis of four-point walking

The aim of the experiment reported here was to determine the static and dynamic stability of two-point stance phases when walking on hands and knees at different speeds. In addition, we defined the methods and predicted the consequences of including two-point stance phases into crutch assisted functional electrical stimulation (FES) walking. Crawling on hands and knees was performed at three speeds by five healthy male persons. With twelve joint-position markers placed on the subject, we determined two stability indices for every instant of gait. We analysed the peak values of these two indices during the two-point stance phases. The results indicate that we have to ensure the proper position of the centre of gravity to increase the speed of walking. To reach speeds, lower than 0.6 m/s, it is not necessary to include statically unstable phases. The shift of the centre of gravity towards and across the leading stability edge can result in getting into the dynamically unstable state. Considering the results we can effectively introduce two-point stance phases into crutch assisted FES walking and therefore increase the speed and energy effectiveness of walking

Humanoid robot posture-control learning in real-time based on human sensorimotor learning ability

In this paper we propose a system capable of teaching humanoid robots new skills in real-time. The system aims to simplify the robot control and to provide a natural and intuitive interaction between the human and the robot. The key element of the system is exploitation of the human sensorimotor learning ability where a human demonstrator learns how to operate a robot in the same fashion as humans adapt to various everyday tasks. Another key aspect of the proposed system is that the robot learns the task simultaneously while the human is operating the robot. This enables the control of the robot to be gradually transferred from the human to the robot during the demonstration. The control is transferred based on the accuracy of the imitated task. We demonstrated our approach using an experiment where a human demonstrator taught a humanoid robot how to maintain the postural stability in the presence of the perturbations. To provide the appropriate feedback information of the robots postural stability to the human sensorimotor system, we utilized a custom-built haptic interface. To absorb the demonstrated skill by the robot, we used Locally Weighted Projection Regression machine learning method. A novel approach was implemented to gradually transfer the control responsibility from the human to the incrementally built autonomous robot controller.

Optimal jumps for biarticular legged robots

This paper investigates the extent to which biarticular actuation mechanisms-antagonistic actuation schemes with spring stiffness that extend over two joints, similar in function to biarticular muscles found in legged animals-improve the performance of jumping and other fast explosive robot movements. Robust gradient-based optimization algorithms that take into account the dynamic properties and various contact and actuator constraints of biarticular systems are developed. We then quantitatively evaluate the gains in jumping vis-a-vis conventional joint actuation schemes. We also examine the effects of biarticular link stiffness and link mass distributions on the jumping performance of the biarticular mechanism.

Effects of supportive hand contact on reactive postural control during support perturbations

There are many everyday situations in which a supportive hand contact is required for an individual to counteract various postural perturbations. By emulating situations when balance of an individual is challenged, we examined functional role of supportive hand contact at different locations where balance of an individual was perturbed by translational perturbations of the support surface. We examined the effects of handle location, perturbation direction and perturbation intensity on the postural control and the forces generated in the handle. There were significantly larger centre-of-pressure (CoP) displacements for perturbations in posterior direction than for perturbations in anterior direction. Besides, the perturbation intensity significantly affected the peak CoP displacement in both perturbation directions. However, the position of the handle had no effects on the peak CoP displacement. On the contrary, there were significant effects of perturbation direction, perturbation intensity and handle position on the maximal force in the handle. The effect of the handle position was significant for the perturbations in posterior direction where the lowest maximal forces were recorded in the handle located at the shoulder height. They were comparable to the forces in the handle at eye height and significantly lower than the forces in the handle located either lower or further away from the shoulder. In summary, our results indicate that although the location of a supportive hand contact has no effect on the peak CoP displacement of healthy individuals, it affects the forces that an individual needs to exert on the handle in order to counteract support perturbations.