Tadej Petrič

On-line frequency adaptation and movement imitation for rhythmic robotic tasks

In this paper we present a novel method to obtain the basic frequency of an unknown periodic signal with an arbitrary waveform, which can work online with no additional signal processing or logical operations. The method originates from non-linear dynamical systems for frequency extraction, which are based on adaptive frequency oscillators in a feedback loop. In previous work, we had developed a method that could extract separate frequency components by using several adaptive frequency oscillators in a loop, but that method required a logical algorithm to identify the basic frequency. The novel method presented here uses a Fourier series representation in the feedback loop combined with a single oscillator. In this way it can extract the frequency and the phase of an unknown periodic signal in real time and without any additional signal processing or preprocessing. The method determines the Fourier series coefficients and can be used for dynamic Fourier series implementation. The proposed method can be used for the control of rhythmic robotic tasks, where only the extraction of the basic frequency is crucial. For demonstration several highly non-linear and dynamic periodic robotic tasks are shown, including also a task where an electromyography (EMG) signal is used in a feedback loop.

Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach

We propose an approach to efficiently teach robots how to perform dynamic manipulation tasks in cooperation with a human partner. The approach utilises human sensorimotor learning ability where the human tutor controls the robot through a multi-modal interface to make it perform the desired task. During the tutoring, the robot simultaneously learns the action policy of the tutor and through time gains full autonomy. We demonstrate our approach by an experiment where we taught a robot how to perform a wood sawing task with a human partner using a two-person cross-cut saw. The challenge of this experiment is that it requires precise coordination of the robot’s motion and compliance according to the partner’s actions. To transfer the sawing skill from the tutor to the robot we used Locally Weighted Regression for trajectory generalisation, and adaptive oscillators for adaptation of the robot to the partner’s motion.

Orientation in Cartesian Space Dynamic Movement Primitives

Dynamic movement primitives (DMPs) were proposed as an efficient way for learning and control of complex robot behaviors. They can be used to represent point-to-point and periodic movements and can be applied in Cartesian or in joint space. One problem that arises when DMPs are used to define control policies in Cartesian space is that there exists no minimal, singularity-free representation of orientation. In this paper we show how dynamic movement primitives can be defined for non minimal, singularity free representations of orientation, such as rotation matrices and quaternions. All of the advantages of DMPs, including ease of learning, the ability to include coupling terms, and scale and temporal invariance, can be adopted in our formulation. We have also proposed a new phase stopping mechanism to ensure full movement reproduction in case of perturbations.

Effects of Robotic Knee Exoskeleton on Human Energy Expenditure

A number of studies discuss the design and control of various exoskeleton mechanisms, yet relatively few address the effect on the energy expenditure of the user. In this paper, we discuss the effect of a performance augmenting exoskeleton on the metabolic cost of an able-bodied user/pilot during periodic squatting. We investigated whether an exoskeleton device will significantly reduce the metabolic cost and what is the influence of the chosen device control strategy. By measuring oxygen consumption, minute ventilation, heart rate, blood oxygenation, and muscle EMG during 5-min squatting series, at one squat every 2 s, we show the effects of using a prototype robotic knee exoskeleton under three different noninvasive control approaches: gravity compensation approach, position-based approach, and a novel oscillator-based approach. The latter proposes a novel control that ensures synchronization of the device and the user. Statistically significant decrease in physiological responses can be observed when using the robotic knee exoskeleton under gravity compensation and oscillator-based control. On the other hand, the effects of position-based control were not significant in all parameters although all approaches significantly reduced the energy expenditure during squatting.

Adaptive Control of Exoskeleton Robots for Periodic Assistive Behaviours Based on EMG Feedback Minimisation

In this paper we propose an exoskeleton control method for adaptive learning of assistive joint torque profiles in periodic tasks. We use human muscle activity as feedback to adapt the assistive joint torque behaviour in a way that the muscle activity is minimised. The user can then relax while the exoskeleton takes over the task execution. If the task is altered and the existing assistive behaviour becomes inadequate, the exoskeleton gradually adapts to the new task execution so that the increased muscle activity caused by the new desired task can be reduced. The advantage of the proposed method is that it does not require biomechanical or dynamical models. Our proposed learning system uses Dynamical Movement Primitives (DMPs) as a trajectory generator and parameters of DMPs are modulated using Locally Weighted Regression. Then, the learning system is combined with adaptive oscillators that determine the phase and frequency of motion according to measured Electromyography (EMG) signals. We tested the method with real robot experiments where subjects wearing an elbow exoskeleton had to move an object of an unknown mass according to a predefined reference motion. We further evaluated the proposed approach on a whole-arm exoskeleton to show that it is able to adaptively derive assistive torques even for multiple-joint motion.

Smooth continuous transition between tasks on a kinematic control level: Obstacle avoidance as a control problem

Kinematically redundant robots allow simultaneous execution of several tasks with different priorities. Beside the main task, obstacle avoidance is one commonly used subtask. The ability to avoid obstacles is especially important when the robot is working in a human environment. In this paper, we propose a novel control method for kinematically redundant robots, where we focus on a smooth, continuous transition between different tasks. The method is based on a new and very simple null-space formulation. Sufficient conditions for the tasks design are given using the Lyapunov-based stability discussion. The effectiveness of the proposed control method is demonstrated by simulation and on a real robot. Pros and cons of the proposed method and the comparison with other control methods are also discussed.

Real-time 3D marker tracking with a WIIMOTE stereo vision system: Application to robotic throwing

In this paper we describe the use of a standard game console joystick, namely the Nintendo WIIMOTE, for an active real-time 3D marker tracking. We show the ease of applicability of inexpensive and robust standard game controllers for 3D object tracking, e.g. to track an infrared source in 3D space. Recovering the 3D information using stereo vision is still one of the major research areas in computer vision and has given rise to a great deal of literature in the recent past. In this paper we present the method for calibrating a WIIMOTE stereo pair without knowing any parameters of the build-in infrared cameras in advance. The results are two matrices which includes both the intrinsic and extrinsic parameters for left and right cameras. The comparison between the stereo and the mono WIIMOTE tracking system is presented. Furthermore, to demonstrate the use of the WIIMOTE stereo system we considered the task of throwing a ball with robotic hand, to the target identified with an infrared source. The throwing task was divided into two separate parts: the tracking part and the throwing part.

Human-in-the-loop approach for teaching robot assembly tasks using impedance control interface

In this paper we propose a human-in-the-loop approach for teaching robots how to solve part assembly tasks. In the proposed setup the human tutor controls the robot through a haptic interface and a hand-held impedance control interface. The impedance control interface is based on a linear spring-return potentiometer that maps the button position to the robot arm stiffness. This setup allows the tutor to modulate the robot compliance based on the given task requirements. The demonstrated motion and stiffness trajectories are encoded using Dynamical Movement Primitives and learnt using Locally Weight Regression. To validate the proposed approach we performed experiments using Kuka Light Weight Robot and HapticMaster robot. The task of the experiment was to teach the robot how to perform an assembly task involving sliding a bolt fitting inside a groove in order to mount two parts together. Different stiffness was required in different stages of the task execution to accommodate the interaction of the robot with the environment and possible human-robot cooperation.

Motion capture and reinforcement learning of dynamically stable humanoid movement primitives

Direct transfer of human motion trajectories to humanoid robots does not result in dynamically stable robot movements due to the differences in human and humanoid robot kinematics and dynamics. We developed a system that converts human movements captured by a low-cost RGB-D camera into dynamically stable humanoid movements. The transfer of human movements occurs in real-time. As need arises, the developed system can smoothly transition between unconstrained movement imitation and imitation with balance control, where movement reproduction occurs in the null space of the balance controller. The developed balance controller is based on an approximate model of the robot dynamics, which is sufficient to stabilize the robot during on-line imitation. However, the resulting movements cannot be guaranteed to be optimal because the model of the robot dynamics is not exact. The initially acquired movement is therefore subsequently improved by model-free reinforcement learning, both with respect to the accuracy of reproduction and balance control. We present experimental results in simulation and on a real humanoid robot.

Smooth transition between tasks on a kinematic control level: Application to self collision avoidance for two Kuka LWR robots

A common approach for kinematically redundant robot consist of a definition of several tasks properly combined in priority. However, in some cases the task priority needs to be changed in order to successfully perform the desired task without changing the initial strategy. In this paper we propose a novel method for control of kinematically redundant robots, where we focus on a smooth, continuous transition between the primary and the secondary task. The method is based on a null-space velocity control algorithm, which is essential for achieving good behaviour of a redundant robotic system. The effectiveness of the proposed system is demonstrated on a robotic system with two Kuka LWR robots.