Nobutsuna Endo

Whole body emotion expressions for KOBIAN humanoid robot — preliminary experiments with different Emotional patterns —

Personal robots and robot technology (RT)-based assistive devices are expected to play a major role in our elderly-dominated society, with an active participation to joint works and community life with humans, as partner and as friends for us. In particular, these robots are expected to be fundamental for helping and assisting elderly and disabled people during their activities of daily living (ADLs). To achieve this result, personal robots should be also capable of human-like emotion expressions. To this purpose we developed a new whole body emotion expressing bipedal humanoid robot, named KOBIAN, which is also capable to express human-like emotions. In this paper we presented three different evaluations of the emotional expressiveness of KOBIAN. In particular In particular, we presented the analysis of the roles of the face, the body, and their combination in emotional expressions. We also compared Emotional patterns created by a Photographer and a Cartoonist with the ones created by us. Overall, although the experimental results are not as good as we were expecting, we confirmed the robot can clearly express its emotions, and that very high recognition ratios are possible.

Design of the humanoid robot KOBIAN - preliminary analysis of facial and whole body emotion expression capabilities-

Personal robots and robot technology (RT)-based assistive devices are expected to play a major role in our elderly-dominated society, with an active participation to joint works and community life with humans, as partner and as friends for us. In particular, these robots are expected to be fundamental for helping and assisting elderly and disabled people during their activities of daily living (ADLs). To achieve this result, personal robots should be capable of human-like emotion expressions; in addition, human-like bipedal walking is the best solution for the robots which should be active in the human living environment. Although several bipedal robots and several emotional expression robots have been developed in the recent years, until now there was no robot which integrated all these functions. Therefore we developed a new bipedal walking robot, named KOBIAN, which is also capable to express human-like emotions. In this paper, we present the design and the preliminary evaluation of the new emotional expression head. The preliminary results showed that the emotion expressed by only the head cannot be really easily understood by the users. However, the presence of a full body clearly enhances the emotion expression capability of the robot, thus proving the effectiveness of the proposed approach.

Development of whole-body emotion expression humanoid robot

Personal robots and robot technology (RT)-based assistive devices are expected to play a major role in our elderly-dominated society, with an active participation to joint works and community life with humans, as partner and as friends for us. The authors think that the emotion expression of a robot is effective in joint activities of human and robot. In addition, we also think that bipedal walking is necessary to robots which are active in human living environment. But, there was no robot which has those functions. And, it is not clear what kinds of functions are effective actually. Therefore we developed a new bipedal walking robot which is capable to express emotions. In this paper, we present the design and the preliminary evaluation of the new head of the robot with only a small number of degrees of freedom for facial expression.

Development of expressive robotic head for bipedal humanoid robot

This paper describes the development of a new expressive robotic head for the bipedal humanoid robot. Facial expressions of our old robotic head have low facial expression recognition rate and in order to improve it we asked amateur cartoonists to create computer graphics (CG) images. To realize such expressions found in the CGs, the new head was provided with 24-DoFs and facial color. We designed compact mechanisms that fit into the head, which dimensions are based on average adult Japanese female size. We conducted a survey with pictures and videos to evaluate the expression ability. Results showed that facial expression recognition rates for the 6 basic emotions are increased compared to the old KOBIANs head.

New Foot System Adaptable to Convex and Concave Surface

Many control methods have been studied on the assumption that the feet of biped robots contact the ground with four points. However, it is difficult for almost all of such biped robots to maintain four-point contact on uneven terrains because they have rigid and flat soles. In order to solve the problem, foot mechanisms should be studied. In 2003, we developed WS-1R (Waseda Shoes - No.1 Refined) which is able to maintain four-point contact. However, it is difficult to deal with the concave or convex ground because of the problems of the contact detection and sideways slip. So, WS-5 (Waseda Shoes - No.5) has been developed. To avoid the slip of the foot, a cam-slider locking system consisting of a solenoid and a cam is constructed and installed at the foot. Also, linear encoders are employed to measure the position of the foot sliders. Through walking experiments on uneven terrains, the effectiveness of WS-5 is confirmed.

A cross-cultural study on generation of culture dependent facial expressions of humanoid social robot

Communication between humans and robots is a very critical step for the integration of social robots into society. Emotion expression through a robotic face is one of the key points of communication. Despite the most recent efforts, no matter how much expression capabilities improve, facial expression recognition is often hampered by a cultural divide between subjects that participate in surveys. The purpose of this work is to take advantage of the 24 degrees of freedom head of the humanoid social robot KOBIAN-R for making it capable of displaying different versions of the same expressions, using face and neck, in a way that they are easy to understand for Japanese and for Western subjects. We present a system based on relevant studies of human communication and facial anatomy, as well as on the work of illustrators and cartoonists. The expression generator we developed can be adapted to specific cultures. Results confirmed the in-group advantage, showing that the recognition rate of this system is higher when the nationality of the subjects and the cultural characterisation of the shown expressions are coincident. We conclude that this system could be used, in future, on robots that have to interact in a social environment, with people with different cultural background.

Landing Pattern Modification Method with Predictive Attitude and Compliance Control to Deal with Uneven Terrain

Many researchers have been studying on walking control methods for biped robots. However, the effectiveness of these control methods was not verified in outdoor environments such as pedestrian roads and gravel roads. In this paper, a landing pattern modification method adaptable to uneven terrain in a real environment is proposed which is based on a predictive attitude compensation control and a nonlinear compliance control. This method does not require any other sensors except force sensors. Also, a new biped foot system is described which can form larger support polygons on uneven terrain than conventional biped foot systems. Using the modification method and the foot system, WL-16RII (Waseda Leg-No.16 Refined II) achieved a stable walk on bumpy terrain with 20 mm height and 10 degrees inclination. Furthermore, a stable dynamic walk was realized on a paved road, when a human rode it. Through various walking experiments, the effectiveness of the method was confirmed

Generation of humanoid robot's facial expressions for context-aware communication

Communication between humans and robots is a very important aspect in the field of Humanoid Robotics. For a natural interaction, robots capable of nonverbal communication must be developed. However, despite the most recent efforts, robots still can show only limited expression capabilities. The purpose of this work is to create a facial expression generator that can be applied to the 24 DoF head of the humanoid robot KOBIAN-R. In this manuscript, we present a system that based on relevant studies of human communication and facial anatomy can produce thousands of combinations of facial and neck movements. The wide range of expressions covers not only primary emotions, but also complex or blended ones, as well as communication acts that are not strictly categorized as emotions. Results showed that the recognition rate of expressions produced by this system is comparable to the rate of recognition of the most common facial expressions. Context-based recognition, which is especially important in case of more complex communication acts, was also evaluated. Results proved that produced robotic expressions can alter the meaning of a sentence in the same way as human expressions do. We conclude that our system can successfully improve the communication abilities of KOBIAN-R, making it capable of complex interaction in the future.

Waseda Bioinstrumentation system WB-2 - the new inertial measurement unit for the new motion caption system -

Personal robots and robot technology (RT)- based assistive devices are expected to play a major role in Japans elderly-dominated society, both for joint activities with their human partners and for participation in community life. These new devices should be capable of smooth and natural adaptation and interaction with their human partners and the environment, should be able to communicate naturally with humans, and should never have a negative effect on their human partners, neither physical nor emotional. To achieve this smooth and natural integration between humans and robots, we need first to investigate and clarify how these interactions are carried out. Therefore, we developed the portable bioinstrumentation system WB-2 (Waseda bioinstrumentation system No.2), which can measure the movements of the head, the arms, and the hands (position, velocity, and acceleration), as well as several physiological parameters (electrical activity of the heart respiration, perspiration, pulse wave, and so on), to objectively measure and understand the physical and physiological effects of the interaction between robots and humans. In this paper we present our development of the Inertial Measurement Unit, which is at the heart of our new motion-capture system that replaces the system used in the Waseda bioinstrumentation system No.1 refined (WB-1R). Some preliminary results of experiments with the unit are also presented and analyzed.

Using the Waseda Bioinstrumentation System WB-1R to analyze Surgeon’s performance during laparoscopy - towards the development of a global performance index -

Minimally invasive surgery (MIS) has become very common in recent years, thanks to the many advantages it provides for patients. Since it is difficult for surgeons to learn and master this technique, several training methods and metrics have been proposed, both to improve the surgeons abilities and also to assess his/her skills. This paper presents the use of the WB-1R (Waseda bioinstrumentation system no.1 refined), which was developed at Waseda University, Tokyo, to investigate and analyze a surgeons movements and performance. Specifically, the system can measure the movements of the head, the arms, and the hands, as well as several physiological parameters. In this paper we present our experiment to evaluate a surgeons ability to handle surgical instruments and his/her depth perception using a laparoscopic view. Our preliminary analysis of a subset of the acquired data (i.e. comfort of the subjects; the amount of time it took o complete each exercise; and respiration) clearly shows that the expert surgeon and the group of medical students perform very differently. Therefore, WB-1R (or, better, a newer version tailored specifically for use in the operating room) could provide important additional information to help assess the experience and performance of surgeons, thus leading to the development of a global performance index for surgeons during MIS. These analyses and modeling, moreover, are an important step towards the automatization and the robotic assistance of the surgical gesture.