J. Norberto Pires

Object-oriented and distributed approach for programming robotic manufacturing cells

Abstract Flexible manufacturing systems (FMS) are essential for small/medium batch and job shop manufacturing. These types of production systems are used to manufacture a considerable variety of products with medium/small production volumes. Therefore, the manufacturing platforms supporting these types of production must be flexible and organized in flexible manufacturing cells (FMC). Programming FMCs remains a difficult task and is an actual area of research and development. This paper reports an object-oriented approach developed for FMC programming. The work presented was first thought for application in industrial robot manipulators, and later extended to other FMC equipments just by putting the underlying ideas in a general framework. Initially, the motivation for this work was to develop means to add force control to a standard industrial robot manipulator. This problem requires remote access to the robot controller, remote programming and monitoring, as also is required to program and monitor any other FMC equipment. The proposed approach is distributed based on a client/server model and runs on Win32 platforms, i.e., Microsoft Windows and Windows NT. Implementation for the special case of industrial robot manipulators is presented, along with some application examples used for educational, research and industrial purposes.

Robot‐by‐voice: experiments on commanding an industrial robot using the human voice

Purpose – This paper reports a few results of an ongoing research project that aims to explore ways to command an industrial robot using the human voice. This feature can be interesting with several industrial, laboratory and clean‐room applications, where a close cooperation between robots and humans is desirable.Design/methodology/approach – A demonstration is presented using two industrial robots and a personal computer (PC) equipped with a sound board and a headset microphone. The demonstration was coded using the Microsoft Visual Basic and C#.NET 2003 and associated with two simple robot applications: one capable of picking‐and‐placing objects and going to predefined positions, and the other capable of performing a simple linear weld on a work‐piece. The speech recognition grammar is specified using the grammar builder from the Microsoft Speech SDK 5.1. The paper also introduces the concepts of text‐to‐speech translation and voice recognition, and shows how these features can be used with application...

CAD interface for automatic robot welding programming

Industrial robots play an important role in industry, due to their flexibility. Many applications (almost all that require human intervention) may be performed with advantages by robots. Nevertheless, set‐up operations, necessary when changing production models, are still tricky and time‐consuming. It is common to have detailed data of working pieces in computer aided design (CAD) files, resulting from product design and project. This information is not used satisfactorily, or even not used at all, for robot programming. In this paper, we propose a solution capable of extracting robot motion information from the CAD data.

High‐level programming and control for industrial robotics: using a hand‐held accelerometer‐based input device for gesture and posture recognition

Purpose – Most industrial robots are still programmed using the typical teaching process, through the use of the robot teach pendant. This is a tedious and time‐consuming task that requires some technical expertise, and hence new approaches to robot programming are required. The purpose of this paper is to present a robotic system that allows users to instruct and program a robot with a high‐level of abstraction from the robot language.Design/methodology/approach – The paper presents in detail a robotic system that allows users, especially non‐expert programmers, to instruct and program a robot just showing it what it should do, in an intuitive way. This is done using the two most natural human interfaces (gestures and speech), a force control system and several code generation techniques. Special attention will be given to the recognition of gestures, where the data extracted from a motion sensor (three‐axis accelerometer) embedded in the Wii remote controller was used to capture human hand behaviours. G...

Accelerometer-based control of an industrial robotic arm

Most of industrial robots are still programmed using the typical teaching process, through the use of the robot teach pendant. In this paper is proposed an accelerometer-based system to control an industrial robot using two low-cost and small 3-axis wireless accelerometers. These accelerometers are attached to the human arms, capturing its behavior (gestures and postures). An Artificial Neural Network (ANN) trained with a back-propagation algorithm was used to recognize arm gestures and postures, which then will be used as input in the control of the robot. The aim is that the robot starts the movement almost at the same time as the user starts to perform a gesture or posture (low response time). The results show that the system allows the control of an industrial robot in an intuitive way. However, the achieved recognition rate of gestures and postures (92%) should be improved in future, keeping the compromise with the system response time (160 milliseconds). Finally, the results of some tests performed with an industrial robot are presented and discussed.

Programming‐by‐demonstration in the coworker scenario for SMEs

– The purpose of this paper is to report a collection of developments that enable users to program industrial robots using speech, several device interfaces, force control and code generation techniques., – The reported system is explained in detail and a few practical examples are given that demonstrate its usefulness for small to medium‐sized enterprises (SMEs), where robots and humans need to cooperate to achieve a common goal (coworker scenario). The paper also explores the user interface software adapted for use by non‐experts., – The programming‐by‐demonstration (PbD) system presented proved to be very efficient with the task of programming entirely new features to an industrial robotic system. The system uses a speech interface for user command, and a force‐controlled guiding system for teaching the robot the details about the task being programmed. With only a small set of implemented robot instructions it was fairly easy to teach the robot system a new task, generate the robot code and execute it immediately., – Although a particular robot controller was used, the system is in many aspects general, since the options adopted are mainly based on standards. It can obviously be implemented with other robot controllers without significant changes. In fact, most of the features were ported to run with Motoman robots with success., – It is important to stress that the robot program built in this section was obtained without writing a single line of code, but instead just by moving the robot to the desired positions and adding the required robot instructions using speech. Even the upload task of the obtained module to the robot controller is commanded by speech, along with its execution/termination. Consequently, teaching the robotic system a new feature is accessible for any type of user with only minor training., – This type of PbD systems will constitute a major advantage for SMEs, since most of those companies do not have the necessary engineering resources to make changes or add new functionalities to their robotic manufacturing systems. Even at the system integrator level these systems are very useful for avoiding the need for specific knowledge about all the controllers with which they work: complexity is hidden beyond the speech interfaces and portable interface devices, with specific and user‐friendly APIs making the connection between the programmer and the system.

OmniClimbers: Omni-directional magnetic wheeled climbing robots for inspection of ferromagnetic structures

This paper introduces Omniclimber, a new climbing robot with high maneuverability for inspection of ferromagnetic flat and convex human made structures. In addition to maneuverability, adaptability to various structures with different curvatures and materials are addressed. The conceptual and detailed design of OmniClimbers are presented and two prototypes of the robot are introduced. Several laboratory and field tests are reported, and the results are discussed.

Force/torque sensing applied to industrial robotic deburring

Force/torque sensing is very important for several automatic and industrial robotic applications. Basically, if precise control of the forces that arise from contact between tools and parts is required to successfully complete the automatic task, then a force/torque sensor is needed along with some force/torque control technique. In this paper we focus on force/torque sensing aspects applied to industrial robotic tasks. Concentrating on a particular type of force/torque sensor, we demonstrate how to use them and how to integrate them into force/torque control applications using robots. Finally, an industrial application is presented where force control was fundamental for the success of the task.

CAD-based off-line robot programming

Traditional industrial robot programming, using the robot teach pendant, is a tedious and time-consuming task that requires technical expertise. Hence, new and more intuitive ways for people to interact with robots are required to make robot programming easier. The goal is to develop methodologies that help users to program a robot in an intuitive way, with a high-level of abstraction from the robot language. In this paper we present a CAD-based system to program a robot from a 3D CAD environment, allowing users with basic CAD skills to generate robot programs off-line, without stop robot production. This system works as a human-robot interface (HRI) where, through a relatively low cost and commercially available CAD package, the user is able to generate robot programs. The methods used to extract information from the CAD and techniques to treat/convert it into robot commands are presented. The effectiveness of the proposed method is proved through various experiments. The results showed that the system is easy to use and within minutes an untrained user can set up the system and generate a robot program for a specific task. Finally, the time spent in the robot programming task is compared with the time taken to perform the same task but using the robot teach pendant as interface.

High‐level robot programming based on CAD: dealing with unpredictable environments

Purpose – The purpose of this paper is to present a CAD‐based human‐robot interface that allows non‐expert users to teach a robot in a manner similar to that used by human beings to teach each other.Design/methodology/approach – Intuitive robot programming is achieved by using CAD drawings to generate robot programs off‐line. Sensory feedback allows minimization of the effects of uncertainty, providing information to adjust the robot paths during robot operation.Findings – It was found that it is possible to generate a robot program from a common CAD drawing and run it without any major concerns about calibration or CAD model accuracy.Research limitations/implications – A limitation of the proposed system has to do with the fact that it was designed to be used for particular technological applications.Practical implications – Since most manufacturing companies have CAD packages in their facilities today, CAD‐based robot programming may be a good option to program robots without the need for skilled robot ...