Luís F. Rocha

Evaluation of Depth Sensors for Robotic Applications

The sensors that acquire 3D data play an important role in many applications. In addition, they have been used in the robotic field for several purposes, for instance, enhancing the navigation of mobile robots, object detection, scene reconstruction, 3D inspection of parts and others. Moreover, a significant amount of devices with distinct cost, accuracy and features have been released in the recent years which increases the difficulty of comparing each sensor in a proper manner or choosing the most suitable device for a specific task and operation field. This paper compares the Kinect v1, Kinect v2, Structure Sensor and Mesa Imaging SR4000. The noise of each sensor is characterized for different distances and considering objects with different colors. Therefore, this paper proposes a simple but quantitative benchmark for evaluating 3D devices that characterizes the most relevant features for the robotic field and in accordance with different type of operations.

Shop floor scheduling in a mobile robotic environment

Nowadays,it is far more common to see mobile robotics working in the industrial sphere due to the mandatory need to achieve a new level of productivity and increase profits by reducing production costs. Management scheduling and task scheduling are crucial for companies that incessantly seek to improve their processes, increase their efficiency, reduce their production time and capitalize on their infrastructure by increasing and improving production. However, when faced with the constant decrease in production cycles, management algorithms can no longer solely focus on the mere management of the resources available, they must attempt to optimize every interaction between them, to achieve maximum efficiency for each production resource. In this paper we focus on the presentation of the new competition called Robot@Factory, its environment and its main objectives, paying special attention to the scheduling algorithm developed for this specific case study. The findings from the simulation approach have allowed us to conclude that mobile robotic path planning and the scheduling of the associated tasks represent a complex problem that has a strong impact on the efficiency of the entire production process.

2D Cloud Template Matching - A Comparison between Iterative Closest Point and Perfect Match

Self-localization of mobile robots in the environment is one of the most fundamental problems in the robotics field. It is a complex and challenging problem due to the high requirements of autonomous mobile vehicles, particularly with regard to algorithms accuracy, robustness and computational efficiency. In this paper we present the comparison of two of the most used map-matching algorithm, which are the Iterative Closest Point and the Perfect Match. This category of algorithms are normally applied in localization based on natural landmarks. They were compared using an extensive collection of metrics, such as accuracy, computational efficiency, convergence speed, maximum admissible initialization error and robustness to outliers in the robots sensors data. The test results were performed in both simulated and real world environments.

Comprehensive Review of the Dispatching, Scheduling and Routing of AGVs

Automated Guided Vehicle System (AGVS) has become an important strategic tool for automated warehouses. In a very competitive business scenario, they can increase productivity and reduce costs of FMS (Flexible Manufacturing System) transportation systems. The AGV System provides efficient material flow and distribution among workstations at the right time and place. To attend such requirements, AGVS involves dispatching and scheduling of tasks and routing of AGVs. Some studies have approached such procedures in a similar form, although they have different functionalities. This paper reviews the literature related to the dispatching, scheduling and routing of AGVs (Automated Guided Vehicles) and highlights their main differences in comparison with the common management of vehicles transportation systems. To obtain a theoretical base, the definitions of dispatching, routing and scheduling procedures for materials handling applications are presented and the main methods to solve them are discussed.

Recognizing Industrial Manipulated Parts Using the Perfect Match Algorithm

The objective of this work is to develop a highly robust 3D part localization and recognition algorithm. This research work is driven by the needs specified by enterprises with small production series that seek for full robotic automation in their production line, which processes a wide range of products and cannot use dedicated identification devices due to technological processes. With the correct classification of the part, the robot will be able to autonomously select the correct program to execute. For this purpose, the Perfect Match algorithm, which is known by its computational efficiency, high precision and robustness, was adapted for object recognition achieving a 99.7% of classification rate. The expected practical implication of this work is contributing to the integration of industrial robots in highly dynamic and specialized lines, reducing the companies’ dependency on skilled operators.

Assessment of Robotic Picking Operations Using a 6 Axis Force/Torque Sensor

This letter presents a novel architecture for evaluating the success of picking operations that are executed by industrial robots. It is formed by a cascade of machine learning algorithms (kNN and SVM) and uses information obtained by a 6 axis force/torque sensor and, if available, information from the built-in sensors of the robotic gripper. Beyond measuring the success or failure of the entire operation, this architecture makes it possible to detect in real-time when an object is slipping during the picking. Therefore, force and torque signatures are collected during the picking movement of the robot, which is decomposed into five different stages that allows to characterize distinct levels of success over time. Several trials were performed using an industrial robot with two different grippers for picking a long and flexible object. The experiments demonstrate the reliability of the proposed approach under different picking scenarios since, it obtained a testing performance (in terms of accuracy) up to 99.5% of successful identification of the result of the picking operations, considering an universe of 400 attempts.

Online inspection system based on machine learning techniques: real case study of fabric textures classification for the automotive industry

This paper focus on the classification, in real-time and under uncontrolled lighting, of fabric textures for the automotive industry. Many industrial processes have spatial constraints that limit the effective control of illumination of their vision based systems, hindering their effectiveness. The ability to overcome these problems using robust classification methods with suitable pre-processing techniques and choice of characteristics will increase the efficiency of this type of solutions with obvious production gains and thus economical. For this purpose, this paper studied and analyzed various pre-processing techniques, and selected the most appropriate fabric characteristics for the considered industrial case scenario. The methodology followed was based on the comparison of two different machine learning classifiers, ANN and SVM, using a large set of samples with a large variability of lightning conditions to faithfully simulate the industrial environment. The obtained solution shows the sensibility of ANN over SVM considering the number of features and the size of the training set, showing the better effectiveness and robustness of the last. The characteristics vector uses histogram equalization, Laws filter and Sobel filter, and multi-scale analysis. By using a correlation based method was possible to reduce the number of features used, achieving a better balanced between processing time and classification ratio.

Development of a 3D model based part recognition system for industrial applications: Main challenges

Nowadays, and considering flexibility, industrial robots still present some drawback that prevent them to be used in vast fields of the industry. One of their major limitations is related with their perception skills. In this area, and although the many developments verified on 3D object recognition systems in the research sphere, the number of solutions appearing in the industry level has been slow. Hence, this article tries to clarify some of the motives that difficult the technology transference (in what concerns object recognition) between both worlds. At the same time, it will be presented an industrial case scenario (inserted in an European Project) where some of the problems enumerated during the article are present.

Time enhanced A∗: Towards the development of a new approach for Multi-Robot Coordination

In this paper the authors focus on presenting a new path planning approach for a multi-robot transportation system in an industrial case scenario. The proposed method is based on the A* heuristic search in a cell decomposition scenario, for which a time component was added - Time Enhanced A* or simply TEAA*. To access the flexibility and efficiency of the proposed algorithm, a set of experiments were performed in a simulated industrial environment. During trials execution the proposed algorithm has shown high capability on preventing/dealing with the occurrence of deadlocks in the transportation system.

New marker for real-time industrial robot programming by motion imitation.

This paper presents a new marker for robot programming by demonstration through motion imitation. The device is based on high intensity LEDs (light emission diodes) which are captured by a pair of industrial cameras. Using stereoscopy, the marker supplies 6-DoF (degrees of freedom) human wrist tracking with both position and orientation data. We propose a robust technique for camera and stereo calibration which maps camera coordinates directly into the desired robot frame, using a single LED. The calibration and tracking procedures are thoroughly described. The tests show that the marker presents a new robust, accurate and intuitive method for industrial robot programming. The system is able to perform in real-time and requires only a single pair of industrial cameras though more can be used for improved effectiveness and accuracy.