Ayssam Yehia Elkady

Robotics Middleware: A Comprehensive Literature Survey and Attribute-Based Bibliography

Autonomous robots are complex systems that require the interaction between numerous heterogeneous components (software and hardware). Because of the increase in complexity of robotic applications and the diverse range of hardware, robotic middleware is designed to manage the complexity and heterogeneity of the hardware and applications, promote the integration of new technologies, simplify software design, hide the complexity of low-level communication and the sensor heterogeneity of the sensors, improve software quality, reuse robotic software infrastructure across multiple research efforts, and to reduce production costs. This paper presents a literature survey and attribute-based bibliography of the current state of the art in robotic middleware design. The main aim of the survey is to assist robotic middleware researchers in evaluating the strengths and weaknesses of current approaches and their appropriateness for their applications. Furthermore, we provide a comprehensive set of appropriate bibliographic references that are classified based on middleware attributes.

A PLUG AND PLAY MIDDLEWARE FOR SENSORY MODULES, ACTUATION PLATFORMS AND TASK DESCRIPTIONS IN ROBOTIC MANIPULATION PLATFORMS

We are developing a framework (RISCWare) for the modular design and integration of sensory modules, actuation platforms, and task descriptions that will be implemented as a tool to reduce efforts in designing and utilizing robotic platforms. The framework is used to customize robotic platforms by simply defining the available sensing devices, actuation platforms, and required tasks. The main purpose for designing this framework is to reduce the time and complexity of the development of robotic software and maintenance costs, and to improve code and component reusability. Usage of the proposed framework prevents the need to redesign or rewrite algorithms or applications due to changes in the robot’s platform, operating systems, or the introduction of new functionalities. In this paper, the RISCWare framework is developed and described. RISCWare is a robotic middleware used for the integration of heterogeneous robotic components. RISCWare consists of three modules. The first module is the sensory module, which represents sensors that collect information about the remote or local environment. The platform module defines the robotic platforms and actuation methods. The last module is the task-description module, which defines the tasks and applications that the platforms will perform such as teleoperation, navigation, obstacle avoidance, manipulation, 3-D reconstruction, and map building. The plug-and-play approach is one of the key features of RISCWare, which allows auto-detection and auto-reconfiguration of the attached standardized components (hardware and software) according to current system configurations. These components can be dynamically available or unavailable. Dynamic reconfiguration provides the facility to modify a system during its execution and can be used to apply patches and updates, to implement adaptive systems, or to support third-party modules. This automatic detection and reconfiguration of devices and driver software makes it easier and more efficient for end users to add and use new devices and software applications. In addition, the software components should be written in a flexible way to get better usage of the hardware resource and also they should be easy to install/uninstall. Several experiments, performed on the RISCbot II mobile manipulation platform, are described and implemented to evaluate the RISCWare framework with respect to applicability and resource utilization.Copyright

Modular Design and Implementation for a Sensory-Driven Mobile Manipulation Framework

A mobile manipulator is a manipulator mounted on a mobile platform with no support from the ground. We are already in the process of building a platform (RISCbot II) which consists of a comprehensive sensor suite and significant end-effector capabilities for manipulation. In order to reduce the uncertainty in localization, sensor fusion is used to create an efficient and effective user interface to facilitate teleoperation by enhancing the quality of information that is provided to the teleoperator. We are developing a framework for a modular design of sensory modules, actuation platforms, and task descriptions that will be implemented as a tool to reduce and streamline efforts in designing robotic platforms. The framework is comprised of three modules. The first module encapsulates the sensors which gather information about the remote, or local, environment. The second module defines the platforms and actuation methods. The last module describes the tasks that the platforms will perform such as teleoperation, navigation, obstacle avoidance, manipulation, 3-D reconstruction, and map building. This paper presents the modular design process of the RISCbot II mobile manipulator. In the design process, the overall design of the system is discussed and then the control process of the robot is presented. Furthermore, the tasks that the RISCbot II can perform such as teleoperation, navigation, obstacle avoidance, manipulation, and face detection and recognition are described.

A Structured Approach for Modular Design in Robotics and Automation Environments

In this paper, the RISCWare framework is proposed as a robotic middleware for the modular design of sensory modules, actuation platforms, and task descriptions. This framework will be used to customize robotic platforms by simply defining the available sensing devices, actuation platforms and required tasks. In addition, this framework will significantly increase the capability of robotic industries in the analysis, design, and development of autonomous mobile platforms. RISCWare is comprised of three modules. The first module encapsulates the sensors, which gather information about the remote or local environment. The second module defines the platforms, manipulators, and actuation methods. The last module describes the tasks that the robotic platforms will perform such as teleoperation, navigation, obstacle avoidance, manipulation, 3-D reconstruction, and map building. The objective is to design a middleware framework to allow a user to plug in new sensors, tasks or actuation hardware, resulting in a fully functional operational system. Furthermore, the user is able to install and uninstall hardware/software components through system lifetime with ease and modularity. In addition, when hardware devices are plugged into the framework, they are automatically detected by the middleware layer, which loads the appropriate software and avails the device for applications usage. This automatic detection and configuration of devices make it efficient and seamless for end users to add and use new devices and software applications. Several experiments, performed on the RISCbot II mobile robot, are implemented to evaluate the RISCWare framework with respect to applicability and resource utilization.

A New Algorithm for Measuring and Optimizing the Manipulability Index

The estimation of the performance characteristics of robot manipulators is crucial in robot application and design. Furthermore, studying the manipulability index for every point within the workspace of any serial manipulator is considered an important problem. Such studies are required for designing trajectories to avoid singular configurations. In this article, a new method for measuring the manipulability index is proposed, and then some simulations are performed on different industrial manipulators such as the Puma 560 manipulator, a six DOF manipulator and the Mitsubishi Movemaster manipulator.

New Concept in Optimizing Manipulability Index of Serial Manipulators, Using SVD Method

Studying the Manipulability index for every point within the workspace of any serial manipulator is considered one of the important problems, required for designing trajectories or avoiding singular configurations. We had to go through this problem for our project of optimizing D-H parameters of extending for Mitsubishi which is existed at our lab. First step is to get all points within the workspace envelope with different manipulability bands and to find most the high band to start forward kinematic design and optimization of additional s parameters.

Design and Implementation of a Multi-sensor Mobile Platform

In the last several years, mobile manipulators have been increasingly utilized and developed from a theoretical viewpoint as well as for practical applications in space, underwater, construction, and service environments. Our mobile manipulator RISCbot, is comprised of a manipulator arm mounted on a motorized mobile base wheelchair. The work presented in this chapter explores the use of multi-sensor for combining measurements from ultrasonic and infrared sensors for mobile manipulator navigation and obstacle avoidance. Furthermore, we deal with the problem of controlling of a mobile manipulator via sensor fusion in order to reduce the uncertainty in localization and obstacle avoidance. Sensor fusion is used by combining and integrating data gathered from sensory information provided by ultrasonic and infrared sensors to enhance the quality of information provided to RISCbot.

Cartesian Parallel Manipulator Modeling, Control and Simulation

Parallel manipulators are robotic devices that differ from the more traditional serial robotic manipulators by their kinematic structure. Parallel manipulators are composed of multiple closed kinematic loops. Typically, these kinematic loops are formed by two or more kinematic chains that connect a moving platform to a base, where one joint in the chain is actuated and the other joints are passive. This kinematic structure allows parallel manipulators to be driven by actuators positioned on or near the base of the manipulator. In contrast, serial manipulators do not have closed kinematic loops and are usually actuated at each joint along the serial linkage. Accordingly, the actuators that are located at each joint along the serial linkage can account for a significant portion of the loading experienced by the manipulator, whereas the links of a parallel manipulator generally need not carry the load of the actuators. This allows the parallel manipulator links to be made lighter than the links of an analogous serial manipulator. The most noticeable interesting features of parallel mechanisms being: • High payload capacity. • High throughput movements (high accelerations). • High mechanical rigidity. • Low moving mass. • Simple mechanical construction. • Actuators can be located on the base. However, the most noticeable disadvantages being: • They have smaller workspaces than serial manipulators of similar size. • Singularities within working volume. • High coupling between the moving kinematic chains.

Modular Design: A Plug and Play Approach to Sensory Modules, Actuation Platforms, and Task Descriptions for Robotics and Automation Applications

In this paper, the RISCWare framework is proposed as a robotic middleware for the modular design of sensory modules, actuation platforms, and task descriptions. This framework will be used to customize robotic platforms by simply defining the available sensing devices, actuation platforms and required tasks. In addition, this framework will significantly increase the capability of robotic industries in the analysis, design, and development of autonomous mobile platforms. RISCWare is comprised of three modules. The first module encapsulates the sensors, which gather information about the remote or local environment. The second module defines the platforms, manipulators, and actuation methods. The last module describes the tasks that the robotic platforms will perform such as teleoperation, navigation, obstacle avoidance, manipulation, 3-D reconstruction, and map building. The objective is to design a middleware framework to allow a user to plug in new sensors, tasks or actuation hardware, resulting in a fully functional operational system. Furthermore, the user is able to install and uninstall hardware/software components through system lifetime with ease and modularity. In addition, when hardware devices are plugged into the framework, they are automatically detected by the middleware layer, which loads the appropriate software and avails the device for applications usage. This automatic detection and configuration of devices make it efficient and seamless for end users to add and use new devices and software applications. Several experiments, performed on the RISCbot II mobile robot, are implemented to evaluate the RISCWare framework with respect to applicability and resource utilization.

Modular Design and Structure for a Mobile Sensory Platform

A mobile manipulator is a manipulator mounted on a mobile platform with no support from the ground. We are already in the process of building a platform (RISCbot II) which consists of a comprehensive sensor suite and significant end-effector capabilities for manipulation. In order to reduce the uncertainty in localization, sensor fusion is used to create an efficient and effective user interface to facilitate teleoperation by enhancing the quality of information that is provided to the teleoperator.