Christoph Pieper

Fast multitarget tracking via strategy switching for sensor-based sorting

State-of-the-art sensor-based sorting systems provide solutions to sort various products according to quality aspects. Such systems face the challenge of an existing delay between perception and separation of the material. To reliably predict an objects position when reaching the separation stage, information regarding its movement needs to be derived. Multitarget tracking offers approaches through which this can be achieved. However, processing time is typically limited since the sorting decision for each object needs to be derived sufficiently early before it reaches the separation stage. In this paper, an approach for multitarget tracking in sensor-based sorting is proposed which supports establishing an upper bound regarding processing time required for solving the measurement to track association problem. To demonstrate the success of the proposed method, experiments are conducted for data-sets obtained via simulation of a sorting system. This way, it is possible to not only demonstrate the impact on required runtime but also on the quality of the association.

Simulation-based evaluation of predictive tracking for sorting bulk materials

Multitarget tracking problems arise in many real-world applications. The performance of the utilized algorithm strongly depends both on how the data association problem is handled and on the suitability of the motion models employed. Especially the motion models can be hard to validate. Previously, we have proposed to use multitarget tracking to improve optical belt sorters. In this paper, we evaluate both the suitability of our model and the tracking and then of our entire system incorporating the image processing component via the use of highly realistic numerical simulations. We first assess the model using noise-free measurements generated by the simulation and then evaluate the entire system by using synthetically generated image data.

Real-time multitarget tracking for sensor-based sorting

Utilizing parallel algorithms is an established way of increasing performance in systems that are bound to real-time restrictions. Sensor-based sorting is a machine vision application for which firm real-time requirements need to be respected in order to reliably remove potentially harmful entities from a material feed. Recently, employing a predictive tracking approach using multitarget tracking in order to decrease the error in the physical separation in optical sorting has been proposed. For implementations that use hard associations between measurements and tracks, a linear assignment problem has to be solved for each frame recorded by a camera. The auction algorithm can be utilized for this purpose, which also has the advantage of being well suited for parallel architectures. In this paper, an improved implementation of this algorithm for a graphics processing unit (GPU) is presented. The resulting algorithm is implemented in both an OpenCL and a CUDA based environment. By using an optimized data structure, the presented algorithm outperforms recently proposed implementations in terms of speed while retaining the quality of output of the algorithm. Furthermore, memory requirements are significantly decreased, which is important for embedded systems. Experimental results are provided for two different GPUs and six datasets. It is shown that the proposed approach is of particular interest for applications dealing with comparatively large problem sizes.

Improving multitarget tracking using orientation estimates for sorting bulk materials

Optical belt sorters can be used to sort a large variety of bulk materials. By the use of sophisticated algorithms, the performance of the complex machinery can be further improved. Recently, we have proposed an extension to industrial optical belt sorters that involves tracking the individual particles on the belt using an area scan camera. If the estimated behavior of the particles matches the true behavior, the reliability of the separation process can be improved. The approach relies on multitarget tracking using hard association decisions between the tracks and the measurements. In this paper, we propose to include the orientation in the assessment of the compatibility of a track and a measurement. This allows us to achieve more reliable associations, facilitating a higher accuracy of the tracking results.

Motion-based material characterization in sensor-based sorting

Abstract Sensor-based sorting provides state-of-the-art solutions for sorting cohesive, granular materials. Typically, involved sensors, illumination, implementation of data analysis and other components are designed and chosen according to the sorting task at hand. A common property of conventional systems is the utilization of scanning sensors. However, the usage of area-scan cameras has recently been proposed. When observing objects at multiple time points, the corresponding paths can be reconstructed by using multiobject tracking. This in turn allows to accurately estimate the point in time and position at which any object will reach the separation stage of the optical sorter and hence contributes to decreasing the error in physical separation. In this paper, it is proposed to further exploit motion information for the purpose of material characterization. By deriving suitable features from the motion information, we show that high classification performance is obtained for an exemplary classification task. The approach therefore contributes towards decreasing the detection error of sorting systems.

Numerical Investigation of Optical Sorting Using the Discrete Element Method

Automated optical sorting systems are important devices in the growing field of bulk solids handling. The initial sorter calibration and the precise optical sorting of many materials is still very time consuming and difficult. A numerical model of an automated optical belt sorter is presented in this study. The sorter and particle interaction is described with the Discrete Element Method (DEM) while the separation phase is considered in a post processing step. Different operating parameters and their influence on sorting quality are investigated. In addition, two models for detecting and predicting the particle movement between the detection point and the separation step are presented and compared, namely a conventional line scan camera model and a new approach combining an area scan camera model with particle tracking.