Florian Faion

Intelligent sensor-scheduling for multi-kinect-tracking

This paper describes a method to intelligently schedule a network of multiple RGBD sensors in a Bayesian object tracking scenario, with special focus on Microsoft KinectTM devices. These setups have issues such as the large amount of raw data generated by the sensors and interference caused by overlapping fields of view. The proposed algorithm addresses these issues by selecting and exclusively activating the sensor that yields the best measurement, as defined by a novel stochastic model that also considers hardware constraints and intrinsic parameters. In addition, as existing solutions to toggle the sensors were found to be insufficient, the development of a hardware module, especially designed for quick toggling and synchronization with the depth stream, is also discussed. The algorithm then is evaluated within the scope of a multi-Kinect object tracking scenario and compared to other scheduling strategies.

Constrained object tracking on compact one-dimensional manifolds based on directional statistics

In this paper, we present a novel approach for tracking objects whose movement is constrained to a compact one-dimensional manifold, for example a conveyer belt or a mobile robot whose movement is restricted to tracks. Standard approaches either ignore the constraint at first and retroactively move the estimate to lie on the manifold, or consider the tracking problem on a manifold but falsely assume a Gaussian distribution. Our method explicitly takes the actual topology into account from the beginning and relies on special types of probability distributions defined on the proper manifold. In particular, we consider objects moving along a closed one-dimensional track, for example an ellipse, a polygon, or similar closed shapes. This shape is transformed to a circle with a homeomorphism. Thus, we can apply a recursive circular filtering algorithm to the constrained tracking problem. Finally, the estimate is transformed back to the original manifold. We evaluate the proposed method in an experiment by tracking a toy train moving along a track and comparing the results to those of traditional approaches for this problem.

Tracking ground moving extended objects using RGBD data

This paper is about an experimental set-up for tracking a ground moving mobile object from a birds eye view. In this experiment, an RGB and depth camera is used for detecting moving points. The detected points serve as input for a probabilistic extended object tracking algorithm that simultaneously estimates the kinematic parameters and the shape parameters of the object. By this means, it is easy to discriminate moving objects from the background and the probabilistic tracking algorithm ensures a robust and smooth shape estimate. We provide an experimental evaluation of a recent Bayesian extended object tracking algorithm based on a so-called Random Hypersurface Model and give a comparison with active contour models.

Bayesian estimation of line segments

A popular approach when tracking extended objects with elongated shapes, such as ships or airplanes, is to approximate them as a line segment. Despite its simple shape, the distribution of measurement sources on a line segment can be characterized in many radically different ways. The spectrum ranges from Spatial Distribution Models that assume a distinct probability for each individual source, to Greedy Association Models as used in curve fitting, which do not assume any distribution at all. In between these border cases, Random Hypersurface Models assume a distribution over subsets of all sources. In this paper, we compare Bayesian estimators based on these different models. We point out their advantages and disadvantages and evaluate their performance by means of illustrative examples with synthetic and real data using a Linear Regression Kalman Filter.

Real-time whole-body human motion tracking based on unlabeled markers

In this paper, we present a novel online approach for tracking whole-body human motion based on unlabeled measurements of markers attached to the body. For that purpose, we employ a given kinematic model of the human body including the locations of the attached markers. Based on the model, we apply a combination of constrained sample-based Kalman filtering and multi-target tracking techniques: 1) joint constraints imposed by the human body are satisfied by introducing a parameter transformation based on periodic functions, 2) a global nearest neighbor (GNN) algorithm computes the most likely one-to-one association between markers and measurements, and 3) multiple hypotheses tracking (MHT) allows for a robust initialization that only requires an upright standing user. Evaluations clearly demonstrate that the proposed tracking provides highly accurate pose estimates in realtime, even for fast and complex motions. In addition, it provides robustness to partial occlusion of markers and also handles unavoidable clutter measurements.

Recursive Bayesian pose and shape estimation of 3D objects using transformed plane curves

We consider the task of recursively estimating the pose and shape parameters of 3D objects based on noisy point cloud measurements from their surface. We focus on objects whose surface can be constructed by transforming a plane curve, such as a cylinder that is constructed by extruding a circle. However, designing estimators for such objects is challenging, as the straightforward distance-minimizing approach cannot observe all parameters, and additionally is subject to bias in the presence of noise. In this article, we first discuss these issues and then develop probabilistic models for cylinder, torus, cone, and an extruded curve by adapting related approaches including Random Hypersurface Models, partial likelihood, and symmetric shape models. In experiments with simulated data, we show that these models yield unbiased estimators for all parameters even in the presence of high noise.

A closed-form likelihood for Particle Filters to track extended objects with star-convex RHMs

Modeling 2D extended targets with star-convex Random Hypersurface Models (RHMs) allows for accurate object pose and shape estimation. A star-convex RHM models the shape of an object with the aid of a radial function that describes the distance from the object center to any point on its boundary. However, up to now only linear estimators, i.e., Kalman Filters, are used due to the lack of a explicit likelihood function. In this paper, we propose a closed-form and easy to implement likelihood function for tracking extended targets with star-convex RHMs. This makes it possible to apply nonlinear estimators such as Particle Filters to estimate a detailed shape of a target.We compared the proposed likelihood against the usual Kalman filter approaches with tracking pose and shape of an airplane in 2D. The evaluations showed that the combination of the Progressive Gaussian Filter (PGF) and the new likelihood function delivers the best estimation performance and can outperform the usually employed Kalman Filters.

Depth sensor calibration by tracking an extended object

In this paper, we propose a novel algorithm for automatically calibrating a network of depth sensors, based on a moving calibration object. The sensors may have non-overlapping fields of view in order to avoid interference. Two major challenges are discussed. First, depending on where the object is located relative to the sensor, the number and quality of the measurements strongly varies. Second, a single depth sensor observes the calibration object only from one side. Dealing with these challenges requires a simple calibration object as well as an algorithm that can deal with under-determined measurements of varying quality. A recursive Bayesian estimator is developed that determines the extrinsic parameters by measuring the surface of a moving cube with known pose. Our approach does not restrict the configuration of the network and requires no manual initialization or interaction. Ambiguities that are induced by the rotational cube symmetries are resolved by applying a multiple model approach. Besides synthetic evaluation we perform real data experiments and compare to state-of-the-art calibration.

Exploiting negative measurements for tracking star-convex extended objects

In this paper, we propose a novel approach to track extended objects by incorporating negative information. While traditional techniques to track extended targets use only positive measurements, assumed to stem from the target, the proposed estimator is also capable of incorporating negative measurements, which tell us where the target cannot be. To achieve this, we introduce a simple, robust, and easy-to-implement recursive Bayesian estimator which employs ideas from the field of curve fitting. As an application of this idea, we develop a measurement equation to estimate star-convex shapes which can be used in standard non-linear Kalman filters. Finally, we evaluate the proposed estimator using synthetic data and demonstrate its robustness in scenarios with clutter and low measurement quality.

Level-set random hypersurface models for tracking nonconvex extended objects

This paper presents a novel approach to track a non-convex shape approximation of an extended target based on noisy point measurements. For this purpose, a novel type of Random Hypersurface Model (RHM), called Level-Set RHM is introduced that models the interior of a shape with level-sets of an implicit function. Based on the Level-Set RHM, a nonlinear measurement equation can be derived that allows to employ a standard Gaussian state estimator for tracking an extended object even in scenarios with high measurement noise. In this paper, shapes are described using polygons and shape regularization is applied using ideas from active contour models.