Emanuele Trucco

Efficient stereo with multiple windowing

We present a new, efficient stereo algorithm addressing robust disparity estimation in the presence of occlusions. The algorithm is an adaptive, multi-window scheme using left-right consistency to compute disparity and its associated uncertainty. We demonstrate and discuss performances with both synthetic and real stereo pairs, and show how our results improve on those of closely related techniques for both robustness and efficiency.

Robust motion and correspondence of noisy 3-D point sets with missing data

Abstract We describe RICP, a robust algorithm for registering and finding correspondences in sets of 3-D points with significant percentages of missing data, and therefore useful for both motion analysis and reverse engineering. RICP exploits LMedS robust estimation to withstand the effect of outliers. Our extensive experimental comparison of RICP with ICP shows RICPs superior robustness and reliability.

Making good features track better

This paper addresses robust feature tracking. We extend the well-known Shi-Tomasi-Kanade tracker by introducing an automatic scheme for rejecting spurious features. We employ a simple and efficient outlier rejection rule, called X84, and prove that its theoretical assumptions are satisfied in the feature tracking scenario. Experiments with real and synthetic images confirm that our algorithm makes good features track better; we show a quantitative example of the benefits introduced by the algorithm for the case of fundamental matrix estimation. The complete code of the robust tracker is available via ftp.

Video Tracking: A Concise Survey

This paper addresses video tracking, the problem of following moving targets automatically over a video sequence, and brings three main contributions. First, we give a concise introduction to video tracking in computer vision, including design requirements and a review of recent techniques, with some details of selected algorithms. Second, we give an overview of 28 recent papers on subsea video tracking and related motion analysis problems, arguably capturing the state-of-the-art of subsea video tracking. We summarize key features in a comparative, at-a-glance table, and discuss this work in comparison to the state-of-the-art in computer vision. Third, we identify well-proven computer vision techniques not yet embraced by the subsea research community, suggesting useful research directions for the subsea video processing community

Experiments in curvature-based segmentation of range data

This paper focuses on the experimental evaluation of a range image segmentation system which partitions range data into homogeneous surface patches using estimates of the sign of the mean and Gaussian curvatures. The authors report the results of an extensive testing program aimed at investigating the behavior of important experimental parameters such as the probability of correct classification and the accuracy of curvature estimates, measured over variations of significant segmentation variables. Evaluation methods in computer vision are often unstructured and subjective: this paper contributes a useful example of extensive experimental assessment of surface-based range segmentation. >

Improving Feature Tracking with Robust Statistics

Abstract: This paper addresses robust feature tracking. The aim is to track point features in a sequence of images and to identify unreliable features resulting from occlusions, perspective distortions and strong intensity changes. We extend the well-known Shi–Tomasi–Kanade tracker by introducing an automatic scheme for rejecting spurious features. We employ a simple and efficient outliers rejection rule, called X84, and prove that its theoretical assumptions are satisfied in the feature tracking scenario. Experiments with real and synthetic images confirm that our algorithm consistently discards unreliable features; we show a quantitative example of the benefits introduced by the algorithm for the case of fundamental matrix estimation. The complete code of the robust tracker is available via ftp.

Three-dimensional image processing in the future of immersive media

This survey paper discusses the three-dimensional image processing challenges posed by present and future immersive telecommunications, especially immersive video conferencing and television. We introduce the concepts of presence, immersion, and co-presence and discuss their relation to virtual collaborative environments in the context of communications. Several examples are used to illustrate the current state of the art. We highlight the crucial need of real-time, highly realistic video with adaptive viewpoint for future immersive communications and identify calibration, multiple-view analysis, tracking, and view synthesis as the fundamental image-processing modules addressing such a need. For each topic, we sketch the basic problem and representative solutions from the image processing literature.

Symmetric stereo with multiple windowing

We present a new, efficient stereo algorithm addressing robust disparity estimation in the presence of occlusions. The algorithm is an adaptive, multiwindow scheme using left–right consistency to compute disparity and its associated uncertainty. We demonstrate and discuss performances with both synthetic and real stereo pairs, and show how our results improve on those of closely related techniques for both accuracy and efficiency.

Model-based planning of optimal sensor placements for inspection

We report a system for sensor planning, GASP, which is used to compute the optimal positions for inspection tasks using known imaging sensors and feature-based object models. GASP (general automatic sensor planning) uses a feature inspection representation (the FIR), which contains the explicit solution for the simplest sensor positioning problem. The FIR is generated off-line, and is exploited by GASP to compute on-line plans for more complex tasks, called inspection scripts. Viewpoint optimality is defined as a function of feature visibility and measurement reliability. Visibility is computed using an approximate model. Reliability of inspection depends on both the physical sensors acquiring the images and on the processing software; therefore we include both these components in a generalized sensor model. These predictions are based on experimental, quantitative assessment. We show how these are computed for a real generalized sensor, which includes a 3-D range imaging system, and software performing robust outlier removal, surface segmentation, object location and surface fitting. Finally, we demonstrate a complete inspection session involving 3-D object positioning, planning optimal position inspection, and feature measurement from the optimal viewpoint.

Markerless human articulated tracking using hierarchical particle swarm optimisation

In this paper, we address markerless full-body articulated human motion tracking from multi-view video sequences acquired in a studio environment. The tracking is formulated as a multi-dimensional non-linear optimisation and solved using particle swarm optimisation (PSO), a swarm-intelligence algorithm which has gained popularity in recent years due to its ability to solve difficult non-linear optimisation problems. We show that a small number of particles achieves accuracy levels comparable with several recent algorithms. PSO initialises automatically, does not need a sequence-specific motion model and recovers from temporary tracking divergence through the use of a powerful hierarchical search algorithm (HPSO). We compare experimentally HPSO with particle filter (PF), annealed particle filter (APF) and partitioned sampling annealed particle filter (PSAPF) using the computational framework provided by Balan et al. HPSO accuracy and consistency are better than PF and compare favourably with those of APF and PSAPF, outperforming it in sequences with sudden and fast motion. We also report an extensive experimental study of HPSO over ranges of values of its parameters.