Shahram Shirani

Optimal mode selection and synchronization for robust video communications over error-prone networks

We describe an effective method for increasing error resilience of video transmission over bit error prone networks. Rate-distortion optimized mode selection and synchronization marker insertion algorithms are introduced. The resulting video communication system takes into account the channel condition and the error concealment method used by the decoder, to optimize video coding mode selection and placement of synchronization markers in the compressed bit stream. The effects of mismatch between the parameters used by the encoder and the parameters associated with the actual channel condition and the decoder error concealment method are evaluated. Results for the binary symmetric channel and wideband code division multiple access mobile network models are presented in order to illustrate the advantages of the proposed method.

Fully Integrated Single Photon Avalanche Diode Detector in Standard CMOS 0.18-

Avalanche photodiodes (APDs) operating in Geiger mode can detect weak optical signals at high speed. The implementation of APD systems in a CMOS technology makes it possible to integrate the photodetector and its peripheral circuits on the same chip. In this paper, we have fabricated APDs of different sizes and their driving circuits in a commercial 0.18-mum CMOS technology. The APDs are theoretically analyzed, measured, and the results are interpreted. Excellent breakdown performance is measured for the 10 and 20 m APDs at 10.2 V. The APD system is compared to the previous implementations in standard CMOS. Our APD has a 5.5% peak probability of detection of a photon at an excess bias of 2 V, and a 30 ns dead time, which is better than the previously reported results.

\mu

An analysis of the active pixel sensor (APS), considering the doping profiles of the photodiode in an APS fabricated in a 0.18 mum standard CMOS technology, is presented. A simple and accurate model for the junction capacitance of the photodiode is proposed. An analytic expression for the output voltage of the APS obtained with this capacitance model is in good agreement with measurements and is more accurate than the models used previously. A different mode of operation for the APS based on the dc level of the output is suggested. This new mode has better low-light-level sensitivity than the conventional APS operating mode, and it has a slower temporal response to the change of the incident light power. At 1 muW/cm2 and lower levels of light, the measured signal-to-noise ratio (SNR) of this new mode is more than 10 dB higher than the SNR of previously reported APS circuits. Also, with an output SNR of about 10 dB, the proposed dc level is capable of detecting light powers as low as 20 nW/cm2, which is about 30 times lower than the light power detected in recent reports by other groups.

m Technology

In this paper, we propose a two-stage error-concealment method for block-based compressed video which was transmitted in an error-prone environment. In the first stage, we obtain initial estimates of the missing blocks. If the motion vectors associated with the missing blocks are available, motion compensation is used to provide good estimates. Otherwise, a novel algorithm which preserves image continuity is used to estimate the blocks. In the second stage, a maximum a posteriori (MAP) estimator, which employs an adaptive Markov random field (MRF) as the image a priori model is used to improve the video reconstruction quality. The adaptive model enables the estimation to incorporate information embedded not only in the immediate neighborhood pixels but also in a wider neighborhood into the reconstruction procedure without increasing the order of the MRF model. The proposed concealment method achieves very good computation-performance tradeoffs, as demonstrated via experimental results.

CMOS-Based Active Pixel for Low-Light-Level Detection: Analysis and Measurements

Multi-focus image fusion has emerged as a major topic in image processing to generate all-focus images with increased depth-of-field from multi-focus photographs. Different approaches have been used in spatial or transform domain for this purpose. But most of them are subject to one or more of image fusion quality degradations such as blocking artifacts, ringing effects, artificial edges, halo artifacts, contrast decrease, sharpness reduction, and misalignment of decision map with object boundaries. In this paper we present a novel multi-focus image fusion method in spatial domain that utilizes a dictionary which is learned from local patches of source images. Sparse representation of relative sharpness measure over this trained dictionary are pooled together to get the corresponding pooled features. Correlation of the pooled features with sparse representations of input images produces a pixel level score for decision map of fusion. Final regularized decision map is obtained using Markov Random Field (MRF) optimization. We also gathered a new color multi-focus image dataset which has more variety than traditional multi-focus image sets. Experimental results demonstrate that our proposed method outperforms existing state-of-the-art methods, in terms of visual and quantitative evaluations.

A concealment method for video communications in an error-prone environment

Population of old generation is growing in most countries. Many of these seniors are living alone at home. Falling is among the most dangerous events that often happen and may need immediate medical care. Automatic fall detection systems could help old people and patients to live independently. Vision-based systems have advantage over wearable devices. These visual systems extract some features from video sequences and classify fall and normal activities. These features usually depend on cameras view direction. Using several cameras to solve this problem increases the complexity of the final system. In this paper, we propose to use variations in silhouette area that are obtained from only one camera. We use a simple background separation method to find the silhouette. We show that the proposed feature is view invariant. Extracted feature is fed into a support vector machine for classification. Simulation of the proposed method using a publicly available dataset shows promising results.

Multi-focus image fusion using dictionary-based sparse representation

A new watermarking method using rotation-invariant Zernike moments is introduced. The watermark signal is embedded in the Zernike moments of the input image. The watermarked image does not show any quality degradation. Tests shows that this method is robust to additive noise, JPEG compression and rotation.

Automatic Monocular System for Human Fall Detection Based on Variations in Silhouette Area

In this paper, a two-stage method for the reconstruction of missing data in the transmission of baseline JPEG coded images in error prone environments is proposed. In the first stage, we estimate the values of the missing DC coefficients. As effects of errors in estimating the missing DC values will appear as a number of stripes across the image, a technique for removing such stripes is also developed. In the second stage, the data of missing blocks is reconstructed by exploiting the correlation between adjacent blocks. Simulation results intricate that our reconstruction method performs very well. The two key contributions of our method are that it does not assume nondifferential encoding of the DC coefficients, and that it performs well in the reconstruction of diagonal edges.

A robust multimedia watermarking technique using Zernike transform

In most solutions to state estimation problems, e.g., target tracking, it is generally assumed that the state transition and measurement models are known a priori. However, there are situations where the model parameters or the model structure itself are not known a priori or are known only partially. In these scenarios, standard estimation algorithms like the Kalman filter and the extended Kalman Filter (EKF), which assume perfect knowledge of the model parameters, are not accurate. In this paper, the nonlinear state estimation problem with possibly non-Gaussian process noise in the presence of a certain class of measurement model uncertainty is considered. It is shown that the problem can be considered as a special case of maximum-likelihood estimation with incomplete data. Thus, in this paper, we propose an EM-type algorithm that casts the problem in a joint state estimation and model parameter identification framework. The expectation (E) step is implemented by a particle filter that is initialized by a Monte Carlo Markov chain algorithm. Within this step, the posterior distribution of the states given the measurements, as well as the state vector itself, are estimated. Consequently, in the maximization (M) step, we approximate the nonlinear observation equation as a mixture of Gaussians (MoG) model. During the M-step, the MoG model is fit to the observed data by estimating a set of MoG parameters. The proposed procedure, called EM-PF (expectation-maximization particle filter) algorithm, is used to solve a highly nonlinear bearing-only tracking problem, where the model structure is assumed unknown a priori. It is shown that the algorithm is capable of modeling the observations and accurately tracking the state vector. In addition, the algorithm is also applied to the sensor registration problem in a multi-sensor fusion scenario. It is again shown that the algorithm is successful in accommodating an unknown nonlinear model for a target tracking scenario.

Reconstruction of baseline JPEG coded images in error prone environments

In all of the video coding standards like H.26X and MPEG-X, much of the compression comes from motion compensated prediction (MCP). Translational motion vectors (MVs) poorly model complex motion and thus coders using polynomial or affine MVs have been proposed in the past. In this paper, we demonstrate a novel affine predictor stage which can be easily incorporated into current codecs greatly increasing MCP quality. If used passively to generate the final prediction, gains of up to 0.7 and 1.6 dB were easily realized for ldquomobilerdquo and ldquoflower gardenrdquo video sequences, respectively. In addition, when the translational MVs are refined, gains of up to 0.98 and 1.88 dB for ldquomobilerdquo and ldquoflower gardenrdquo video sequences were respectively realized.