Leonidas Spinoulas

Compressive Blind Image Deconvolution

We propose a novel blind image deconvolution (BID) regularization framework for compressive sensing (CS) based imaging systems capturing blurred images. The proposed framework relies on a constrained optimization technique, which is solved by a sequence of unconstrained sub-problems, and allows the incorporation of existing CS reconstruction algorithms in compressive BID problems. As an example, a non-convex lp quasi-norm with 0 <; p <; 1 is employed as a regularization term for the image, while a simultaneous auto-regressive regularization term is selected for the blur. Nevertheless, the proposed approach is very general and it can be easily adapted to other state-of-the-art BID schemes that utilize different, application specific, image/blur regularization terms. Experimental results, obtained with simulations using blurred synthetic images and real passive millimeter-wave images, show the feasibility of the proposed method and its advantages over existing approaches.

Passive millimeter-wave imaging with compressive sensing

Abstract. Passive millimeter-wave (PMMW) imagers using a single radiometer, called single pixel imagers, employ raster scanning to produce images. A serious drawback of such a single pixel imaging system is the long acquisition time needed to produce a high-fidelity image, arising from two factors: (a) the time to scan the whole scene pixel by pixel and (b) the integration time for each pixel to achieve adequate signal to noise ratio. Recently, compressive sensing (CS) has been developed for single-pixel optical cameras to significantly reduce the imaging time and at the same time produce high-fidelity images by exploiting the sparsity of the data in some transform domain. While the efficacy of CS has been established for single-pixel optical systems, its application to PMMW imaging is not straightforward due to its (a) longer wavelength by three to four orders of magnitude that suffers high diffraction losses at finite size spatial waveform modulators and (b) weaker radiation intensity, for example, by eight orders of magnitude less than that of infrared. We present the development and implementation of a CS technique for PMMW imagers and shows a factor-of-ten increase in imaging speed.

Compressive passive millimeter-wave imaging

In this paper, we present a novel passive millimeter-wave (PMMW) imaging system designed using compressive sensing principles. We employ randomly encoded masks at the focal plane of the PMMW imager to acquire incoherent measurements of the imaged scene. We develop a Bayesian reconstruction algorithm to estimate the original image from these measurements, where the sparsity inherent to typical PMMW images is efficiently exploited. Comparisons with other existing reconstruction methods show that the proposed reconstruction algorithm provides higher quality image estimates. Finally, we demonstrate with simulations using real PMMW images that the imaging duration can be dramatically reduced by acquiring only a few measurements compared to the size of the image.

High spatio-temporal resolution video with compressed sensing.

We present a prototype compressive video camera that encodes scene movement using a translated binary photomask in the optical path. The encoded recording can then be used to reconstruct multiple output frames from each captured image, effectively synthesizing high speed video. The use of a printed binary mask allows reconstruction at higher spatial resolutions than has been previously demonstrated. In addition, we improve upon previous work by investigating tradeoffs in mask design and reconstruction algorithm selection. We identify a mask design that consistently provides the best performance across multiple reconstruction strategies in simulation, and verify it with our prototype hardware. Finally, we compare reconstruction algorithms and identify the best choice in terms of balancing reconstruction quality and speed.

Deep fully-connected networks for video compressive sensing

In this work we present a deep learning framework for video compressive sensing. The proposed formulation enables recovery of video frames in a few seconds at significantly improved reconstruction quality compared to previous approaches. Our investigation starts by learning a linear mapping between video sequences and corresponding measured frames which turns out to provide promising results. We then extend the linear formulation to deep fully-connected networks and explore the performance gains using deeper architectures. Our analysis is always driven by the applicability of the proposed framework on existing compressive video architectures. Extensive simulations on several video sequences document the superiority of our approach both quantitatively and qualitatively. Finally, our analysis offers insights into understanding how dataset sizes and number of layers affect reconstruction performance while raising a few points for future investigation. Code is available at Github: this https URL

Optimized compressive sampling for passive millimeter-wave imaging

In this paper, we briefly describe a single detector passive millimeter-wave imaging system, which has been previously presented. The system uses a cyclic sensing matrix to acquire incoherent measurements of the observed scene and then reconstructs the image using a Bayesian approach. The cyclic nature of the sensing matrix allows for the design of a single unified and compact mask that provides all the required random masks in a convenient way, such that no mechanical mask exchange is needed. Based on this setup, we primarily propose the optimal adaptive selection of sampling submasks out of the full cyclic mask to obtain improved reconstruction results. The reconstructed images show the feasibility of the imaging system as well as its improved performance through the proposed sampling scheme.

Compressive holographic video

Compressed sensing has been discussed separately in spatial and temporal domains. Compressive holography has been introduced as a method that allows 3D tomographic reconstruction at different depths from a single 2D image. Coded exposure is a temporal compressed sensing method for high speed video acquisition. In this work, we combine compressive holography and coded exposure techniques and extend the discussion to 4D reconstruction in space and time from one coded captured image. In our prototype, digital in-line holography was used for imaging macroscopic, fast moving objects. The pixel-wise temporal modulation was implemented by a digital micromirror device. In this paper we demonstrate 10× temporal super resolution with multiple depths recovery from a single image. Two examples are presented for the purpose of recording subtle vibrations and tracking small particles within 5 ms.

Compressive sampling with unknown blurring function: Application to passive millimeter-wave imaging

We propose a novel blind image deconvolution (BID) regularization framework for compressive passive millimeter-wave (PMMW) imaging systems. The proposed framework is based on the variable-splitting optimization technique, which allows us to utilize existing compressive sensing reconstruction algorithms in compressive BID problems. In addition, a non-convex lp quasi-norm with 0 <; p <; 1 is employed as a regularization term for the image, while a simultaneous auto-regressive (SAR) regularization term is utilized for the blur. Furthermore, the proposed framework is very general and it can be easily adapted to other state-of-the-art BID approaches that utilize different image/blur regularization terms. Experimental results, obtained with simulations using a synthetic image and real PMMW images, show the advantage of the proposed approach compared to existing ones.

Video compressive sensing with on-chip programmable subsampling

The maximum achievable frame-rate for a video camera is limited by the sensors pixel readout rate. The same sensor may achieve either a slow frame-rate at full resolution (e.g., 60 fps at 4 Mpixel resolution) or a fast frame-rate at low resolution (e.g., 240 fps at 1 Mpixel resolution). Higher frame-rates are achieved using pixel readout modes (e.g., subsampling or binning) that sacrifice spatial for temporal resolution within a fixed bandwidth. A number of compressive video cameras have been introduced to overcome this fixed bandwidth constraint and achieve high frame-rates without sacrificing spatial resolution. These methods use electro-optic components (e.g., LCoS, DLPs, piezo actuators) to introduce high speed spatio-temporal multiplexing in captured images. Full resolution, high speed video is then restored by solving an undetermined system of equations using a sparse regularization framework. In this work, we introduce the first all-digital temporal compressive video camera that uses custom subsampling modes to achieve spatio-temporal multiplexing. Unlike previous compressive video cameras, ours requires no additional optical components, enabling it to be implemented in a compact package such as a mobile camera module. We demonstrate results using a TrueSense development kit with a 12 Mpixel sensor and programmable FPGA read out circuitry.

Video compressive sensing using multiple measurement vectors

Compressive Sensing (CS) suggests that, under certain conditions, a signal can be reconstructed using a small number of incoherent measurements. We propose a novel video CS framework based on Multiple Measurement Vectors (MMV) which is suitable for signals with temporal correlation such as video sequences. In addition, a CS circulant matrix is employed for fast reconstruction. Furthermore, the proposed framework allows the number of CS measurements associated with each frame to be chosen in the decoder rather than the encoder offering robustness compared to the multi-scale approaches. Experimental results on two video sequences exhibiting fast motion and occlusions, show the advantages of the proposed method over the current state-of-the-art in video CS.