Alborz Feizi

Wide-field computational imaging of pathology slides using lens-free on-chip microscopy

Lens-free holographic microscopy provides wide-field images with 3D focus adjustment of pathology slides for high-throughput and cost-effective human disease diagnostics. Widescreen Pathology Imaging whole human tissues with a conventional light microscope can be cumbersome, requiring the user to stitch together 500+ individual small images to get a full view of the entire tissue. This microscopy and digitization process is largely confined to advanced laboratories in developing countries. Greenbaum et al. have developed a lens-free microscope based on low-cost holographic technology, which allows imaging of large fields of view—about 100 times greater than high-resolution conventional microscopes. The lens-free imaging uses a small chip, allows for 3D focusing through thick tissue samples, and can colorize the resulting images. With this device, the authors successfully imaged invasive human cancer cells, abnormal cells in Pap smears, and “sickled” cells in whole-blood smears, with spatial resolution and contrast sufficient for clinical diagnosis. In one demonstration, a pathologist was able to distinguish cancerous from benign human tissue using images from the lens-free microscope; the assessment matched conventional light microscopy in 74 of 75 images. With its wide field of view, high resolution, and speedy readout, this lens-free platform could benefit pathology laboratories in both developed and developing countries. Optical examination of microscale features in pathology slides is one of the gold standards to diagnose disease. However, the use of conventional light microscopes is partially limited owing to their relatively high cost, bulkiness of lens-based optics, small field of view (FOV), and requirements for lateral scanning and three-dimensional (3D) focus adjustment. We illustrate the performance of a computational lens-free, holographic on-chip microscope that uses the transport-of-intensity equation, multi-height iterative phase retrieval, and rotational field transformations to perform wide-FOV imaging of pathology samples with comparable image quality to a traditional transmission lens-based microscope. The holographically reconstructed image can be digitally focused at any depth within the object FOV (after image capture) without the need for mechanical focus adjustment and is also digitally corrected for artifacts arising from uncontrolled tilting and height variations between the sample and sensor planes. Using this lens-free on-chip microscope, we successfully imaged invasive carcinoma cells within human breast sections, Papanicolaou smears revealing a high-grade squamous intraepithelial lesion, and sickle cell anemia blood smears over a FOV of 20.5 mm2. The resulting wide-field lens-free images had sufficient image resolution and contrast for clinical evaluation, as demonstrated by a pathologist’s blinded diagnosis of breast cancer tissue samples, achieving an overall accuracy of ~99%. By providing high-resolution images of large-area pathology samples with 3D digital focus adjustment, lens-free on-chip microscopy can be useful in resource-limited and point-of-care settings.

Field-portable pixel super-resolution colour microscope.

Based on partially-coherent digital in-line holography, we report a field-portable microscope that can render lensfree colour images over a wide field-of-view of e.g., >20 mm2. This computational holographic microscope weighs less than 145 grams with dimensions smaller than 17×6×5 cm, making it especially suitable for field settings and point-of-care use. In this lensfree imaging design, we merged a colorization algorithm with a source shifting based multi-height pixel super-resolution technique to mitigate ‘rainbow’ like colour artefacts that are typical in holographic imaging. This image processing scheme is based on transforming the colour components of an RGB image into YUV colour space, which separates colour information from brightness component of an image. The resolution of our super-resolution colour microscope was characterized using a USAF test chart to confirm sub-micron spatial resolution, even for reconstructions that employ multi-height phase recovery to handle dense and connected objects. To further demonstrate the performance of this colour microscope Papanicolaou (Pap) smears were also successfully imaged. This field-portable and wide-field computational colour microscope could be useful for tele-medicine applications in resource poor settings.

Pixel super-resolution using wavelength scanning

Undersampling and pixelation affect a number of imaging systems, limiting the resolution of the acquired images, which becomes particularly significant for wide-field microscopy applications. Various super-resolution techniques have been implemented to mitigate this resolution loss by utilizing sub-pixel displacements in the imaging system, achieved, for example, by shifting the illumination source, the sensor array and/or the sample, followed by digital synthesis of a smaller effective pixel by merging these sub-pixel-shifted low-resolution images. Herein, we introduce a new pixel super-resolution method that is based on wavelength scanning and demonstrate that as an alternative to physical shifting/displacements, wavelength diversity can be used to boost the resolution of a wide-field imaging system and significantly increase its space-bandwidth product. We confirmed the effectiveness of this new technique by improving the resolution of lens-free as well as lens-based microscopy systems and developed an iterative algorithm to generate high-resolution reconstructions of a specimen using undersampled diffraction patterns recorded at a few wavelengths covering a narrow spectrum (10–30 nm). When combined with a synthetic-aperture-based diffraction imaging technique, this wavelength-scanning super-resolution approach can achieve a half-pitch resolution of 250 nm, corresponding to a numerical aperture of ~1.0, across a large field of view (>20 mm2). We also demonstrated the effectiveness of this approach by imaging various biological samples, including blood and Papanicolaou smears. Compared with displacement-based super-resolution techniques, wavelength scanning brings uniform resolution improvement in all directions across a sensor array and requires significantly fewer measurements. This technique would broadly benefit wide-field imaging applications that demand larger space-bandwidth products.

High-Throughput and Label-Free Single Nanoparticle Sizing Based on Time-Resolved On-Chip Microscopy

Sizing individual nanoparticles and dispersions of nanoparticles provides invaluable information in applications such as nanomaterial synthesis, air and water quality monitoring, virology, and medical diagnostics. Several conventional nanoparticle sizing approaches exist; however, there remains a lack of high-throughput approaches that are suitable for low-resource and field settings, i.e., methods that are cost-effective, portable, and can measure widely varying particle sizes and concentrations. Here we fill this gap using an unconventional approach that combines holographic on-chip microscopy with vapor-condensed nanolens self-assembly inside a cost-effective hand-held device. By using this approach and capturing time-resolved in situ images of the particles, we optimize the nanolens formation process, resulting in significant signal enhancement for the label-free detection and sizing of individual deeply subwavelength particles (smaller than λ/10) over a 30 mm(2) sample field-of-view, with an accuracy of ±11 nm. These time-resolved measurements are significantly more reliable than a single measurement at a given time, which was previously used only for nanoparticle detection without sizing. We experimentally demonstrate the sizing of individual nanoparticles as well as viruses, monodisperse samples, and complex polydisperse mixtures, where the sample concentrations can span ∼5 orders-of-magnitude and particle sizes can range from 40 nm to millimeter-scale. We believe that this high-throughput and label-free nanoparticle sizing platform, together with its cost-effective and hand-held interface, will make highly advanced nanoscopic measurements readily accessible to researchers in developing countries and even to citizen-scientists, and might especially be valuable for environmental and biomedical applications as well as for higher education and training programs.

Propagation phasor approach for holographic image reconstruction

To achieve high-resolution and wide field-of-view, digital holographic imaging techniques need to tackle two major challenges: phase recovery and spatial undersampling. Previously, these challenges were separately addressed using phase retrieval and pixel super-resolution algorithms, which utilize the diversity of different imaging parameters. Although existing holographic imaging methods can achieve large space-bandwidth-products by performing pixel super-resolution and phase retrieval sequentially, they require large amounts of data, which might be a limitation in high-speed or cost-effective imaging applications. Here we report a propagation phasor approach, which for the first time combines phase retrieval and pixel super-resolution into a unified mathematical framework and enables the synthesis of new holographic image reconstruction methods with significantly improved data efficiency. In this approach, twin image and spatial aliasing signals, along with other digital artifacts, are interpreted as noise terms that are modulated by phasors that analytically depend on the lateral displacement between hologram and sensor planes, sample-to-sensor distance, wavelength, and the illumination angle. Compared to previous holographic reconstruction techniques, this new framework results in five- to seven-fold reduced number of raw measurements, while still achieving a competitive resolution and space-bandwidth-product. We also demonstrated the success of this approach by imaging biological specimens including Papanicolaou and blood smears.

Sparsity-based multi-height phase recovery in holographic microscopy

High-resolution imaging of densely connected samples such as pathology slides using digital in-line holographic microscopy requires the acquisition of several holograms, e.g., at >6–8 different sample-to-sensor distances, to achieve robust phase recovery and coherent imaging of specimen. Reducing the number of these holographic measurements would normally result in reconstruction artifacts and loss of image quality, which would be detrimental especially for biomedical and diagnostics-related applications. Inspired by the fact that most natural images are sparse in some domain, here we introduce a sparsity-based phase reconstruction technique implemented in wavelet domain to achieve at least 2-fold reduction in the number of holographic measurements for coherent imaging of densely connected samples with minimal impact on the reconstructed image quality, quantified using a structural similarity index. We demonstrated the success of this approach by imaging Papanicolaou smears and breast cancer tissue slides over a large field-of-view of ~20 mm2 using 2 in-line holograms that are acquired at different sample-to-sensor distances and processed using sparsity-based multi-height phase recovery. This new phase recovery approach that makes use of sparsity can also be extended to other coherent imaging schemes, involving e.g., multiple illumination angles or wavelengths to increase the throughput and speed of coherent imaging.

Air quality monitoring using mobile microscopy and machine learning

Rapid, accurate and high-throughput sizing and quantification of particulate matter (PM) in air is crucial for monitoring and improving air quality. In fact, particles in air with a diameter of ≤2.5 μm have been classified as carcinogenic by the World Health Organization. Here we present a field-portable cost-effective platform for high-throughput quantification of particulate matter using computational lens-free microscopy and machine-learning. This platform, termed c-Air, is also integrated with a smartphone application for device control and display of results. This mobile device rapidly screens 6.5 L of air in 30 s and generates microscopic images of the aerosols in air. It provides statistics of the particle size and density distribution with a sizing accuracy of ~93%. We tested this mobile platform by measuring the air quality at different indoor and outdoor environments and measurement times, and compared our results to those of an Environmental Protection Agency–approved device based on beta-attenuation monitoring, which showed strong correlation to c-Air measurements. Furthermore, we used c-Air to map the air quality around Los Angeles International Airport (LAX) over 24 h to confirm that the impact of LAX on increased PM concentration was present even at >7 km away from the airport, especially along the direction of landing flights. With its machine-learning-based computational microscopy interface, c-Air can be adaptively tailored to detect specific particles in air, for example, various types of pollen and mold and provide a cost-effective mobile solution for highly accurate and distributed sensing of air quality.

Corrigendum: Propagation phasor approach for holographic image reconstruction

Scientific Reports 6: Article number: 22738; published online: 11 March 2016; updated: 19 October 2016

Accurate color imaging of pathology slides using holography and absorbance spectrum estimation of histochemical stains

Holographic microscopy presents challenges for color reproduction due to the usage of narrow-band illumination sources, which especially impacts the imaging of stained pathology slides for clinical diagnoses. Here, an accurate color holographic microscopy framework using absorbance spectrum estimation is presented. This method uses multispectral holographic images acquired and reconstructed at a small number (e.g., three to six) of wavelengths, estimates the absorbance spectrum of the sample, and projects it onto a color tristimulus. Using this method, the wavelength selection is optimized to holographically image 25 pathology slide samples with different tissue and stain combinations to significantly reduce color errors in the final reconstructed images. The results can be used as a practical guide for various imaging applications and, in particular, to correct color distortions in holographic imaging of pathology samples spanning different dyes and tissue types.

Yeast viability and concentration analysis using lens-free computational microscopy and machine learning

Research laboratories and the industry rely on yeast viability and concentration measurements to adjust fermentation parameters such as pH, temperature, and pressure. Beer-brewing processes as well as biofuel production can especially utilize a cost-effective and portable way of obtaining data on cell viability and concentration. However, current methods of analysis are relatively costly and tedious. Here, we demonstrate a rapid, portable, and cost-effective platform for imaging and measuring viability and concentration of yeast cells. Our platform features a lens-free microscope that weighs 70 g and has dimensions of 12 × 4 × 4 cm. A partially-coherent illumination source (a light-emitting-diode), a band-pass optical filter, and a multimode optical fiber are used to illuminate the sample. The yeast sample is directly placed on a complementary metal-oxide semiconductor (CMOS) image sensor chip, which captures an in-line hologram of the sample over a large field-of-view of >20 mm2. The hologram is transferred to a touch-screen interface, where a trained Support Vector Machine model classifies yeast cells stained with methylene blue as live or dead and measures cell viability as well as concentration. We tested the accuracy of our platform against manual counting of live and dead cells using fluorescent exclusion staining and a bench-top fluorescence microscope. Our regression analysis showed no significant difference between the two methods within a concentration range of 1.4 × 105 to 1.4 × 106 cells/mL. This compact and cost-effective yeast analysis platform will enable automatic quantification of yeast viability and concentration in field settings and resource-limited environments.