Anshuman J. Das

Coded Time-of-Flight Imaging for Calibration Free Fluorescence Lifetime Estimation

We present a novel, single-shot, calibration-free, framework within which Time-of-Flight cameras can be used to estimate lifetimes of fluorescent samples. Our technique relaxes the high time resolution or the multi-frequency measurement requirements in conventional systems.

A compact structured light based otoscope for three dimensional imaging of the tympanic membrane

Three dimensional (3D) imaging of the tympanic membrane (TM) has been carried out using a traditional otoscope equipped with a high-definition webcam, a portable projector and a telecentric optical system. The device allows us to project fringe patterns on the TM and the magnified image is processed using phase shifting algorithms to arrive at a 3D description of the TM. Obtaining a 3D image of the TM can aid in the diagnosis of ear infections such as otitis media with effusion, which is essentially fluid build-up in the middle ear. The high resolution of this device makes it possible examine a computer generated 3D profile for abnormalities in the shape of the eardrum. This adds an additional dimension to the image that can be obtained from a traditional otoscope by allowing visualization of the TM from different perspectives. In this paper, we present the design and construction of this device and details of the imaging processing for recovering the 3D profile of the subject under test. The design of the otoscope is similar to that of the traditional device making it ergonomically compatible and easy to adopt in clinical practice.

Machine learning approaches for large scale classification of produce

The analysis and identification of different attributes of produce such as taxonomy, vendor, and organic nature is vital to verifying product authenticity in a distribution network. Though a variety of analysis techniques have been studied in the past, we present a novel data-centric approach to classifying produce attributes. We employed visible and near infrared (NIR) spectroscopy on over 75,000 samples across several fruit and vegetable varieties. This yielded 0.90–0.98 and 0.98–0.99 classification accuracies for taxonomy and farmer classes, respectively. The most significant factors in the visible spectrum were variations in the produce color due to chlorophyll and anthocyanins. In the infrared spectrum, we observed that the varying water and sugar content levels were critical to obtaining high classification accuracies. High quality spectral data along with an optimal tuning of hyperparameters in the support vector machine (SVM) was also key to achieving high classification accuracies. In addition to demonstrating exceptional accuracies on test data, we explored insights behind the classifications, and identified the highest performing approaches using cross validation. We presented data collection guidelines, experimental design parameters, and machine learning optimization parameters for the replication of studies involving large sample sizes.

Smartphone-based fluorescence spectroscopy device aiding in preliminary skin screening (Erratum)

Preliminary diagnosis of closely resembling skin conditions can be highly subjective for dermatologists. In ambiguous cases, it often leads to performing invasive procedures like biopsies. Different skin conditions, however, have varying concentrations of fluorophores (like collagen, NADH) and chromophores (like melanin, hemoglobin) which can alter their fluorescence spectra. We demonstrate a handheld, portable, smartphone-based spectrometer that leverages these alterations in skin autofluorescence spectra for rapid screening of skin conditions. This methodology involves excitation of affected skin areas with ultraviolet (UV-A) 385 nm light, capturing the generated fluorescence spectra and sending the data wirelessly to a companion mobile application for data storage, analysis and visualization. By collecting the fluorescence spectral signals from healthy and unhealthy skin conditions, we establish that the signals collected using this portable device can be used to develop a classification method to help in differentially diagnosing these conditions. It shows promise as a useful skin screening tool for both dermatologists and primary health care workers. This device can enable quick, non-invasive and a more objective preliminary examination. We envision the device to be especially useful in primary healthcare centers of developing countries where availability of dermatologists is limited.

Volume estimation of tonsil phantoms using an oral camera with 3D imaging.

Three-dimensional (3D) visualization of oral cavity and oropharyngeal anatomy may play an important role in the evaluation for obstructive sleep apnea (OSA). Although computed tomography (CT) and magnetic resonance (MRI) imaging are capable of providing 3D anatomical descriptions, this type of technology is not readily available in a clinic setting. Current imaging of the oropharynx is performed using a light source and tongue depressors. For better assessment of the inferior pole of the tonsils and tongue base flexible laryngoscopes are required which only provide a two dimensional (2D) rendering. As a result, clinical diagnosis is generally subjective in tonsillar hypertrophy where current physical examination has limitations. In this report, we designed a hand held portable oral camera with 3D imaging capability to reconstruct the anatomy of the oropharynx in tonsillar hypertrophy where the tonsils get enlarged and can lead to increased airway resistance. We were able to precisely reconstruct the 3D shape of the tonsils and from that estimate airway obstruction percentage and volume of the tonsils in 3D printed realistic models. Our results correlate well with Brodskys classification of tonsillar hypertrophy as well as intraoperative volume estimations.

A method for rapid 3D scanning and replication of large paleontological specimens

We demonstrate a fast and cost-effective technique to perform three dimensional (3D) scanning and replication of large paleontological specimens, in this case the entire skull of a Tyrannosaurus rex (T.rex) with a volume in the range of 2 m3. The technique involves time-of-flight (TOF) depth sensing using the Kinect scanning module commonly used in gesture recognition in gaming. Raw data from the Kinect sensor was captured using open source software and the reconstruction was done rapidly making this a viable method that can be adopted by museums and researchers in paleontology. The current method has the advantage of being low-cost as compared to industrial scanners and photogrammetric methods but also of accurately scanning a substantial volume range which is well suited for large specimens. The depth resolution from the Kinect sensor was measured to be around 0.6 mm which is ideal for scanning large specimens with reasonable structural detail. We demonstrate the efficacy of this method on the skull of FMNH PR 2081, also known as SUE, a near complete T.rex at the Field Museum of Natural History.

Mobile phone based mini-spectrometer for rapid screening of skin cancer

We demonstrate a highly sensitive mobile phone based spectrometer that has potential to detect cancerous skin lesions in a rapid, non-invasive manner. Earlier reports of low cost spectrometers utilize the camera of the mobile phone to image the field after moving through a diffraction grating. These approaches are inherently limited by the closed nature of mobile phone image sensors and built in optical elements. The system presented uses a novel integrated grating and sensor that is compact, accurate and calibrated. Resolutions of about 10 nm can be achieved. Additionally, UV and visible LED excitation sources are built into the device. Data collection and analysis is simplified using the wireless interfaces and logical control on the smart phone. Furthermore, by utilizing an external sensor, the mobile phone camera can be used in conjunction with spectral measurements. We are exploring ways to use this device to measure endogenous fluorescence of skin in order to distinguish cancerous from non-cancerous lesions with a mobile phone based dermatoscope.

Multi-frequency reference-free fluorescence lifetime imaging using a time-of-flight camera

Multifrequency fluorescence lifetime imaging has been demonstrated using a time-of-flight camera. Numerical fitting reveals the lifetime and depth of a fluorescent sample without the need of calibration or reference measurements.