Igor Zingman

Morphological operators for segmentation of high contrast textured regions in remotely sensed imagery

We develop a transformation based on morphological filters that measures the contrast of image texture. This transformation is proportional to texture contrast, but insensitive to its specific type. Though the transformation provides a high response in textured areas, it suppresses individual high contrast features that stand apart from textured areas. It can serve as an effective texture descriptor for unsupervised or supervised segmentation of textured regions, provides high accuracy of localization and does not involve heavy computations. The method is robust to variations of illumination and works on different types of images without needing to be tuned. The only parameter is a scale related parameter. We illustrate the use of the proposed method on satellite and aerial images.

A morphological approach for distinguishing texture and individual features in images

We present a morphological texture contrast (MTC) operator that allows detection of textural and non-texture regions in images. We show that in contrast to other approaches, the MTC discriminates between texture details and isolated features and does not extend borders of texture regions. A comparison with other methods used for texture detection is provided. Using the ideas underlying the MTC operator, we develop a complementary operator called morphological feature contrast (MFC) that allows extraction of isolated features while not being confused by texture details. We illustrate an application of the MFC operator to extraction of isolated objects such as individual trees or buildings that should be distinguished from forests or urban centers. We also propose an MFC based detector of isolated linear features and compare it with an alternative approach used for detection of edges and lines in cluttered scenes. We furthermore derive an extended version of the MFC that can be directly applied to vector-valued images.

Detection of Texture and Isolated Features Using Alternating Morphological Filters

Recently, we introduced a morphological texture contrast (MTC) operator that allows detection of textural and non-texture regions in images. In this paper we provide comparison of the MTC with other available techniques. We show that, in contrast to other approaches, the MTC discriminates between texture details and isolated features, and does not extend borders of texture regions. Using the ideas underlying the MTC operator, we develop a complementary operator called morphological feature contrast (MFC) that allows extraction of isolated features while not being confused by texture details. We illustrate an application of the MFC operator for extraction of isolated objects such as individual trees or buildings that should be distinguished from forests or urban centers. We furthermore provide an example of how this operator can be used for detection of isolated linear structures. We also derive an extended version of the MFC that works with vector-valued images.

Detection of Fragmented Rectangular Enclosures in Very High Resolution Remote Sensing Images

We develop an approach for the detection of ruins of livestock enclosures (LEs) in alpine areas captured by high-resolution remotely sensed images. These structures are usually of approximately rectangular shape and appear in images as faint fragmented contours in complex background. We address this problem by introducing a rectangularity feature that quantifies the degree of alignment of an optimal subset of extracted linear segments with a contour of rectangular shape. The rectangularity feature has high values not only for perfectly regular enclosures but also for ruined ones with distorted angles, fragmented walls, or even a completely missing wall. Furthermore, it has a zero value for spurious structures with less than three sides of a perceivable rectangle. We show how the detection performance can be improved by learning a linear combination of the rectangularity and size features from just a few available representative examples and a large number of negatives. Our approach allowed detection of enclosures in the Silvretta Alps that were previously unknown. A comparative performance analysis is provided. Among other features, our comparison includes the state-of-the-art features that were generated by pretrained deep convolutional neural networks (CNNs). The deep CNN features, although learned from a very different type of images, provided the basic ability to capture the visual concept of the LEs. However, our handcrafted rectangularity-size features showed considerably higher performance.

Automated search for livestock enclosures of rectangular shape in remotely sensed imagery

We introduce an approach for the detection of approximately rectangular structures in gray scale images. Our research is motivated by the Silvretta Historica project that aims at automated detection of remains of livestock enclosures in remotely sensed images of alpine regions. The approach allows detection of enclosures with linear sides of various sizes and proportions. It is robust to incomplete or fragmented rectangles and tolerates deviations from a perfect rectangular shape. Morphological operators are used to extract linear features. They are grouped into parameterized linear segments by means of a local Hough transform. To identify appropriate configurations of linear segments we define convexity and angle constraints. Configurations meeting these constraints are rated by a proposed rectangularity measure that discards overly fragmented configurations and configurations with more than one side completely missing. The search for appropriate configurations is efficiently performed on a graph. Its nodes represent linear segments and edges encode the above constraints. We tested our approach on a set of aerial and GeoEye-1 satellite images of 0.5m resolution that contain ruined livestock enclosures of approximately rectangular shape. The approach showed encouraging results in finding configurations of linear segments originating from the objects of our interest.

Detection of incomplete enclosures of rectangular shape in remotely sensed images

We develop an approach for detection of ruins of livestock enclosures in alpine areas captured by high-resolution remotely sensed images. These structures are usually of approximately rectangular shape and appear in images as faint fragmented contours in complex background. We address this problem by introducing a new rectangularity feature that quantifies the degree of alignment of an optimal subset of extracted linear segments with a contour of rectangular shape. The rectangularity feature has high values not only for perfect enclosures, but also for broken ones with distorted angles, fragmented walls, or even a completely missing wall. However, it has zero value for spurious structures with less than three sides of a perceivable rectangle. Performance analysis using large imagery of an alpine environment is provided. We show how the detection performance can be improved by learning from only a few representative examples and a large number of negatives.

Reported Attention as a Promising Alternative to Gaze in IQA Tasks

We study the use of crowdsourcing for self-reported attention in image quality assessment (IQA) tasks. We present the results from two crowdsourcing campaigns: one where participants indicated via mouse clicks the image locations that influenced their rating of quality, and another where participants chose locations they looked at in a free-viewing setting. The results are compared to in-lab eye tracking experiments. Our analysis shows a strong connection between the in-lab and self-reported IQA locations. This suggests that crowdsourced studies are an affordable and valid alternative to eye tracking for IQA tasks.