Ilya V. Kurilin

Content-based image orientation recognition

In this chapter, we describe a method for digital image orientation recognition. The method is based on classifier learning by a set of feature vectors extracted from images. Feature vectors are flip-invariant to effectively classify images into portrait-oriented and landscape-oriented photos. A new texture feature is proposed based on the observation that more textured areas are usually located in the lower part of the image. The proposed method could be effectively applied to index prints of photos (printing a set of miniatures of a large image collection).

Embedding positional-independent hidden data into hardcopy

We propose an approach for embedding of imperceptible hidden data into printed text document with ability to extract this data during scanning. Our approach is based on intrusion of cluster of small black dots (patterns) with predefined positional-independent structure into the document. Such intrusion will not visibly deteriorate document itself. Proposed multiple duplications of embedded information and statistical approach during hidden message extraction provide method with high immunity against document modification or noise.

Generation of PDF with vector symbols from scanned document

The paper is devoted to the algorithm for generation of PDF with vector symbols from scanned documents. The complex multi-stage technique includes segmentation of the document to text/drawing areas and background, conversion of symbols to lines and Bezier curves, storing compressed background and foreground. In the paper we concentrate on symbol conversion that comprises segmentation of symbol bodies with resolution enhancement, contour tracing and approximation. Presented method outperforms competitive solutions and secures the best compression rate/quality ratio. Scaling of initial document to other sizes as well as several printing/scanning-to-PDF iterations expose advantages of proposed way for handling with document images. Numerical vectorization quality metric was elaborated. The outcomes of OCR software and user opinion survey confirm high quality of proposed method.

Fast Algorithm for Visibility Enhancement of the Images with Low Local Contrast

In the paper, we propose new fast and effective approach for automatic visibility enhancement of images with poor global and local contrast. Initially, we developed the technique for scanned images with dark and light background regions and low visibility of foreground objects in both types of regions. Newly proposed algorithm carries out locally adaptive tone mapping by means of variable S-shaped curve. We use cubic Hermit spline. Starting and ending points of the spline depend on global brightness contrast, whereas tangents depend on local distribution of background and foreground pixels. Alteration of the tangents for adjacent areas is smoothed in order to avoid forming of visible artifacts. The description of several optimization tricks, which allow realization of high-speed algorithm, is given. We compare proposed method with several well-known image enhancement techniques by means of estimation of Michelson contrast (also known as visibility metric) for a number of test patterns. Disclosed algorithm outperforms tested alternatives. Finally, we extend application of proposed method for photo enhancement and correction of images with haze.

High-performance automatic cropping and deskew of multiple objects on scanned images

The paper is devoted to a novel high-performance algorithm for automatic segmentation and skew correction of several objects on a scanned image. The complex multi-stage technique includes preprocessing, initial segmentation, classification of connected regions, merging of fragmented regions by heuristic procedure, bounding boxes detection and deskew of rectangular objects. Our method is highly effective owing to unification most of operations in one pass. Algorithm provides users with additional functionality and comfort. The method is evaluated by suggested quantitative quality criteria.

Descreening of scanned images

Screen or halftone pattern appears on the majority of images printed on electrophotographic and ink-jet printers as well as offset machines. When such halftoned image is scanned, a noisy effect called a Moiré pattern often appears on the image. There are plenty of methods proposed for descreening of images. Common way is adaptive smoothing of scanned images. However the descreening techniques face the following dilemma: deep screen reduction and restoration of contone images leads to blurring of sharp edges of text and other graphics primitives, on the other hand insufficient smoothing keeps screen in halftoned areas. We propose novel descreening algorithm that is primarily intended for preservation of sharpness and contrast of text edges and for restoration contone images from halftone ones accurately. Proposed technique for descreening of scanned images comprises five steps. The first step is decrease of edge transition slope length via local tone mapping with ordering; it is carried out before adaptive smoothing, and it allows better preservation of edges. Adaptive low-pass filter applies simplified idea of Non-Local Means filter for area classification; similarity is calculated between central block of window and different adjacent block that is selected randomly. If similarity is high then current pixel relates to flat region, otherwise pixel relates to edge region. For prevention of edges blurring, flat regions are smoothed stronger than edge regions. By random selection of blocks we avoid the computational overhead related to excessive directional edge detection. Final three stages include additional decrease of edge transition slope length using local tone mapping, increase of local contrast via modified unsharp mask filter, that uses bilateral filter with special edge-stop function for modest smoothing of edges, and global contrast stretching. These stages are intended to compensate decreasing of sharpness and contrast due to low-pass filtering, it allows to enhance visual quality of scanned image. For parameters adjusting for different scanning resolutions and comparison with existing techniques test target and criteria were proposed. Also the quality of proposed approach is evaluated by surveying observers opinions. According to obtained outcomes the proposed algorithm demonstrates good descreening capabilities.

Automatic Generation of Collage

We describe algorithms for the automatic creation of collages from a collection of photos. The appeal of different forms of collage from the user’s viewpoint is discussed. We consider time- and camera-based photo selection procedures, including the estimation of the quality of the photographs. Collage generation involves arrangement of the photos on canvas and an application of seamless blending with elements of randomness.

Automatic Red Eye Correction

The red eye artefact is an irritating defect in photos. The correction of red eyes during printing without user intervention is an important task. This chapter is devoted to a description of an efficient technique for automatic correction of red eyes. Initially we developed a method for a photo printer; however, our approach is applicable for any software and firmware. The algorithm is independent of face orientation and is capable of detecting paired red eyes as well as single red eyes. For the segmentation of roundish red regions, we applied colour information and thresholding in the domain of outcomes of four-directional edge-detection filters jointly. For classification of segmented regions, we built a cascade of classifiers: three simple classifiers eliminate obviously false areas, and after that an ensemble of decision trees created by an adaptive boosting algorithm performs detection of red-eye regions with good performance. A retouching stage includes desaturation, darkening, and blending with the initial image. In addition, we construct a sophisticated quality criterion of correction: we employ the Analytic Hierarchy Process for prioritization of the observer’s opinions about outcomes of detection and correction. The experimental results demonstrate good performance of the proposed algorithm in comparison with existing solutions.

Removal of JPEG Artefacts

The present chapter generally relates to a method for effective reduction of artefacts caused by lossy compression algorithms based on block-based Discreet Cosine Transform (DCT) coding, known as JPEG coding. The most common artefacts produced by this type of coding are blocking and ringing artefacts. To reduce the effect of coding artefacts caused by significant information loss, a variety of different algorithms and methods have been suggested. However, the majority of solutions propose to process all blocks in the image, even those blocks that are not affected by artefacts and this leads to an increase in processing time and required resources, as well as image over-blurring. Techniques for ringing artefact detection usually rely on an edge-detection step, a complicated and versatile procedure with unknown optimal parameters. In this paper, we describe very effective procedures for the detection of artefacts and their subsequent correction. This approach helps to save a notable amount of computational resources, since not all the blocks are involved in correction procedures. Detection steps are performed in the frequency domain, using only the DCT coefficients of an image. Numerous examples have been analysed and compared with the existent solutions, and the results prove the effectiveness of the proposed technique.

Image Enhancement Pipeline Based on EXIF Metadata

The application of metadata from an EXIF-file for the estimation of the probability of defects existing in digital photos is considered. The following typical defects of photos are selected: exposure problems, noise, colour cast, blur, JPEG artefacts, and the presence of red eyes. An extensive database of photographs captured using ten different cameras was collected, and the influence of various EXIF-tags on the presence of defects analysed. An EXIF-based image enhancement pipeline is created which allows a reduction in the total time needed for automatic photo enhancement as a consequence of the estimation of the probability that several defects are present in the corrected photo. The optimisation of the image enhancement procedure is implemented by applying a specific classification based on the EXIF-tags contained in photographs, so that the number of cases for which a quality assessment is required is reduced.