Bruno Cornelis

Crack detection and inpainting for virtual restoration of paintings: The case of the Ghent Altarpiece

Digital image processing is proving to be of great help in the analysis and documentation of our vast cultural heritage. In this paper, we present a new method for the virtual restoration of digitized paintings with special attention for the Ghent Altarpiece (1432), a large polyptych panel painting of which very few digital reproductions exist. We achieve our objective by detecting and digitally removing cracks. The detection of cracks is particularly difficult because of the varying content features in different parts of the polyptych. Three new detection methods are proposed and combined in order to detect cracks of different sizes as well as varying brightness. Semi-supervised clustering based post-processing is used to remove objects falsely labelled as cracks. For the subsequent inpainting stage, a patch-based technique is applied to handle the noisy nature of the images and to increase the performance for crack removal. We demonstrate the usefulness of our method by means of a case study where the goal is to improve readability of the depiction of text in a book, present in one of the panels, in order to assist paleographers in its deciphering.

Virtual restoration of the ghent altarpiece using crack detection and inpainting

In this paper, we present a new method for virtual restoration of digitized paintings, with the special focus on the Ghent Altarpiece (1432), one of Belgiums greatest masterpieces. The goal of the work is to remove cracks from the digitized painting thereby approximating how the painting looked like before ageing for nearly 600 years and aiding art historical and palaeographical analysis. For crack detection, we employ a multiscale morphological approach, which can cope with greatly varying thickness of the cracks as well as with their varying intensities (from dark to the light ones). Due to the content of the painting (with extremely many fine details) and complex type of cracks (including inconsistent whitish clouds around them), the available inpainting methods do not provide satisfactory results on many parts of the painting. We show that patch-based methods outperform pixel-based ones, but leaving still much room for improvements in this application. We propose a new method for candidate patch selection, which can be combined with different patchbased inpainting methods to improve their performance in crack removal. The results demonstrate improved performance, with less artefacts and better preserved fine details.

Fast communication: Digital canvas removal in paintings

The periodic structure of the underlying support of paintings on canvas can become quite prominent and disturbing in high resolution digital recordings. In this paper, we construct a new model and method for the digital removal of canvas which is considered as a noise component superimposed on the painting artwork. The high resolution of the images prohibits the efficient application of existing adaptive denoising filters. Hence, a two-step approach is proposed. First a (smoothing) Wiener filter is applied to the complete image. The second step consists of a spatially adaptive extension with low-complexity to obtain a generic digital canvas removal filter.

Digital cradle removal in X-ray images of art paintings

We introduce an algorithm that removes the deleterious effect of cradling on X-ray images of paintings on wooden panels. The algorithm consists of a three stage procedure. Firstly, the cradled regions are located automatically. The second step consists of separating the X-ray image into a textural and image component. In the last step the algorithm learns to distinguish between the texture caused by the wooden cradle and the texture belonging to the original painted wooden panel. The results obtained with our method are compared with those obtained manually by best current practice.

Digital Image Processing of The Ghent Altarpiece: Supporting the painting's study and conservation treatment

Hanging in the Saint Bavo Cathedral in Ghent, Belgium, is The Ghent Altarpiece, also known as The Adoration of the Mystic Lamb (see Figure 1). According to an inscription on the outer frames, it was painted by brothers Hubert and Jan van Eyck for Joos Vijd and?his wife Elisabeth Borluut in 1432. It is one of the most admired and influential paintings in the history of art and has given rise to many intriguing questions that have been puzzling art historians to date [11]. Moreover, the material history of the panels is very complicated. They were hidden, dismantled, moved away, stolen, and recovered during riots, fires and wars. The recovery of the panels by the U.S. Army in the Nazi hoards deep in the Altaussee salt mines has particularly marked memories. One panel was stolen in 1934 and never recovered. Besides varying conservation conditions, the panels underwent numerous restoration treatments and were even partially painted over.

Multi-Modal Dictionary Learning for Image Separation With Application in Art Investigation

In support of art investigation, we propose a new source separation method that unmixes a single X-ray scan acquired from double-sided paintings. In this problem, the X-ray signals to be separated have similar morphological characteristics, which brings previous source separation methods to their limits. Our solution is to use photographs taken from the front-and back-side of the panel to drive the separation process. The crux of our approach relies on the coupling of the two imaging modalities (photographs and X-rays) using a novel coupled dictionary learning framework able to capture both common and disparate features across the modalities using parsimonious representations; the common component captures features shared by the multi-modal images, whereas the innovation component captures modality-specific information. As such, our model enables the formulation of appropriately regularized convex optimization procedures that lead to the accurate separation of the X-rays. Our dictionary learning framework can be tailored both to a single- and a multi-scale framework, with the latter leading to a significant performance improvement. Moreover, to improve further on the visual quality of the separated images, we propose to train coupled dictionaries that ignore certain parts of the painting corresponding to craquelure. Experimentation on synthetic and real data—taken from digital acquisition of the Ghent Altarpiece (1432)—confirms the superiority of our method against the state-of-the-art morphological component analysis technique that uses either fixed or trained dictionaries to perform image separation.

Accurate label-free 3-part leukocyte recognition with single cell lens-free imaging flow cytometry

Three-part white blood cell differentials which are key to routine blood workups are typically performed in centralized laboratories on conventional hematology analyzers operated by highly trained staff. With the trend of developing miniaturized blood analysis tool for point-of-need in order to accelerate turnaround times and move routine blood testing away from centralized facilities on the rise, our group has developed a highly miniaturized holographic imaging system for generating lens-free images of white blood cells in suspension. Analysis and classification of its output data, constitutes the final crucial step ensuring appropriate accuracy of the system. In this work, we implement reference holographic images of single white blood cells in suspension, in order to establish an accurate ground truth to increase classification accuracy. We also automate the entire workflow for analyzing the output and demonstrate clear improvement in the accuracy of the 3-part classification. High-dimensional optical and morphological features are extracted from reconstructed digital holograms of single cells using the ground-truth images and advanced machine learning algorithms are investigated and implemented to obtain 99% classification accuracy. Representative features of the three white blood cell subtypes are selected and give comparable results, with a focus on rapid cell recognition and decreased computational cost.

X-ray image separation via coupled dictionary learning

In support of art investigation, we propose a new source separation method that unmixes a single X-ray scan acquired from double-sided paintings. Unlike prior source separation methods, which are based on statistical or structural incoherence of the sources, we use visual images taken from the front- and back-side of the panel to drive the separation process. The coupling of the two imaging modalities is achieved via a new multi-scale dictionary learning method. Experimental results demonstrate that our method succeeds in the discrimination of the sources, while state-of-the-art methods fail to do so.

L1-optimized linear prediction for light field image compression

The advent of consumer-level plenoptic cameras has sparkled the interest towards the design of efficient compression techniques for light field images. State-of-the-art compression systems such as HEVC prove to be inefficient when directly applied on this type of data due to the inherent spatial discontinuities among neighboring microlens images. In this paper, a novel light field image compression system is proposed. The disk-shaped pixel clusters corresponding to each microlens in the light field image are efficiently predicted based on the neighboring disks. In this context, an optimized linear prediction design based on L1 minimization of the residuals is proposed. K-means clustering is employed on training data in order to determine the optimized set of predictors. The experimental results on an extensive set of light field images demonstrate that the proposed coding scheme yields an average of 2.93 dB and 3.22 dB gain in PSNR, and 52.67% and 57.27% average rate savings compared to HEVC and JPEG2000 respectively.

Removing Cradle Artifacts in X-Ray Images of Paintings

We propose an algorithm that removes the visually unpleasant effects of cradling in X-ray images of panel paintings, with the goal of improving the X-ray image readability by art experts. The algorithm consists of three stages. In the first stage the location of the cradle is detected automatically and the grayscale inconsistency, caused by the thickness of the cradle, is corrected. In a second stage we use a method called morphological component analysis to separate the X-ray image into a so-called cartoon part and a texture part, where the latter contains mostly the wood grain from both the panel and the cradling. The algorithm next learns a Bayesian factor model that distinguishes between the texture patterns that originate from the cradle and those from other components such as the panel and/or the painting on the panel surface, and finally uses this to remove the textures associated with the cradle. We apply the algorithm to a number of historically important paintings on panel. We also show how it c...