Markus Gerke

Automatic structural seismic damage assessment with airborne oblique pictometry imagery

Accurate and rapid mapping of seismic building damage is essential to support rescue forces and estimate economic losses. Traditional methods have limitations: ground-based mapping is slow and largely limited to facade information, and image-based mapping is typically restricted to vertical (roof) views. Here, we assess the value of photogrammetrically processed airborne oblique, multi-perspective Pictometry data, in a two-step approach: (a) supervised classification into facades, intact roofs, destroyed roofs and vegetation using 22 image-derived features, and (b) combining the classification results from different viewing directions into a per-building damage score adapted from the European Macroseismic Scale (EMS 98) for damage classification (no-moderate damage, heavy damage, destruction). Overall classification accuracies for the four classes and for the building damage of 70 percent and 63 percent, respectively, were achieved. Image stereo overlap helped classify facades, but problems with the relatively vague EMS damage class definitions were encountered, and subjectivity in training data generation affected overall classification by up to 10 percent.

Review of automatic feature extraction from high-resolution optical sensor data for UAV-based cadastral mapping

Unmanned Aerial Vehicles (UAVs) have emerged as a rapid, low-cost and flexible acquisition system that appears feasible for application in cadastral mapping: high-resolution imagery, acquired using UAVs, enables a new approach for defining property boundaries. However, UAV-derived data are arguably not exploited to its full potential: based on UAV data, cadastral boundaries are visually detected and manually digitized. A workflow that automatically extracts boundary features from UAV data could increase the pace of current mapping procedures. This review introduces a workflow considered applicable for automated boundary delineation from UAV data. This is done by reviewing approaches for feature extraction from various application fields and synthesizing these into a hypothetical generalized cadastral workflow. The workflow consists of preprocessing, image segmentation, line extraction, contour generation and postprocessing. The review lists example methods per workflow step—including a description, trialed implementation, and a list of case studies applying individual methods. Furthermore, accuracy assessment methods are outlined. Advantages and drawbacks of each approach are discussed in terms of their applicability on UAV data. This review can serve as a basis for future work on the implementation of most suitable methods in a UAV-based cadastral mapping workflow.

Review of the Current State of UAV Regulations

UAVs—unmanned aerial vehicles—facilitate data acquisition at temporal and spatial scales that still remain unachievable for traditional remote sensing platforms. However, current legal frameworks that regulate UAVs present significant barriers to research and development. To highlight the importance, impact, and diversity of UAV regulations, this paper provides an exploratory investigation of UAV regulations on the global scale. For this, the methodological approach consists of a research synthesis of UAV regulations, including a thorough literature review and a comparative analysis of national regulatory frameworks. Similarities and contrasting elements in the various national UAV regulations are explored including their statuses from the perspectives of past, present, and future trends. Since the early 2000s, countries have gradually established national legal frameworks. Although all UAV regulations have one common goal—minimizing the risks to other airspace users and to both people and property on the ground—the results reveal distinct variations in all the compared variables. Furthermore, besides the clear presence of legal frameworks, market forces such as industry design standards and reliable information about UAVs as public goods are expected to shape future developments.

Minimal camera networks for 3D image based modeling of cultural heritage objects.

3D modeling of cultural heritage objects like artifacts, statues and buildings is nowadays an important tool for virtual museums, preservation and restoration. In this paper, we introduce a method to automatically design a minimal imaging network for the 3D modeling of cultural heritage objects. This becomes important for reducing the image capture time and processing when documenting large and complex sites. Moreover, such a minimal camera network design is desirable for imaging non-digitally documented artifacts in museums and other archeological sites to avoid disturbing the visitors for a long time and/or moving delicate precious objects to complete the documentation task. The developed method is tested on the Iraqi famous statue “Lamassu”. Lamassu is a human-headed winged bull of over 4.25 m in height from the era of Ashurnasirpal II (883–859 BC). Close-range photogrammetry is used for the 3D modeling task where a dense ordered imaging network of 45 high resolution images were captured around Lamassu with an object sample distance of 1 mm. These images constitute a dense network and the aim of our study was to apply our method to reduce the number of images for the 3D modeling and at the same time preserve pre-defined point accuracy. Temporary control points were fixed evenly on the body of Lamassu and measured by using a total station for the external validation and scaling purpose. Two network filtering methods are implemented and three different software packages are used to investigate the efficiency of the image orientation and modeling of the statue in the filtered (reduced) image networks. Internal and external validation results prove that minimal image networks can provide highly accurate records and efficiency in terms of visualization, completeness, processing time (>60% reduction) and the final accuracy of 1 mm.

Identification of Structurally Damaged Areas in Airborne Oblique Images Using a Visual-Bag-of-Words Approach

Automatic post-disaster mapping of building damage using remote sensing images is an important and time-critical element of disaster management. The characteristics of remote sensing images available immediately after the disaster are not certain, since they may vary in terms of capturing platform, sensor-view, image scale, and scene complexity. Therefore, a generalized method for damage detection that is impervious to the mentioned image characteristics is desirable. This study aims to develop a method to perform grid-level damage classification of remote sensing images by detecting the damage corresponding to debris, rubble piles, and heavy spalling within a defined grid, regardless of the aforementioned image characteristics. The Visual-Bag-of-Words (BoW) is one of the most widely used and proven frameworks for image classification in the field of computer vision. The framework adopts a kind of feature representation strategy that has been shown to be more efficient for image classification—regardless of the scale and clutter—than conventional global feature representations. In this study supervised models using various radiometric descriptors (histogram of gradient orientations (HoG) and Gabor wavelets) and classifiers (SVM, Random Forests, and Adaboost) were developed for damage classification based on both BoW and conventional global feature representations, and tested with four datasets. Those vary according to the aforementioned image characteristics. The BoW framework outperformed conventional global feature representation approaches in all scenarios (i.e., for all combinations of feature descriptors, classifiers, and datasets), and produced an average accuracy of approximately 90%. Particularly encouraging was an accuracy improvement by 14% (from 77% to 91%) produced by BoW over global representation for the most complex dataset, which was used to test the generalization capability.

An Image-Based Approach for the Co-Registration of Multi-Temporal UAV Image Datasets

During the past years, UAVs (Unmanned Aerial Vehicles) became very popular as low-cost image acquisition platforms since they allow for high resolution and repetitive flights in a flexible way. One application is to monitor dynamic scenes. However, the fully automatic co-registration of the acquired multi-temporal data still remains an open issue. Most UAVs are not able to provide accurate direct image georeferencing and the co-registration process is mostly performed with the manual introduction of ground control points (GCPs), which is time consuming, costly and sometimes not possible at all. A new technique to automate the co-registration of multi-temporal high resolution image blocks without the use of GCPs is investigated in this paper. The image orientation is initially performed on a reference epoch and the registration of the following datasets is achieved including some anchor images from the reference data. The interior and exterior orientation parameters of the anchor images are then fixed in order to constrain the Bundle Block Adjustment of the slave epoch to be aligned with the reference one. The study involved the use of two different datasets acquired over a construction site and a post-earthquake damaged area. Different tests have been performed to assess the registration procedure using both a manual and an automatic approach for the selection of anchor images. The tests have shown that the procedure provides results comparable to the traditional GCP-based strategy and both the manual and automatic selection of the anchor images can provide reliable results.

Segmentation Based on Normalized Cuts for the Detection of Suburban Roads in Aerial Imagery

This paper deals with the segmentation of images of suburban scenes with the normalized cut algorithm. The segmentation results are intended to be used for the extraction of roads in order to assess existing road data. The similarity matrix necessary for the normalized cuts algorithm is built up using similarity criteria that are suitable for the separation of road segments and non-road segments. These criteria are edges, colour, hue and road surface colour derived with the help of the database information which is thus used as prior information to facilitate the segmentation and extraction. Segmentation is the main topic of this paper, but some hints on future work regarding the selection of road segments based on road colour are given. The results show that the approach is suitable for the segmentation in order to extract roads in suburban scenes.

Contour Detection for UAV-Based Cadastral Mapping

Unmanned aerial vehicles (UAVs) provide a flexible and low-cost solution for the acquisition of high-resolution data. The potential of high-resolution UAV imagery to create and update cadastral maps is being increasingly investigated. Existing procedures generally involve substantial fieldwork and many manual processes. Arguably, multiple parts of UAV-based cadastral mapping workflows could be automated. Specifically, as many cadastral boundaries coincide with visible boundaries, they could be extracted automatically using image analysis methods. This study investigates the transferability of gPb contour detection, a state-of-the-art computer vision method, to remotely sensed UAV images and UAV-based cadastral mapping. Results show that the approach is transferable to UAV data and automated cadastral mapping: object contours are comprehensively detected at completeness and correctness rates of up to 80%. The detection quality is optimal when the entire scene is covered with one orthoimage, due to the global optimization of gPb contour detection. However, a balance between high completeness and correctness is hard to achieve, so a combination with area-based segmentation and further object knowledge is proposed. The localization quality exhibits the usual dependency on ground resolution. The approach has the potential to accelerate the process of general boundary delineation during the creation and updating of cadastral maps.

Graph matching in 3D space for structural seismic damage assessment

One common objective in computer vision and photogrammetry is to infer higher level object structure which is not directly observable in images or other sensing data. A practical problem field for such research is seismic building damage assessment. It is possible to observe objects such as façades, roofs, or rubble piles in oblique airborne images, but whether they are part of an actually intact or destroyed building is not observable directly: only the spatial relation between those directly observable objects allows conclusions about the structural integrity of a building. In this paper we present an approach to seismic building damage assessment, where a graph-based learning technique is employed to detect and to classify building damage levels, given instances of four object classes derived by supervised classification in object space. Results show that the vague building damage level description leads to relatively low classification score (52%), when a pre-defined building outline is assumed. However, if one is independent from such a pre-segmentation, the detection and classification rate is higher (70%).

Using UAVs for map creation and updating. A case study in Rwanda

Aerial or satellite images are conventionally used for geospatial data collection. However, unmanned aerial vehicles (UAVs) are emerging as a suitable technology for providing very high spatial and temporal resolution data at a low cost. This paper aims to show the potential of using UAVs for map creation and updating. The whole workflow is introduced in the paper, using a case study in Rwanda, where 954 images were collected with a DJI Phantom 2 Vision Plus quadcopter. An orthophoto covering 0.095 km2 with a spatial resolution of 3.3 cm was produced and used to extract features with a sub-decimetre accuracy. Quantitative and qualitative control of the UAV data products were performed, indicating that the obtained accuracies comply to international standards. Moreover, possible problems and further perspectives were also discussed. The results demonstrate that UAVs provide promising opportunities to create high-resolution and highly accurate orthophotos, thus facilitating map creation and updating.