Manuel Campos-Taberner

Processing of Extremely High-Resolution LiDAR and RGB Data: Outcome of the 2015 IEEE GRSS Data Fusion Contest - Part A: 2-D Contest

In this paper, we discuss the scientific outcomes of the 2015 data fusion contest organized by the Image Analysis and Data Fusion Technical Committee (IADF TC) of the IEEE Geoscience and Remote Sensing Society (IEEE GRSS). As for previous years, the IADF TC organized a data fusion contest aiming at fostering new ideas and solutions for multisource studies. The 2015 edition of the contest proposed a multiresolution and multisensorial challenge involving extremely high-resolution RGB images and a three-dimensional (3-D) LiDAR point cloud. The competition was framed in two parallel tracks, considering 2-D and 3-D products, respectively. In this paper, we discuss the scientific results obtained by the winners of the 2-D contest, which studied either the complementarity of RGB and LiDAR with deep neural networks (winning team) or provided a comprehensive benchmarking evaluation of new classification strategies for extremely high-resolution multimodal data (runner-up team). The data and the previously undisclosed ground truth will remain available for the community and can be obtained at http://www.grss-ieee.org/community/technical-committees/data-fusion/2015-ieee-grss-data-fusion-contest/. The 3-D part of the contest is discussed in the Part-B paper [1].

Multitemporal Monitoring of Plant Area Index in the Valencia Rice District with PocketLAI

Leaf area index (LAI) is a key biophysical parameter used to determine foliage cover and crop growth in environmental studies in order to assess crop yield. Frequently, plant canopy analyzers (LAI-2000) and digital cameras for hemispherical photography (DHP) are used for indirect effective plant area index (PAIeff) estimates. Nevertheless, these instruments are expensive and have the disadvantages of low portability and maintenance. Recently, a smartphone app called PocketLAI was presented and tested for acquiring PAIeff measurements. It was used during an entire rice season for indirect PAIeff estimations and for deriving reference high-resolution PAIeff maps. Ground PAIeff values acquired with PocketLAI, LAI-2000, and DHP were well correlated (R2 = 0.95, RMSE = 0.21 m2/m2 for Licor-2000, and R2 = 0.94, RMSE = 0.6 m2/m2 for DHP). Complementary data such as phenology and leaf chlorophyll content were acquired to complement seasonal rice plant information provided by PAIeff. High-resolution PAIeff maps, which can be used for the validation of remote sensing products, have been derived using a global transfer function (TF) made of several measuring dates and their associated satellite radiances.

Exploitation of SAR and Optical Sentinel Data to Detect Rice Crop and Estimate Seasonal Dynamics of Leaf Area Index

This paper presents and evaluates multitemporal LAI estimates derived from Sentinel-2A data on rice cultivated area identified using time series of Sentinel-1A images over the main European rice districts for the 2016 crop season. This study combines the information conveyed by Sentinel-1A and Sentinel-2A into a high-resolution LAI retrieval chain. Rice crop was detected using an operational multi-temporal rule-based algorithm, and LAI estimates were obtained by inverting the PROSAIL radiative transfer model with Gaussian process regression. Direct validation was performed with in situ LAI measurements acquired in coordinated field campaigns in three countries (Italy, Spain and Greece). Results showed high consistency between estimates and ground measurements, revealing high correlations (R2 > 0.93) and good accuracies (RMSE < 0.83, rRMSEm < 23.6% and rRMSEr < 16.6%) in all cases. Sentinel-2A estimates were compared with Landsat-8 showing high spatial consistency between estimates over the three areas. The possibility to exploit seasonally-updated crop mask exploiting Sentinel-1A data and the temporal consistency between Sentinel-2A and Landsat-7/8 LAI time series demonstrates the feasibility of deriving operationally high spatial-temporal decametric multi-sensor LAI time series useful for crop monitoring.

Mapping Leaf Area Index With a Smartphone and Gaussian Processes

Leaf area index (LAI) is a key biophysical parameter used to determine foliage cover and crop growth in environmental studies. Smartphones are nowadays ubiquitous sensor devices with high computational power, moderate cost, and high-quality sensors. A smartphone app, which is called PocketLAI, was recently presented and tested for acquiring ground LAI estimates. In this letter, we explore the use of state-of-the-art nonlinear Gaussian process regression (GPR) to derive spatially explicit LAI estimates over rice using ground data from PocketLAI and Landsat 8 imagery. GPR has gained popularity in recent years because of its solid Bayesian foundations that offer not only high accuracy but also confidence intervals for the retrievals. We show the first LAI maps obtained with ground data from a smartphone combined with advanced machine learning. This letter compares LAI predictions and confidence intervals of the retrievals obtained with PocketLAI with those obtained with classical instruments, such as digital hemispheric photography (DHP) and LI-COR LAI-2000. This letter shows that all three instruments obtained comparable results, but PocketLAI is far cheaper. The proposed methodology hence opens a wide range of possible applications at moderate cost.

Downstream Services for Rice Crop Monitoring in Europe: From Regional to Local Scale

The ERMES agromonitoring system for rice cultivations integrates EO data at different resolutions, crop models, and user-provided in situ data in a unified system, which drives two operational downstream services for rice monitoring. The first is aimed at providing information concerning the behavior of the current season at regional/rice district scale, while the second is dedicated to provide farmers with field-scale data useful to support more efficient and environmentally friendly crop practices. In this contribution, we describe the main characteristics of the system, in terms of overall architecture, technological solutions adopted, characteristics of the developed products, and functionalities provided to end users. Peculiarities of the system reside in its ability to cope with the needs of different stakeholders within a common platform, and in a tight integration between EO data processing and information retrieval, crop modeling, in situ data collection, and information dissemination. The ERMES system has been operationally tested in three European rice-producing countries (Italy, Spain, and Greece) during growing seasons 2015 and 2016, providing a great amount of near-real-time information concerning rice crops. Highlights of significant results are provided, with particular focus on real-world applications of ERMES products and services. Although developed with focus on European rice cultivations, solutions implemented in the ERMES system can be, and are already being, adapted to other crops and/or areas of the world, thus making it a valuable testing bed for the development of advanced, integrated agricultural monitoring systems.

Shared feature representations of LiDAR and optical images: Trading sparsity for semantic discrimination

This paper studies the level of complementary information conveyed by extremely high resolution LiDAR and optical images. We pursue this goal following an indirect approach via unsupervised spatial-spectral feature extraction. We used a recently presented unsupervised convolutional neural network trained to enforce both population and lifetime spar-sity in the feature representation. We derived independent and joint feature representations, and analyzed the sparsity scores and the discriminative power. Interestingly, the obtained results revealed that the RGB+LiDAR representation is no longer sparse, and the derived basis functions merge color and elevation yielding a set of more expressive colored edge filters. The joint feature representation is also more discriminative when used for clustering and topological data visualization.

Development of an earth observation processing chain for crop bio-physical parameters at local scale

This paper proposes a full Earth observation processing chaing for biophysical parameter estimation at local scales. In particular, we focus on the Leaf Area Index (LAI) as an essential climate variable required for the monitoring and modeling of land surfaces at local scale. The main goal of this study is tied to the use of optical satellite images to retrieve Earth Observation (EO) biophysical parameters able to describe the spatio-temporal changes in agro-ecosystems at local scale. The objective of this work is two-fold: (i) to set up and update the EO products processing chain at high resolution (local) scale; and (ii) derive multitemporal LAI maps at 30 m resolution to be fed into a crop model. The processing chain includes the combination of surface reflectance products from Landat 7 ETM+ and Landsat 8 OLI. The results of the processing chain used and the retrieval approach are encouraging for crop monitoring at local scale.

Derivation of global vegetation biophysical parameters from EUMETSAT Polar System

Abstract This paper presents the algorithm developed in LSA-SAF (Satellite Application Facility for Land Surface Analysis) for the derivation of global vegetation parameters from the AVHRR (Advanced Very High Resolution Radiometer) sensor on board MetOp (Meteorological–Operational) satellites forming the EUMETSAT (European Organization for the Exploitation of Meteorological Satellites) Polar System (EPS). The suite of LSA-SAF EPS vegetation products includes the leaf area index (LAI), the fractional vegetation cover (FVC), and the fraction of absorbed photosynthetically active radiation (FAPAR). LAI, FAPAR, and FVC characterize the structure and the functioning of vegetation and are key parameters for a wide range of land–biosphere applications. The algorithm is based on a hybrid approach that blends the generalization capabilities offered by physical radiative transfer models with the accuracy and computational efficiency of machine learning methods. One major feature is the implementation of multi-output retrieval methods able to jointly and more consistently estimate all the biophysical parameters at the same time. We propose a multi-output Gaussian process regression (GPRmulti), which outperforms other considered methods over PROSAIL (coupling of PROSPECT and SAIL (Scattering by Arbitrary Inclined Leaves) radiative transfer models) EPS simulations. The global EPS products include uncertainty estimates taking into account the uncertainty captured by the retrieval method and input errors propagation. A sensitivity analysis is performed to assess several sources of uncertainties in retrievals and maximize the positive impact of modeling the noise in training simulations. The paper discusses initial validation studies and provides details about the characteristics and overall quality of the products, which can be of interest to assist the successful use of the data by a broad user’s community. The consistent generation and distribution of the EPS vegetation products will constitute a valuable tool for monitoring of earth surface dynamic processes.

A Critical Comparison of Remote Sensing Leaf Area Index Estimates over Rice-Cultivated Areas: From Sentinel-2 and Landsat-7/8 to MODIS, GEOV1 and EUMETSAT Polar System

Leaf area index (LAI) is a key biophysical variable fundamental in natural vegetation and agricultural land monitoring and modelling studies. This paper is aimed at comparing, validating and discussing different LAI satellite products from operational services and customized solution based on innovative Earth Observation (EO) data such as Landsat-7/8 and Sentinel-2A. The comparison was performed to assess overall quality of LAI estimates for rice, as a fundamental input of different scale (regional to local) operational crop monitoring systems such as the ones developed during the “An Earth obseRvation Model based RicE information Service” (ERMES) project. We adopted a multiscale approach following international recognized protocols of the Committee on Earth Observation Satellites (CEOS) Land Product Validation (LPV) guidelines in different steps: (1) acquisition of representative field sample measurements, (2) validation of decametric satellite product (10–30 m spatial resolution), and (3) exploitation of such data to assess quality of medium-resolution operational products (~1000 m). The study areas were located in the main European rice areas in Spain, Italy and Greece. Field campaigns were conducted during three entire rice seasons (2014, 2015 and 2016—from sowing to full-flowering) to acquire multi-temporal ground LAI measurements and to assess Landsat-7/8 LAI estimates. Results highlighted good correspondence between Landsat-7/8 LAI estimates and ground measurements revealing high correlations (R2 ≥ 0.89) and low root mean squared errors (RMSE ≤ 0.75) in all seasons. Landsat-7/8 as well as Sentinel-2A high-resolution LAI retrievals, were compared with satellite LAI products operationally derived from MODIS (MOD15A2), Copernicus PROBA-V (GEOV1), and the recent EUMETSAT Polar System (EPS) LAI product. Good agreement was observed between high- and medium-resolution LAI estimates. In particular, the EPS LAI product was the most correlated product with both Landsat/7-8 and Sentinel-2A estimates, revealing R2 ≥ 0.93 and RMSE ≤ 0.53 m2/m2. In addition, a comparison exercise of EPS, GEOV1 and MODIS revealed high correlations (R2 ≥ 0.90) and RMSE ≤ 0.80 m2/m2 in all cases and years. The temporal assessment shows that the three satellite products capture well the seasonality during the crop phenological cycle. Discrepancies are observed mainly in absolute values retrieved for the peak of rice season. This is the first study that provides a quantitative assessment on the quality of available operational LAI product for rice monitoring to both the scientific community and users of agro-monitoring operational services.

Spatial Rice Yield Estimation Based on MODIS and Sentinel-1 SAR Data and ORYZA Crop Growth Model

Crop insurance is a viable solution to reduce the vulnerability of smallholder farmers to risks from pest and disease outbreaks, extreme weather events, and market shocks that threaten their household food and income security. In developing and emerging countries, the implementation of area yield-based insurance, the form of crop insurance preferred by clients and industry, is constrained by the limited availability of detailed historical yield records. Remote-sensing technology can help to fill this gap by providing an unbiased and replicable source of the needed data. This study is dedicated to demonstrating and validating the methodology of remote sensing and crop growth model-based rice yield estimation with the intention of historical yield data generation for application in crop insurance. The developed system combines MODIS and SAR-based remote-sensing data to generate spatially explicit inputs for rice using a crop growth model. MODIS reflectance data were used to generate multitemporal LAI maps using the inverted Radiative Transfer Model (RTM). SAR data were used to generate rice area maps using MAPScape-RICE to mask LAI map products for further processing, including smoothing with logistic function and running yield simulation using the ORYZA crop growth model facilitated by the Rice Yield Estimation System (Rice-YES). Results from this study indicate that the approach of assimilating MODIS and SAR data into a crop growth model can generate well-adjusted yield estimates that adequately describe spatial yield distribution in the study area while reliably replicating official yield data with root mean square error, RMSE, of 0.30 and 0.46 t ha−1 (normalized root mean square error, NRMSE of 5% and 8%) for the 2016 spring and summer seasons, respectively, in the Red River Delta of Vietnam, as evaluated at district level aggregation. The information from remote-sensing technology was also useful for identifying geographic locations with peculiarity in the timing of rice establishment, leaf growth, and yield level, and thus contributing to the spatial targeting of further investigation and interventions needed to reduce yield gaps.