Jorge Torres-Sánchez

Configuration and Specifications of an Unmanned Aerial Vehicle (UAV) for Early Site Specific Weed Management

A new aerial platform has risen recently for image acquisition, the Unmanned Aerial Vehicle (UAV). This article describes the technical specifications and configuration of a UAV used to capture remote images for early season site- specific weed management (ESSWM). Image spatial and spectral properties required for weed seedling discrimination were also evaluated. Two different sensors, a still visible camera and a six-band multispectral camera, and three flight altitudes (30, 60 and 100 m) were tested over a naturally infested sunflower field. The main phases of the UAV workflow were the following: 1) mission planning, 2) UAV flight and image acquisition, and 3) image pre-processing. Three different aspects were needed to plan the route: flight area, camera specifications and UAV tasks. The pre-processing phase included the correct alignment of the six bands of the multispectral imagery and the orthorectification and mosaicking of the individual images captured in each flight. The image pixel size, area covered by each image and flight timing were very sensitive to flight altitude. At a lower altitude, the UAV captured images of finer spatial resolution, although the number of images needed to cover the whole field may be a limiting factor due to the energy required for a greater flight length and computational requirements for the further mosaicking process. Spectral differences between weeds, crop and bare soil were significant in the vegetation indices studied (Excess Green Index, Normalised Green-Red Difference Index and Normalised Difference Vegetation Index), mainly at a 30 m altitude. However, greater spectral separability was obtained between vegetation and bare soil with the index NDVI. These results suggest that an agreement among spectral and spatial resolutions is needed to optimise the flight mission according to every agronomical objective as affected by the size of the smaller object to be discriminated (weed plants or weed patches).

Weed Mapping in Early-Season Maize Fields Using Object-Based Analysis of Unmanned Aerial Vehicle (UAV) Images

The use of remote imagery captured by unmanned aerial vehicles (UAV) has tremendous potential for designing detailed site-specific weed control treatments in early post-emergence, which have not possible previously with conventional airborne or satellite images. A robust and entirely automatic object-based image analysis (OBIA) procedure was developed on a series of UAV images using a six-band multispectral camera (visible and near-infrared range) with the ultimate objective of generating a weed map in an experimental maize field in Spain. The OBIA procedure combines several contextual, hierarchical and object-based features and consists of three consecutive phases: 1) classification of crop rows by application of a dynamic and auto-adaptive classification approach, 2) discrimination of crops and weeds on the basis of their relative positions with reference to the crop rows, and 3) generation of a weed infestation map in a grid structure. The estimation of weed coverage from the image analysis yielded satisfactory results. The relationship of estimated versus observed weed densities had a coefficient of determination of r2=0.89 and a root mean square error of 0.02. A map of three categories of weed coverage was produced with 86% of overall accuracy. In the experimental field, the area free of weeds was 23%, and the area with low weed coverage (<5% weeds) was 47%, which indicated a high potential for reducing herbicide application or other weed operations. The OBIA procedure computes multiple data and statistics derived from the classification outputs, which permits calculation of herbicide requirements and estimation of the overall cost of weed management operations in advance.

An automatic object-based method for optimal thresholding in UAV images

An automatic thresholding algorithm was developed in an OBIA framework.The algorithm was tested in UAV images acquired on different herbaceous row crops.The main objective was to accurately discriminate vegetation vs bare soil.Classification accuracies about 90% were achieved.Two cameras were tested on board the UAV: visible, and visible+infrared. In precision agriculture, detecting the vegetation in herbaceous crops in early season is a first and crucial step prior to addressing further objectives such as counting plants for germination monitoring, or detecting weeds for early season site specific weed management. The ultra-high resolution of UAV images, and the powerful tools provided by the Object Based Image Analysis (OBIA) are the key in achieving this objective. The present research work develops an innovative thresholding OBIA algorithm based on the Otsus method, and studies how the results of this algorithm are affected by the different segmentation parameters (scale, shape and compactness). Along with the general description of the procedure, it was specifically applied for vegetation detection in remotely-sensed images captured with two sensors (a conventional visible camera and a multispectral camera) mounted on an Unmanned Aerial Vehicle (UAV) and acquired over fields of three different herbaceous crops (maize, sunflower and wheat). The tests analyzed the performance of the OBIA algorithm for classifying vegetation coverage as affected by different automatically selected thresholds calculated in the images of two vegetation indices: the Excess Green (ExG) and the Normalized Difference Vegetation Index (NDVI). The segmentation scale parameter affected the vegetation index histograms, which led to changes in the automatic estimation of the optimal threshold value for the vegetation indices. The other parameters involved in the segmentation procedure (i.e., shape and compactness) showed minor influence on the classification accuracy. Increasing the object size, the classification error diminished until an optimum was reached. After this optimal value, increasing object size produced bigger errors.

High-Throughput 3-D Monitoring of Agricultural-Tree Plantations with Unmanned Aerial Vehicle (UAV) Technology

The geometric features of agricultural trees such as canopy area, tree height and crown volume provide useful information about plantation status and crop production. However, these variables are mostly estimated after a time-consuming and hard field work and applying equations that treat the trees as geometric solids, which produce inconsistent results. As an alternative, this work presents an innovative procedure for computing the 3-dimensional geometric features of individual trees and tree-rows by applying two consecutive phases: 1) generation of Digital Surface Models with Unmanned Aerial Vehicle (UAV) technology and 2) use of object-based image analysis techniques. Our UAV-based procedure produced successful results both in single-tree and in tree-row plantations, reporting up to 97% accuracy on area quantification and minimal deviations compared to in-field estimations of tree heights and crown volumes. The maps generated could be used to understand the linkages between tree grown and field-related factors or to optimize crop management operations in the context of precision agriculture with relevant agro-environmental implications.

Selecting patterns and features for between- and within- crop-row weed mapping using UAV-imagery

The problem of remote weed mapping via machine learning is considered.Unmanned aerial vehicles are used to capture maize and sunflower field images.The proposed method considers pattern and feature selection techniques.The final model requires few user information to generalise to new areas.There are features of great influence for the classification of both crops. This paper approaches the problem of weed mapping for precision agriculture, using imagery provided by Unmanned Aerial Vehicles (UAVs) from sunflower and maize crops. Precision agriculture referred to weed control is mainly based on the design of early post-emergence site-specific control treatments according to weed coverage, where one of the most important challenges is the spectral similarity of crop and weed pixels in early growth stages. Our work tackles this problem in the context of object-based image analysis (OBIA) by means of supervised machine learning methods combined with pattern and feature selection techniques, devising a strategy for alleviating the user intervention in the system while not compromising the accuracy. This work firstly proposes a method for choosing a set of training patterns via clustering techniques so as to consider a representative set of the whole field data spectrum for the classification method. Furthermore, a feature selection method is used to obtain the best discriminating features from a set of several statistics and measures of different nature. Results from this research show that the proposed method for pattern selection is suitable and leads to the construction of robust sets of data. The exploitation of different statistical, spatial and texture metrics represents a new avenue with huge potential for between and within crop-row weed mapping via UAV-imagery and shows good synergy when complemented with OBIA. Finally, there are some measures (specially those linked to vegetation indexes) that are of great influence for weed mapping in both sunflower and maize crops.

Quantifying efficacy and limits of unmanned aerial vehicle (UAV) technology for weed seedling detection as affected by sensor resolution.

In order to optimize the application of herbicides in weed-crop systems, accurate and timely weed maps of the crop-field are required. In this context, this investigation quantified the efficacy and limitations of remote images collected with an unmanned aerial vehicle (UAV) for early detection of weed seedlings. The ability to discriminate weeds was significantly affected by the imagery spectral (type of camera), spatial (flight altitude) and temporal (the date of the study) resolutions. The colour-infrared images captured at 40 m and 50 days after sowing (date 2), when plants had 5–6 true leaves, had the highest weed detection accuracy (up to 91%). At this flight altitude, the images captured before date 2 had slightly better results than the images captured later. However, this trend changed in the visible-light images captured at 60 m and higher, which had notably better results on date 3 (57 days after sowing) because of the larger size of the weed plants. Our results showed the requirements on spectral and spatial resolutions needed to generate a suitable weed map early in the growing season, as well as the best moment for the UAV image acquisition, with the ultimate objective of applying site-specific weed management operations.

A semi-supervised system for weed mapping in sunflower crops using unmanned aerial vehicles and a crop row detection method

Graphical abstractDisplay Omitted HighlightsThe problem of constructing a weed mapping model via machine learning techniques is assessed.The combination of spectral properties with vegetation indexes and crop rows helps the prediction.A semi-supervised classifier has been proved to perform well for the classification problem assessed with very few information provided by the user.An extended experimental design for weed mapping could be performed considering other crops. This paper presents a system for weed mapping, using imagery provided by unmanned aerial vehicles (UAVs). Weed control in precision agriculture is based on the design of site-specific control treatments according to weed coverage. A key component is precise and timely weed maps, and one of the crucial steps is weed monitoring, by ground sampling or remote detection. Traditional remote platforms, such as piloted planes and satellites, are not suitable for early weed mapping, given their low spatial and temporal resolutions. Nonetheless, the ultra-high spatial resolution provided by UAVs can be an efficient alternative. The proposed method for weed mapping partitions the image and complements the spectral information with other sources of information. Apart from the well-known vegetation indexes, which are commonly used in precision agriculture, a method for crop row detection is proposed. Given that crops are always organised in rows, this kind of information simplifies the separation between weeds and crops. Finally, the system incorporates classification techniques for the characterisation of pixels as crop, soil and weed. Different machine learning paradigms are compared to identify the best performing strategies, including unsupervised, semi-supervised and supervised techniques. The experiments study the effect of the flight altitude and the sensor used. Our results show that an excellent performance is obtained using very few labelled data complemented with unlabelled data (semi-supervised approach), which motivates the use of weed maps to design site-specific weed control strategies just when farmers implement the early post-emergence weed control.

Assessing Optimal Flight Parameters for Generating Accurate Multispectral Orthomosaicks by UAV to Support Site-Specific Crop Management

This article describes the technical specifications and configuration of a multirotor unmanned aerial vehicle (UAV) to acquire remote images using a six-band multispectral sensor. Several flight missions were programmed as follows: three flight altitudes (60, 80 and 100 m), two flight modes (stop and cruising modes) and two ground control point (GCP) settings were considered to analyze the influence of these parameters on the spatial resolution and spectral discrimination of multispectral orthomosaicked images obtained using Pix4Dmapper. Moreover, it is also necessary to consider the area to be covered or the flight duration according to any flight mission programmed. The effect of the combination of all these parameters on the spatial resolution and spectral discrimination of the orthomosaicks is presented. Spectral discrimination has been evaluated for a specific agronomical purpose: to use the UAV remote images for the detection of bare soil and vegetation (crop and weeds) for in-season site-specific weed management. These results show that a balance between spatial resolution and spectral discrimination is needed to optimize the mission planning and image processing to achieve every agronomic objective. In this way, users do not have to sacrifice flying at low altitudes to cover the whole area of interest completely.

Accurate ortho-mosaicked six-band multispectral UAV images as affected by mission planning for precision agriculture proposes

ABSTRACT Weed mapping at very early phenological stages of crop and weed plants for site-specific weed management can be achieved by using ultra-high spatial and high spectral resolution imagery provided by multispectral sensors on-board an unmanned aerial vehicle (UAV). These UAV images cannot cover the whole field, resulting in the need to take a sequence of multiple overlapped images. Therefore, the overlapped images must be oriented and ortho-rectified to create an accurate ortho-mosaicked image of the entire field for further classification. Because the spatial quality of ortho-mosaicked images mainly depend on the flight altitude and percentage of overlap, this paper describes the effect of flight parameters using a multirotor UAV and a multispectral camera on the mosaicking workflow. The objective is to define the best configuration for the mission planning to generate accurate ortho-images. A set of flights with a range of altitudes (30, 40, 50, 60, 70, 80, and 90 m) above ground level (AGL) and two end-lap and side-lap settings (60–30% and 70–40%) were studied. The spatial accuracy of ortho-mosaics was evaluated taking into consideration the ASPRS test. The results showed that the best flight setting to keep the spatial accuracy in the bundle adjustment was 70–40% overlap and altitudes AGL ranging from 60 to 90 m. At these flight altitudes, the spatial resolution was quite similar, making it possible to optimize the mission planning, flying at a higher altitude and increasing the area overflow without decreasing the ortho-mosaic spatial quality. This study has relevant implications for further use in detecting weed seedlings in crops.

An Automatic Random Forest-OBIA Algorithm for Early Weed Mapping between and within Crop Rows Using UAV Imagery

Accurate and timely detection of weeds between and within crop rows in the early growth stage is considered one of the main challenges in site-specific weed management (SSWM). In this context, a robust and innovative automatic object-based image analysis (OBIA) algorithm was developed on Unmanned Aerial Vehicle (UAV) images to design early post-emergence prescription maps. This novel algorithm makes the major contribution. The OBIA algorithm combined Digital Surface Models (DSMs), orthomosaics and machine learning techniques (Random Forest, RF). OBIA-based plant heights were accurately estimated and used as a feature in the automatic sample selection by the RF classifier; this was the second research contribution. RF randomly selected a class balanced training set, obtained the optimum features values and classified the image, requiring no manual training, making this procedure time-efficient and more accurate, since it removes errors due to a subjective manual task. The ability to discriminate weeds was significantly affected by the imagery spatial resolution and weed density, making the use of higher spatial resolution images more suitable. Finally, prescription maps for in-season post-emergence SSWM were created based on the weed maps—the third research contribution—which could help farmers in decision-making to optimize crop management by rationalization of the herbicide application. The short time involved in the process (image capture and analysis) would allow timely weed control during critical periods, crucial for preventing yield loss.