Martín Montalvo

Automatic detection of crop rows in maize fields with high weeds pressure

This paper proposes a new method, oriented to crop row detection in images from maize fields with high weed pressure. The vision system is designed to be installed onboard a mobile agricultural vehicle, i.e. submitted to gyros, vibrations and undesired movements. The images are captured under image perspective, being affected by the above undesired effects. The image processing consists of three main processes: image segmentation, double thresholding, based on the Otsus method, and crop row detection. Image segmentation is based on the application of a vegetation index, the double thresholding achieves the separation between weeds and crops and the crop row detection applies least squares linear regression for line adjustment. Crop and weed separation becomes effective and the crop row detection can be favorably compared against the classical approach based on the Hough transform. Both gain effectiveness and accuracy thanks to the double thresholding that makes the main finding of the paper.

Support Vector Machines for crop/weeds identification in maize fields

In Precision Agriculture (PA) automatic image segmentation for plant identification is an important issue to be addressed. Emerging technologies in optical imaging sensors play an important role in PA. In maize fields, site-specific treatments, with chemical products or mechanical manipulations, are applied for weeds elimination. Maize is an irrigated crop, also unprotected from rainfall. After a strong rain, soil materials (particularly clays) mixed with water impregnate the vegetative cover. The green spectral component associated to the plants is masked by the dominant red spectral component coming from soil materials. This makes methods based on the greenness identification fail under such situations. We propose a new method based on Support Vector Machines for identifying plants with green spectral components masked and unmasked. The method is also valid for post-treatment evaluation, where loss of greenness in weeds is identified with the effectiveness of the treatment and in crops with damage or masking. The performance of the method allows to verify its viability for automatic tasks in agriculture based on image processing.

Automatic expert system for weeds/crops identification in images from maize fields

Automation for the identification of plants, based on imaging sensors, in agricultural crops represents an important challenge. In maize fields, site-specific treatments, with chemical products or mechanical manipulations, can be applied for weeds elimination. This requires the identification of weeds and crop plants. Sometimes these plants appear impregnated by materials coming from the soil (particularly clays). This appears when the field is irrigated or after rain, particularly when the water falls with some force. This makes traditional approaches based on images greenness identification fail under such situations. Indeed, most pixels belonging to plants, but impregnated, are misidentified as soil pixels because they have lost their natural greenness. This loss of greenness also occurs after treatment when weeds have begun the process of death. To correctly identify all plants, independently of the loss of greenness, we design an automatic expert system based on image segmentation procedures. The performance of this method is verified favorably.

Automatic expert system based on images for accuracy crop row detection in maize fields

This paper proposes an automatic expert system for accuracy crop row detection in maize fields based on images acquired from a vision system. Different applications in maize, particularly those based on site specific treatments, require the identification of the crop rows. The vision system is designed with a defined geometry and installed onboard a mobile agricultural vehicle, i.e. submitted to vibrations, gyros or uncontrolled movements. Crop rows can be estimated by applying geometrical parameters under image perspective projection. Because of the above undesired effects, most often, the estimation results inaccurate as compared to the real crop rows. The proposed expert system exploits the human knowledge which is mapped into two modules based on image processing techniques. The first one is intended for separating green plants (crops and weeds) from the rest (soil, stones and others). The second one is based on the system geometry where the expected crop lines are mapped onto the image and then a correction is applied through the well-tested and robust Theil-Sen estimator in order to adjust them to the real ones. Its performance is favorably compared against the classical Pearson product-moment correlation coefficient.

A new Expert System for greenness identification in agricultural images

Highlights? We design an Expert System for plant discrimination in agricultural fields. ? A decision making module determines the image quality. ? A greenness identification module extracts green plants. ? The Expert System is valid under adverse conditions and different devices. ? Plants segmentation is required for weeds specific treatments. It is well-known that one important issue emerging strongly in agriculture is related with the automation of tasks, where camera-based sensors play an important role. They provide images that must be conveniently processed. The most relevant image processing procedures require the identification of green plants, in our experiments they comes from barley and maize fields including weeds, so that some type of action can be carried out, including site-specific treatments with chemical products or mechanical manipulations.The images come from outdoor environments, which are affected for a high variability of illumination conditions because of sunny or cloudy days or both with high rate of changes.Several indices have been proposed in the literature for greenness identification, but under adverse environmental conditions most of them fail or do not work properly. This is true even for camera devices with auto-image white balance.This paper proposes a new automatic and robust Expert System for greenness identification. It consists of two main modules: (1) decision making, based on image histogram analysis and (2) greenness identification, where two different strategies are proposed, the first based on classical greenness identification methods and the second inspired on the Fuzzy Clustering approach. The Expert System design as a whole makes a contribution, but the Fuzzy Clustering strategy makes the main finding of this paper. The system is tested for different images captured with several camera devices.

Camera Sensor Arrangement for Crop/Weed Detection Accuracy in Agronomic Images

In Precision Agriculture, images coming from camera-based sensors are commonly used for weed identification and crop line detection, either to apply specific treatments or for vehicle guidance purposes. Accuracy of identification and detection is an important issue to be addressed in image processing. There are two main types of parameters affecting the accuracy of the images, namely: (a) extrinsic, related to the sensors positioning in the tractor; (b) intrinsic, related to the sensor specifications, such as CCD resolution, focal length or iris aperture, among others. Moreover, in agricultural applications, the uncontrolled illumination, existing in outdoor environments, is also an important factor affecting the image accuracy. This paper is exclusively focused on two main issues, always with the goal to achieve the highest image accuracy in Precision Agriculture applications, making the following two main contributions: (a) camera sensor arrangement, to adjust extrinsic parameters and (b) design of strategies for controlling the adverse illumination effects.

Crop Row Detection in Maize Fields Inspired on the Human Visual Perception

This paper proposes a new method, oriented to image real-time processing, for identifying crop rows in maize fields in the images. The vision system is designed to be installed onboard a mobile agricultural vehicle, that is, submitted to gyros, vibrations, and undesired movements. The images are captured under image perspective, being affected by the above undesired effects. The image processing consists of two main processes: image segmentation and crop row detection. The first one applies a threshold to separate green plants or pixels (crops and weeds) from the rest (soil, stones, and others). It is based on a fuzzy clustering process, which allows obtaining the threshold to be applied during the normal operation process. The crop row detection applies a method based on image perspective projection that searches for maximum accumulation of segmented green pixels along straight alignments. They determine the expected crop lines in the images. The method is robust enough to work under the above-mentioned undesired effects. It is favorably compared against the well-tested Hough transformation for line detection.

Machine-Vision Systems Selection for Agricultural Vehicles: A Guide

Machine vision systems are becoming increasingly common onboard agricultural vehicles (autonomous and non-autonomous) for different tasks. This paper provides guidelines for selecting machine-vision systems for optimum performance, considering the adverse conditions on these outdoor environments with high variability on the illumination, irregular terrain conditions or different plant growth states, among others. In this regard, three main topics have been conveniently addressed for the best selection: (a) spectral bands (visible and infrared); (b) imaging sensors and optical systems (including intrinsic parameters) and (c) geometric visual system arrangement (considering extrinsic parameters and stereovision systems). A general overview, with detailed description and technical support, is provided for each topic with illustrative examples focused on specific applications in agriculture, although they could be applied in different contexts other than agricultural. A case study is provided as a result of research in the RHEA (Robot Fleets for Highly Effective Agriculture and Forestry Management) project for effective weed control in maize fields (wide-rows crops), funded by the European Union, where the machine vision system onboard the autonomous vehicles was the most important part of the full perception system, where machine vision was the most relevant. Details and results about crop row detection, weed patches identification, autonomous vehicle guidance and obstacle detection are provided together with a review of methods and approaches on these topics.

Curved and straight crop row detection by accumulation of green pixels from images in maize fields

This study proposes a new method for detecting curved and straight crop rows in images captured in maize fields during the initial growth stages of crop and weed plants. The images were obtained under perspective projection with a camera installed onboard and conveniently arranged at the front of a tractor. The final goal was the identification of the crop rows which are crucial for precise autonomous guidance and site-specific treatments, including weed removal based on the identification of plants outside the crop rows. Image quality is affected by uncontrolled lighting conditions in outdoor agricultural environments and by gaps in the crop rows (due to lack of germination or defects during planting). Also, different plants heights and volumes occur due to different growth stages affecting the crop row detection process. The proposed method was designed with the required robustness to cope with the above undesirable situations and it consists of three sequentially linked phases: (i) image segmentation, (ii) identification of starting points and (iii) crop row detection. The main contribution is the ability of the method to detect curved crop rows as well as straights rows even with irregular inter-row spaces. The method performance has been tested in terms of accuracy and time processing.

Identification of Plant Textures in Agricultural Images by Principal Component Analysis

In precision agriculture the extraction of green parts is a very important task. One of the biggest issues, when it comes to computer vision, is image segmentation, which has motivated the research conducted in this work. Our goal is the segmentation of vegetative and soil parts in the images. For this proposal a novel method of segmentation is defined in which different vegetation indices are calculated and through the reduction of components by principal component analysis (PCA) we obtain an enhanced greyscale image. Finally, by Otsu thresholding, we binarize the grayscale image isolating the green parts from the other elements in the image.