María Guijarro

Automatic detection of crop rows in maize fields with high weeds pressure

This paper proposes a new method, oriented to crop row detection in images from maize fields with high weed pressure. The vision system is designed to be installed onboard a mobile agricultural vehicle, i.e. submitted to gyros, vibrations and undesired movements. The images are captured under image perspective, being affected by the above undesired effects. The image processing consists of three main processes: image segmentation, double thresholding, based on the Otsus method, and crop row detection. Image segmentation is based on the application of a vegetation index, the double thresholding achieves the separation between weeds and crops and the crop row detection applies least squares linear regression for line adjustment. Crop and weed separation becomes effective and the crop row detection can be favorably compared against the classical approach based on the Hough transform. Both gain effectiveness and accuracy thanks to the double thresholding that makes the main finding of the paper.

Support Vector Machines for crop/weeds identification in maize fields

In Precision Agriculture (PA) automatic image segmentation for plant identification is an important issue to be addressed. Emerging technologies in optical imaging sensors play an important role in PA. In maize fields, site-specific treatments, with chemical products or mechanical manipulations, are applied for weeds elimination. Maize is an irrigated crop, also unprotected from rainfall. After a strong rain, soil materials (particularly clays) mixed with water impregnate the vegetative cover. The green spectral component associated to the plants is masked by the dominant red spectral component coming from soil materials. This makes methods based on the greenness identification fail under such situations. We propose a new method based on Support Vector Machines for identifying plants with green spectral components masked and unmasked. The method is also valid for post-treatment evaluation, where loss of greenness in weeds is identified with the effectiveness of the treatment and in crops with damage or masking. The performance of the method allows to verify its viability for automatic tasks in agriculture based on image processing.

Automatic expert system for weeds/crops identification in images from maize fields

Automation for the identification of plants, based on imaging sensors, in agricultural crops represents an important challenge. In maize fields, site-specific treatments, with chemical products or mechanical manipulations, can be applied for weeds elimination. This requires the identification of weeds and crop plants. Sometimes these plants appear impregnated by materials coming from the soil (particularly clays). This appears when the field is irrigated or after rain, particularly when the water falls with some force. This makes traditional approaches based on images greenness identification fail under such situations. Indeed, most pixels belonging to plants, but impregnated, are misidentified as soil pixels because they have lost their natural greenness. This loss of greenness also occurs after treatment when weeds have begun the process of death. To correctly identify all plants, independently of the loss of greenness, we design an automatic expert system based on image segmentation procedures. The performance of this method is verified favorably.

Automatic expert system based on images for accuracy crop row detection in maize fields

This paper proposes an automatic expert system for accuracy crop row detection in maize fields based on images acquired from a vision system. Different applications in maize, particularly those based on site specific treatments, require the identification of the crop rows. The vision system is designed with a defined geometry and installed onboard a mobile agricultural vehicle, i.e. submitted to vibrations, gyros or uncontrolled movements. Crop rows can be estimated by applying geometrical parameters under image perspective projection. Because of the above undesired effects, most often, the estimation results inaccurate as compared to the real crop rows. The proposed expert system exploits the human knowledge which is mapped into two modules based on image processing techniques. The first one is intended for separating green plants (crops and weeds) from the rest (soil, stones and others). The second one is based on the system geometry where the expected crop lines are mapped onto the image and then a correction is applied through the well-tested and robust Theil-Sen estimator in order to adjust them to the real ones. Its performance is favorably compared against the classical Pearson product-moment correlation coefficient.

A new Expert System for greenness identification in agricultural images

Highlights? We design an Expert System for plant discrimination in agricultural fields. ? A decision making module determines the image quality. ? A greenness identification module extracts green plants. ? The Expert System is valid under adverse conditions and different devices. ? Plants segmentation is required for weeds specific treatments. It is well-known that one important issue emerging strongly in agriculture is related with the automation of tasks, where camera-based sensors play an important role. They provide images that must be conveniently processed. The most relevant image processing procedures require the identification of green plants, in our experiments they comes from barley and maize fields including weeds, so that some type of action can be carried out, including site-specific treatments with chemical products or mechanical manipulations.The images come from outdoor environments, which are affected for a high variability of illumination conditions because of sunny or cloudy days or both with high rate of changes.Several indices have been proposed in the literature for greenness identification, but under adverse environmental conditions most of them fail or do not work properly. This is true even for camera devices with auto-image white balance.This paper proposes a new automatic and robust Expert System for greenness identification. It consists of two main modules: (1) decision making, based on image histogram analysis and (2) greenness identification, where two different strategies are proposed, the first based on classical greenness identification methods and the second inspired on the Fuzzy Clustering approach. The Expert System design as a whole makes a contribution, but the Fuzzy Clustering strategy makes the main finding of this paper. The system is tested for different images captured with several camera devices.

A Hopfield Neural Network for combining classifiers applied to textured images

In this paper we propose a new method for combining simple classifiers through the analogue Hopfield Neural Network (HNN) optimization paradigm for classifying natural textures in images. The base classifiers are the Fuzzy clustering (FC) and the parametric Bayesian estimator (BP). An initial unsupervised training phase determines the number of clusters and estimates the parameters for both FC and BP. Then a decision phase is carried out, where we build as many Hopfield Neural Networks as the available number of clusters. The number of nodes at each network is the number of pixels in the image which is to be classified. Each node at each network is initially loaded with a state value, which is the membership degree (provided by FC) that the node (pixel) belongs to the cluster associated to the network. Each state is later iteratively updated during the HNN optimization process taking into account the previous states and two types of external influences exerted by other nodes in its neighborhood. The external influences are mapped as consistencies. One is embedded in an energy term which considers the states of the node to be updated and the states of its neighbors. The other is mapped as the inter-connection weights between the nodes. From BP, we obtain the probabilities that the nodes (pixels) belong to a cluster (network). We define these weights as a relation between states and probabilities between the nodes in the neighborhood of the node which is being updated. This is the classifier combination, making the main finding of this paper. The proposed combined strategy based on the HNN outperforms the simple classifiers and also classical combination strategies.

A Multi-Agent System Architecture for Sensor Networks

The design of the control systems for sensor networks presents important challenges. Besides the traditional problems about how to process the sensor data to obtain the target information, engineers need to consider additional aspects such as the heterogeneity and high number of sensors, and the flexibility of these networks regarding topologies and the sensors in them. Although there are partial approaches for resolving these issues, their integration relies on ad hoc solutions requiring important development efforts. In order to provide an effective approach for this integration, this paper proposes an architecture based on the multi-agent system paradigm with a clear separation of concerns. The architecture considers sensors as devices used by an upper layer of manager agents. These agents are able to communicate and negotiate services to achieve the required functionality. Activities are organized according to roles related with the different aspects to integrate, mainly sensor management, data processing, communication and adaptation to changes in the available devices and their capabilities. This organization largely isolates and decouples the data management from the changing network, while encouraging reuse of solutions. The use of the architecture is facilitated by a specific modelling language developed through metamodelling. A case study concerning a generic distributed system for fire fighting illustrates the approach and the comparison with related work.

Camera Sensor Arrangement for Crop/Weed Detection Accuracy in Agronomic Images

In Precision Agriculture, images coming from camera-based sensors are commonly used for weed identification and crop line detection, either to apply specific treatments or for vehicle guidance purposes. Accuracy of identification and detection is an important issue to be addressed in image processing. There are two main types of parameters affecting the accuracy of the images, namely: (a) extrinsic, related to the sensors positioning in the tractor; (b) intrinsic, related to the sensor specifications, such as CCD resolution, focal length or iris aperture, among others. Moreover, in agricultural applications, the uncontrolled illumination, existing in outdoor environments, is also an important factor affecting the image accuracy. This paper is exclusively focused on two main issues, always with the goal to achieve the highest image accuracy in Precision Agriculture applications, making the following two main contributions: (a) camera sensor arrangement, to adjust extrinsic parameters and (b) design of strategies for controlling the adverse illumination effects.

Mapping Wide Row Crops with Video Sequences Acquired from a Tractor Moving at Treatment Speed

This paper presents a mapping method for wide row crop fields. The resulting map shows the crop rows and weeds present in the inter-row spacing. Because field videos are acquired with a camera mounted on top of an agricultural vehicle, a method for image sequence stabilization was needed and consequently designed and developed. The proposed stabilization method uses the centers of some crop rows in the image sequence as features to be tracked, which compensates for the lateral movement (sway) of the camera and leaves the pitch unchanged. A region of interest is selected using the tracked features, and an inverse perspective technique transforms the selected region into a bird’s-eye view that is centered on the image and that enables map generation. The algorithm developed has been tested on several video sequences of different fields recorded at different times and under different lighting conditions, with good initial results. Indeed, lateral displacements of up to 66% of the inter-row spacing were suppressed through the stabilization process, and crop rows in the resulting maps appear straight.

Crop Row Detection in Maize Fields Inspired on the Human Visual Perception

This paper proposes a new method, oriented to image real-time processing, for identifying crop rows in maize fields in the images. The vision system is designed to be installed onboard a mobile agricultural vehicle, that is, submitted to gyros, vibrations, and undesired movements. The images are captured under image perspective, being affected by the above undesired effects. The image processing consists of two main processes: image segmentation and crop row detection. The first one applies a threshold to separate green plants or pixels (crops and weeds) from the rest (soil, stones, and others). It is based on a fuzzy clustering process, which allows obtaining the threshold to be applied during the normal operation process. The crop row detection applies a method based on image perspective projection that searches for maximum accumulation of segmented green pixels along straight alignments. They determine the expected crop lines in the images. The method is robust enough to work under the above-mentioned undesired effects. It is favorably compared against the well-tested Hough transformation for line detection.