Alejandro Cervantes

AMPSO: A New Particle Swarm Method for Nearest Neighborhood Classification

Nearest prototype methods can be quite successful on many pattern classification problems. In these methods, a collection of prototypes has to be found that accurately represents the input patterns. The classifier then assigns classes based on the nearest prototype in this collection. In this paper, we first use the standard particle swarm optimizer (PSO) algorithm to find those prototypes. Second, we present a new algorithm, called adaptive Michigan PSO (AMPSO) in order to reduce the dimension of the search space and provide more flexibility than the former in this application. AMPSO is based on a different approach to particle swarms as each particle in the swarm represents a single prototype in the solution. The swarm does not converge to a single solution; instead, each particle is a local classifier, and the whole swarm is taken as the solution to the problem. It uses modified PSO equations with both particle competition and cooperation and a dynamic neighborhood. As an additional feature, in AMPSO, the number of prototypes represented in the swarm is able to adapt to the problem, increasing as needed the number of prototypes and classes of the prototypes that make the solution to the problem. We compared the results of the standard PSO and AMPSO in several benchmark problems from the University of California, Irvine, data sets and find that AMPSO always found a better solution than the standard PSO. We also found that it was able to improve the results of the Nearest Neighbor classifiers, and it is also competitive with some of the algorithms most commonly used for classification.

A comparison between the Pittsburgh and Michigan approaches for the binary PSO algorithm

This paper shows the performance of the binary PSO algorithm as a classification system. These systems are classified in two different perspectives: the Pittsburgh and the Michigan approaches. In order to implement the Michigan approach binary PSO algorithm, the standard PSO dynamic equations are modified, introducing a repulsive force to favor particle competition. A dynamic neighborhood, adapted to classification problems, is also defined. Both classifiers are tested using a reference set of problems, where both classifiers achieve better performance than many classification techniques. The Michigan PSO classifier shows clear advantages over the Pittsburgh one both in terms of success rate and speed. The Michigan PSO can also be generalized to the continuous version of the PSO

Optimizing the DFCN Broadcast Protocol with a Parallel Cooperative Strategy of Multi-Objective Evolutionary Algorithms

This work presents the application of a parallel cooperative optimization approach to the broadcast operation in mobile ad-hoc networks ( manet s). The optimization of the broadcast operation implies satisfying several objectives simultaneously, so a multi-objective approach has been designed. The optimization lies on searching the best configurations of the dfcn broadcast protocol for a given manet scenario. The cooperation of a team of multi-objective evolutionary algorithms has been performed with a novel optimization model. Such model is a hybrid parallel algorithm that combines a parallel island-based scheme with a hyperheuristic approach. Results achieved by the algorithms in different stages of the search process are analyzed in order to grant more computational resources to the most suitable algorithms. The obtained results for a manet s scenario, representing a mall, demonstrate the validity of the new proposed approach.

An Adaptive Michigan Approach PSO for Nearest Prototype Classification

Nearest Prototype methods can be quite successful on many pattern classification problems. In these methods, a collection of prototypes has to be found that accurately represents the input patterns. The classifier then assigns classes based on the nearest prototype in this collection. In this paper we develop a new algorithm (called AMPSO), based on the Particle Swarm Optimization (PSO) algorithm, that can be used to find those prototypes. Each particle in a swarm represents a single prototype in the solution; the swarm evolves using modified PSO equations with both particle competition and cooperation. Experimentation includes an artificial problem and six common application problems from the UCI data sets. The results show that the AMPSO algorithm is able to find solutions with a reduced number of prototypes that classify data with comparable or better accuracy than the 1-NN classifier. The algorithm can also be compared or improves the results of many classical algorithms in each of those problems; and the results show that AMPSO also performs significantly better than any tested algorithm in one of the problems.

Michigan Particle Swarm Optimization for Prototype Reduction in Classification Problems

This paper presents a new approach to Particle Swarm Optimization, called Michigan Approach PSO (MPSO), and its application to continuous classification problems as a Nearest Prototype (NP) classifier. In Nearest Prototype classifiers, a collection of prototypes has to be found that accurately represents the input patterns. The classifier then assigns classes based on the nearest prototype in this collection. The MPSO algorithm is used to process training data to find those prototypes. In the MPSO algorithm each particle in a swarm represents a single prototype in the solution and it uses modified movement rules with particle competition and cooperation that ensure particle diversity. The proposed method is tested both with artificial problems and with real benchmark problems and compared with several algorithms of the same family. Results show that the particles are able to recognize clusters, find decision boundaries and reach stable situations that also retain adaptation potential. The MPSO algorithm is able to improve the accuracy of 1-NN classifiers, obtains results comparable to the best among other classifiers, and improves the accuracy reported in literature for one of the problems.

A novel multiobjective formulation of the robust software project scheduling problem

The Software Project Scheduling (SPS) problem refers to the distribution of tasks during a software project lifetime. Software development involves managing human resources and a total budget in an optimal way for a successful project which, in turn, demonstrates the importance of the SPS problem for software companies. This paper proposes a novel formulation for the SPS problem which takes into account actual issues such as the productivity of the employees at performing different tasks. The formulation also provides project managers with robust solutions arising from an analysis of the inaccuracies in task-cost estimations. An experimental study is presented which compares the resulting project plans and analyses the performance of four different well-know evolutionary algorithms over two sets of realistic instances representing the problem. Statistical parameters are also provided in order to help the project manager in the decision process.

Multiobjective Algorithms Hybridization to Optimize Broadcasting Parameters in Mobile Ad-Hoc Networks

The aim os this paper is to study the hybridization of two multi-objective algorithms in the context of a real problem, the MANETs problem. The algorithms studied are Particle Swarm Optimization (MOPSO) and a new multiobjective algorithm based in the combination of NSGA-II with Evolution Strategies (ESN). This work analyzes the improvement produced by hybridization over the Paretos fronts compared with the non-hybridized algorithms. The purpose of this work is to validate how hybridization of two evolutionary algorithms of different families may help to solve certain problems together in the context of MANETs problem. The hybridization used for this work consists on a sequential execution of the two algorithms and using the final population of the first algorithm as initial population of the second one.

Building Nearest Prototype Classifiers Using a Michigan Approach PSO

This paper presents an application of particle swarm optimization (PSO) to continuous classification problems, using a Michigan approach. In this work, PSO is used to process training data to find a reduced set of prototypes to be used to classify the patterns, maintaining or increasing the accuracy of the nearest neighbor classifiers. The Michigan approach PSO represents each prototype by a particle and uses modified movement rules with particle competition and cooperation that ensure particle diversity. The result is that the particles are able to recognize clusters, find decision boundaries and achieve stable situations that also retain adaptation potential. The proposed method is tested both with artificial problems and with three real benchmark problems with quite promising results

Learning from non-stationary data using a growing network of prototypes

Learning from non-stationary data requires methods that are able to deal with a continuous stream of data instances, possibly of infinite size, where the class distributions are potentially drifting over time. For handling such datasets, we are proposing a new method that incrementally creates and adapts a network of prototypes for classifying complex data received in an online fashion. The algorithm includes both an accuracy-based and time-based forgetting mechanisms that ensure that the model size does not grow indefinitely with large datasets. We have performed tests on seven benchmarking datasets for comparing our proposal with several approaches found in the literature, including ensemble algorithms associated to two different base classifiers. Performances obtained show that our algorithm is comparable to the best of the ensemble classifiers in terms of accuracy/time trade-off. Moreover, our approach appears to have significant advantages for dealing with data that has a complex, non-linearly separable topology.

Metaheuristic approaches for optimal broadcasting design in metropolitan MANETs

Mobile Ad-hoc Networks (MANETs) are composed of a set of communicating devices which are able to spontaneously interconnect without any pre-existing infrastructure. In such scenario, broadcasting becomes an operation of tremendous importance for the own existence and operation of the network. Optimizing a broadcasting strategy in MANETs is a multiobjective problem accounting for three goals: reaching as many stations as possible, minimizing the network utilization, and reducing the duration of the operation itself. This research, which has been developed within the OPLINK project (http://oplink.lcc.uma.es), faces a wide study about this problem in metropolitan MANETs with up to seven different advanced multiobjective metaheuristics. They all compute Pareto fronts of solutions which empower a human designer with the ability of choosing the preferred configuration for the network. The quality of these fronts is evaluated by using the hypervolume metric. The obtained results show that the SPEA2 algorithm is the most accurate metaheuristic for solving the broadcasting problem.