Wei-Neng Chen

An Ant Colony Optimization Approach to a Grid Workflow Scheduling Problem With Various QoS Requirements

Grid computing is increasingly considered as a promising next-generation computational platform that supports wide-area parallel and distributed computing. In grid environments, applications are always regarded as workflows. The problem of scheduling workflows in terms of certain quality of service (QoS) requirements is challenging and it significantly influences the performance of grids. By now, there have been some algorithms for grid workflow scheduling, but most of them can only tackle the problems with a single QoS parameter or with small-scale workflows. In this frame, this paper aims at proposing an ant colony optimization (ACO) algorithm to schedule large-scale workflows with various QoS parameters. This algorithm enables users to specify their QoS preferences as well as define the minimum QoS thresholds for a certain application. The objective of this algorithm is to find a solution that meets all QoS constraints and optimizes the user-preferred QoS parameter. Based on the characteristics of workflow scheduling, we design seven new heuristics for the ACO approach and propose an adaptive scheme that allows artificial ants to select heuristics based on pheromone values. Experiments are done in ten workflow applications with at most 120 tasks, and the results demonstrate the effectiveness of the proposed algorithm.

Particle Swarm Optimization With an Aging Leader and Challengers

In nature, almost every organism ages and has a limited lifespan. Aging has been explored by biologists to be an important mechanism for maintaining diversity. In a social animal colony, aging makes the old leader of the colony become weak, providing opportunities for the other individuals to challenge the leadership position. Inspired by this natural phenomenon, this paper transplants the aging mechanism to particle swarm optimization (PSO) and proposes a PSO with an aging leader and challengers (ALC-PSO). ALC-PSO is designed to overcome the problem of premature convergence without significantly impairing the fast-converging feature of PSO. It is characterized by assigning the leader of the swarm with a growing age and a lifespan, and allowing the other individuals to challenge the leadership when the leader becomes aged. The lifespan of the leader is adaptively tuned according to the leaders leading power. If a leader shows strong leading power, it lives longer to attract the swarm toward better positions. Otherwise, if a leader fails to improve the swarm and gets old, new particles emerge to challenge and claim the leadership, which brings in diversity. In this way, the concept “aging” in ALC-PSO actually serves as a challenging mechanism for promoting a suitable leader to lead the swarm. The algorithm is experimentally validated on 17 benchmark functions. Its high performance is confirmed by comparing with eight popular PSO variants.

A Novel Set-Based Particle Swarm Optimization Method for Discrete Optimization Problems

Particle swarm optimization (PSO) is predominately used to find solutions for continuous optimization problems. As the operators of PSO are originally designed in an n-dimensional continuous space, the advancement of using PSO to find solutions in a discrete space is at a slow pace. In this paper, a novel set-based PSO (S-PSO) method for the solutions of some combinatorial optimization problems (COPs) in discrete space is presented. The proposed S-PSO features the following characteristics. First, it is based on using a set-based representation scheme that enables S-PSO to characterize the discrete search space of COPs. Second, the candidate solution and velocity are defined as a crisp set, and a set with possibilities, respectively. All arithmetic operators in the velocity and position updating rules used in the original PSO are replaced by the operators and procedures defined on crisp sets, and sets with possibilities in S-PSO. The S-PSO method can thus follow a similar structure to the original PSO for searching in a discrete space. Based on the proposed S-PSO method, most of the existing PSO variants, such as the global version PSO, the local version PSO with different topologies, and the comprehensive learning PSO (CLPSO), can be extended to their corresponding discrete versions. These discrete PSO versions based on S-PSO are tested on two famous COPs: the traveling salesman problem and the multidimensional knapsack problem. Experimental results show that the discrete version of the CLPSO algorithm based on S-PSO is promising.

Ant Colony Optimization for Software Project Scheduling and Staffing with an Event-Based Scheduler

Research into developing effective computer aided techniques for planning software projects is important and challenging for software engineering. Different from projects in other fields, software projects are people-intensive activities and their related resources are mainly human resources. Thus, an adequate model for software project planning has to deal with not only the problem of project task scheduling but also the problem of human resource allocation. But as both of these two problems are difficult, existing models either suffer from a very large search space or have to restrict the flexibility of human resource allocation to simplify the model. To develop a flexible and effective model for software project planning, this paper develops a novel approach with an event-based scheduler (EBS) and an ant colony optimization (ACO) algorithm. The proposed approach represents a plan by a task list and a planned employee allocation matrix. In this way, both the issues of task scheduling and employee allocation can be taken into account. In the EBS, the beginning time of the project, the time when resources are released from finished tasks, and the time when employees join or leave the project are regarded as events. The basic idea of the EBS is to adjust the allocation of employees at events and keep the allocation unchanged at nonevents. With this strategy, the proposed method enables the modeling of resource conflict and task preemption and preserves the flexibility in human resource allocation. To solve the planning problem, an ACO algorithm is further designed. Experimental results on 83 instances demonstrate that the proposed method is very promising.

Distributed evolutionary algorithms and their models

Graphical abstractDisplay Omitted HighlightsProvide an updated and systematic review of distributed evolutionary algorithms.Classify the models into population and dimension-distributed groups semantically.Analyze the parallelism, search behaviors, communication costs, scalability, etc.Highlight recent research hotspots in this field.Discuss challenges and potential research directions in this field. The increasing complexity of real-world optimization problems raises new challenges to evolutionary computation. Responding to these challenges, distributed evolutionary computation has received considerable attention over the past decade. This article provides a comprehensive survey of the state-of-the-art distributed evolutionary algorithms and models, which have been classified into two groups according to their task division mechanism. Population-distributed models are presented with master-slave, island, cellular, hierarchical, and pool architectures, which parallelize an evolution task at population, individual, or operation levels. Dimension-distributed models include coevolution and multi-agent models, which focus on dimension reduction. Insights into the models, such as synchronization, homogeneity, communication, topology, speedup, advantages and disadvantages are also presented and discussed. The study of these models helps guide future development of different and/or improved algorithms. Also highlighted are recent hotspots in this area, including the cloud and MapReduce-based implementations, GPU and CUDA-based implementations, distributed evolutionary multiobjective optimization, and real-world applications. Further, a number of future research directions have been discussed, with a conclusion that the development of distributed evolutionary computation will continue to flourish.

Differential Evolution With Two-Level Parameter Adaptation

The performance of differential evolution (DE) largely depends on its mutation strategy and control parameters. In this paper, we propose an adaptive DE (ADE) algorithm with a new mutation strategy DE/lbest/1 and a two-level adaptive parameter control scheme. The DE/lbest/1 strategy is a variant of the greedy DE/best/1 strategy. However, the population is mutated under the guide of multiple locally best individuals in DE/lbest/1 instead of one globally best individual in DE/best/1. This strategy is beneficial to the balance between fast convergence and population diversity. The two-level adaptive parameter control scheme is implemented mainly in two steps. In the first step, the population-level parameters Fp and CRp for the whole population are adaptively controlled according to the optimization states, namely, the exploration state and the exploitation state in each generation. These optimization states are estimated by measuring the population distribution. Then, the individual-level parameters Fi and CRi for each individual are generated by adjusting the population-level parameters. The adjustment is based on considering the individuals fitness value and its distance from the globally best individual. This way, the parameters can be adapted to not only the overall state of the population but also the characteristics of different individuals. The performance of the proposed ADE is evaluated on a suite of benchmark functions. Experimental results show that ADE generally outperforms four state-of-the-art DE variants on different kinds of optimization problems. The effects of ADE components, parameter properties of ADE, search behavior of ADE, and parameter sensitivity of ADE are also studied. Finally, we investigate the capability of ADE for solving three real-world optimization problems.

Optimizing Discounted Cash Flows in Project Scheduling—An Ant Colony Optimization Approach

The multimode resource-constrained project-scheduling problem with discounted cash flows (MRCPSPDCF) is important and challenging for project management. As the problem is strongly nondeterministic polynomial-time hard, only a few algorithms exist and the performance is still not satisfying. To design an effective algorithm for the MRCPSPDCF, this paper proposes an ant colony optimization (ACO) approach. ACO is promising for the MRCPSPDCF due to the following three reasons. First, MRCPSPDCF can be formulated as a graph-based search problem, which ACO has been found to be good at solving. Second, the mechanism of ACO enables the use of domain-based heuristics to accelerate the search. Furthermore, ACO has found good results for the classical single-mode scheduling problems. But the utility of ACO for the much more difficult MRCPSPDCF is still unexplored. In this paper, we first convert the precedence network of the MRCPSPDCF into a mode-on-node (MoN) graph, which becomes the construction graph for ACO. Eight domain-based heuristics are designed to consider the factors of time, cost, resources, and precedence relations. Among these heuristics, the hybrid heuristic that combines different factors together performs well. The proposed algorithm is compared with two different genetic algorithms (GAs), a simulated annealing (SA) algorithm, and a tabu search (TS) algorithm on 55 random instances with at least 13 and up to 98 activities. Experimental results show that the proposed ACO algorithm outperforms the GA, SA, and TS approaches on most cases.

Bi-Velocity Discrete Particle Swarm Optimization and Its Application to Multicast Routing Problem in Communication Networks

This paper proposes a novel bi-velocity discrete particle swarm optimization (BVDPSO) approach and extends its application to the nondeterministic polynomial (NP) complete multicast routing problem (MRP). The main contribution is the extension of particle swarm optimization (PSO) from the continuous domain to the binary or discrete domain. First, a novel bi-velocity strategy is developed to represent the possibilities of each dimension being 1 and 0. This strategy is suitable to describe the binary characteristic of the MRP, where 1 stands for a node being selected to construct the multicast tree, whereas 0 stands for being otherwise. Second, BVDPSO updates the velocity and position according to the learning mechanism of the original PSO in the continuous domain. This maintains the fast convergence speed and global search ability of the original PSO. Experiments are comprehensively conducted on all of the 58 instances with small, medium, and large scales in the Operation Research Library (OR-library). The results confirm that BVDPSO can obtain optimal or near-optimal solutions rapidly since it only needs to generate a few multicast trees. BVDPSO outperforms not only several state-of-the-art and recent heuristic algorithms for the MRP problems, but also algorithms based on genetic algorithms, ant colony optimization, and PSO.

A novel discrete particle swarm optimization to solve traveling salesman problem

Particle swarm optimization (PSO), which simulates the unpredictable flight of a bird flock, is one of the intelligent computation algorithms. PSO is well-known to solve the continuous problems, yet by proper modification, it can also be applied to discrete problems, such as the classical test model: traveling salesman problem (TSP). In this paper, a novel discrete PSO call C3DPSO for TSP, with modified update formulas and a new parameter c3 (called mutation factor, to help to keep the balance between exploitation and exploration), is proposed. In the new algorithm, the particle is not a permutation of numbers but a set of edges, which is different from most other algorithms for TSP. However, it still keeps the most important characteristics of PSO that the whole swarm is guided by pbest and gbest. According to some benchmarks in TSP lib, it is proved that the proposed PSO works well even with 200 cities.

Adaptive Multimodal Continuous Ant Colony Optimization

Seeking multiple optima simultaneously, which multimodal optimization aims at, has attracted increasing attention but remains challenging. Taking advantage of ant colony optimization (ACO) algorithms in preserving high diversity, this paper intends to extend ACO algorithms to deal with multimodal optimization. First, combined with current niching methods, an adaptive multimodal continuous ACO algorithm is introduced. In this algorithm, an adaptive parameter adjustment is developed, which takes the difference among niches into consideration. Second, to accelerate convergence, a differential evolution mutation operator is alternatively utilized to build base vectors for ants to construct new solutions. Then, to enhance the exploitation, a local search scheme based on Gaussian distribution is self-adaptively performed around the seeds of niches. Together, the proposed algorithm affords a good balance between exploration and exploitation. Extensive experiments on 20 widely used benchmark multimodal functions are conducted to investigate the influence of each algorithmic component and results are compared with several state-of-the-art multimodal algorithms and winners of competitions on multimodal optimization. These comparisons demonstrate the competitive efficiency and effectiveness of the proposed algorithm, especially in dealing with complex problems with high numbers of local optima.