Byoung-Jun Park

Polynomial neural networks architecture: analysis and design

Abstract In this study, we introduce and investigate a class of neural architectures of Polynomial Neural Networks (PNNs), discuss a comprehensive design methodology and carry out a series of numeric experiments. Two kinds of PNN architectures, namely a basic PNN and a modified PNN architecture are discussed. Each of them comes with two types such as the generic and the advanced type. The essence of the design procedure dwells on the Group Method of Data Handling. PNN is a flexible neural architecture whose structure is developed through learning. In particular, the number of layers of the PNN is not fixed in advance but becomes dynamically meaning that the network grows over the training period. In this sense, PNN is a self-organizing network. A comparative analysis shows that the proposed PNN are models with higher accuracy than other fuzzy models.

Fuzzy polynomial neural networks: hybrid architectures of fuzzy modeling

We introduce a concept of fuzzy polynomial neural networks (FPNNs), a hybrid modeling architecture combining polynomial neural networks (PNNs) and fuzzy neural networks (FNNs). The development of the FPNNs dwells on the technologies of computational intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms. The structure of the FPNN results from a synergistic usage of FNN and PNN. FNNs contribute to the formation of the premise part of the rule-based structure of the FPNN. The consequence part of the FPNN is designed using PNNs. The structure of the PNN is not fixed in advance as it usually takes place in the case of conventional neural networks, but becomes organized dynamically to meet the required approximation error. We exploit a group method of data handling (GMDH) to produce this dynamic topology of the network. The performance of the FPNN is quantified through experimentation that exploits standard data already used in fuzzy modeling. The obtained experimental results reveal that the proposed networks exhibit high accuracy and generalization capabilities in comparison to other similar fuzzy models.

Self-organizing neurofuzzy networks in modeling software data

Experimental software data sets describing software projects in terms of their complexity and development time have been a subject of intensive modeling. A number of various modeling methodologies and modeling designs have been proposed including neural networks, fuzzy, and neurofuzzy models. In this study, we introduce a concept of Self-organizing neurofuzzy networks (SONFN), a hybrid modeling architecture combining neurofuzzy networks (NFN) and polynomial neural networks (PNN). The development of the SONFN dwells on the technologies of Computational Intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms. The architecture of the SONFN results from a synergistic usage of neurofuzzy networks (NFNs) and polynomial neural networks (PNNs). NFNs contribute to the formation of the premise part of the rule-based structure of the SONFN. The consequence part of the SONFN is designed using PNNs. We discuss two classes of SONFN architectures and propose comprehensive learning algorithms. The experimental results include well-known software data such as the NASA data set concerning software cost estimation and the one describing software modules of the Medical Imaging System (MIS).

Hybrid identification of fuzzy rule‐based models

In this study, we propose a hybrid identification algorithm for a class of fuzzy rule‐based systems. The rule‐based fuzzy modeling concerns structure optimization and parameter identification using the fuzzy inference methods and hybrid structure combined with two methods of optimization theories for nonlinear systems. Two types of inference methods of a fuzzy model concern a simplified and linear type of inference. The proposed hybrid optimal identification algorithm is carried out using a combination of genetic algorithms and an improved complex method. The genetic algorithms determine initial parameters of the membership function of the premise part of the fuzzy rules. In the sequel, the improved complex method (being in essence a powerful auto‐tuning algorithm) leads to fine‐tuning of the parameters of the respective membership functions. An aggregate performance index with a weighting factor is proposed in order to achieve a balance between performance of the fuzzy model obtained for the training and testing data. Numerical examples are included to evaluate the performance of the proposed model. They are also contrasted with the performance of the fuzzy models existing in the literature.

Multilayer hybrid fuzzy neural networks: synthesis via technologies of advanced computational intelligence

In this paper, we develop an advanced architecture and come up with a comprehensive design methodology of genetically optimized hybrid fuzzy neural networks (gHFNNs). The construction of gHFNN exploits fundamental technologies of computational intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms (GAs). The architecture of the gHFNN results from a highly synergistic usage of the genetic optimization-driven hybrid system being generated by combining fuzzy neural networks (FNNs) with polynomial neural networks (PNN). FNN contributes to the formation of the premise part of the overall network structure of the gHFNN. The consequence part of the gHFNN is designed using PNNs. The optimization of the FNN is realized with the aid of a standard backpropagation learning algorithm and genetic optimization. As the consequence part of the gHFNN, the development of the PNN dwells on two general optimization mechanisms: the structural optimization is realized via GAs whereas in the case of the parametric optimization we proceed with a standard least square method-based learning (optimization). Through the consecutive process of such structural and parametric optimization, an optimized PNN becomes generated in a dynamic fashion. To evaluate the performance of the gHFNNs, we experimented with a number of representative numerical examples. A comparative analysis demonstrates that the proposed gHFNNs are neurofuzzy systems with higher accuracy as well as more superb predictive capability than other models available in the literature

Self-organizing neurofuzzy networks based on evolutionary fuzzy granulation

Experimental software datasets describing software projects in terms of their complexity and development time have been a subject of intensive modeling. A number of various modeling methodologies and modeling designs have been proposed including such development frameworks as neural networks, fuzzy and neurofuzzy models. In this study, we introduce a concept of self-organizing neurofuzzy networks (SONFN), a hybrid modeling architecture combining neurofuzzy networks (NFN) and polynomial neural networks (PNN). For these networks we develop a comprehensive design methodology. The construction of SONFNs takes advantage of the well-established technologies of computational intelligence (CI), namely fuzzy sets, neural networks and genetic algorithms. The architecture of the SONFN results from a synergistic usage of NFNs and PNNs. NFN contributes to the formation of the premise part of the rule-based structure of the SONFN. The consequence part of the SONFN is designed using PNNs. We discuss two types of SONFN architectures whose taxonomy is based on the NFN scheme being applied to the premise part of SONFN. We introduce a comprehensive learning algorithm. It is shown that this network exhibits a dynamic structure as the number of its layers as well as the number of nodes in each layer of the SONFN are not predetermined (as this is the case in a popular topology of a multilayer perceptron). The experimental results include a well-known NASA dataset concerning software cost estimation.

Relation-based neurofuzzy networks with evolutionary data granulation

In this study, we introduce a concept of self-organizing neurofuzzy networks (SONFN), a hybrid modeling architecture combining relation-based neurofuzzy networks (NFN) and self-organizing polynomial neural networks (PNN). For such networks we develop a comprehensive design methodology and carry out a series of numeric experiments using data coming from the area of software engineering. The construction of SONFNs exploits fundamental technologies of computational intelligence (CI), namely fuzzy sets, neural networks, and genetic algorithms. The architecture of the SONFN results from a synergistic usage of NFN and PNN. NFN contributes to the formation of the premise part of the rule-based structure of the SONFN. The consequence part of the SONFN is designed using PNNs. We discuss two types of SONFN architectures with the taxonomy based on the NFN scheme being applied to the premise part of SONFN and propose a comprehensive learning algorithm. It is shown that this network exhibits a dynamic structure as the number of its layers as well as the number of nodes in each layer of the SONFN are not predetermined (as this is usually the case for a popular topology of a multilayer perceptron). The experimental results deal with well-known software data such as the NASA dataset concerning software cost estimation and the one describing software modules of the medical imaging system (MIS). In comparison with the previously discussed approaches, the self-organizing networks are more accurate and exhibit superb generalization capabilities.

The hybrid multi-layer inference architecture and algorithm of FPNN based on FNN and PNN

The study is concerned with an approach to the design of a new category of fuzzy neural networks. The proposed Fuzzy Polynomial Neural Networks (FPNN) with hybrid multi-layer inference architecture is based on fuzzy neural networks (FNN) and polynomial neural networks (PNN) for model identification of complex and nonlinear systems. The one and the other are considered as premise and consequence part of FPNN respectively. Therefore, the proposed FPNN is available effectively for multi-input variables and high-order polynomial according to the combination of FNN and PNN. We introduce two kinds of FPNN architectures, namely the basic and modified architectures depending on the connection points (nodes) of the layer of FNN. Owing to the specific features of two combined architectures, it is possible to consider the nonlinear characteristics of process and to get output performance with superb predictive ability. The availability and feasibility of the FPNN is discussed and illustrated with the aid of two representative numerical examples. The results show that the proposed FPNN can produce a model with higher accuracy and predictive ability than any other method presented previously.

A Design of Dynamically Simultaneous Search GA-based Fuzzy Neural Networks: Comparative Analysis and Interpretation

In this paper, we introduce advanced architectures of genetically-oriented Fuzzy Neural Networks (FNNs) based on fuzzy set and fuzzy relation and discuss a comprehensive design methodology. The proposed FNNs are based on ‘if-then’ rule-based networks with the extended structure of the premise and the consequence parts of the fuzzy rules. We consider two types of the FNNs topologies, called here FSNN and FRNN, depending upon the usage of inputs in the premise of fuzzy rules. Three different type of polynomials function (namely, constant, linear, and quadratic) are used to construct the consequence of the rules. In order to improve the accuracy of FNNs, the structure and the parameters are optimized by making use of genetic algorithms (GAs). We enhance the search capabilities of the GAs by introducing the dynamic variants of genetic optimization. It fully exploits the processing capabilities of the FNNs by supporting their structural and parametric optimization. To evaluate the performance of the proposed FNNs, we exploit a suite of several representative numerical examples and its experimental results are compared with those reported in the previous studies.

Design of Polynomial Neural Network Classifier for Pattern Classification with Two Classes

Polynomial networks have been known to have excellent properties as classifiers and universal approximators to the optimal Bayes classifier. In this paper, the use of polynomial neural networks is proposed for efficient implementation of the polynomial-based classifiers. The polynomial neural network is a trainable device consisting of some rules and three processes. The three processes are assumption, effect, and fuzzy inference. The assumption process is driven by fuzzy c-means and the effect processes deals with a polynomial function. A learning algorithm for the polynomial neural network is developed and its performance is compared with that of previous studies.