Prototypes Reduction and Feature Selection based on Fuzzy Boundary Area for Nearest Neighbor Classifiers

Abstract

For prototype-based classifiers, the number of prototypes results in increasing the computational time so that it takes very long time for a prototype-based classifier to determine the class label of an associated data. Many researchers have been interested in the reduction of the number of prototypes without degradation of the classification ability of prototype-based classifiers. In this paper, we introduce a new method for generating prototypes based on the assumption that the prototypes positioned near the boundary surface are important for improving the classification abilities of nearest neighbor classifiers. The main issue of this paper is how to locate the new prototypes as close as possible to the boundary surface. To realize this, we consider possibilistic C-Means clustering and conditional C-Means clustering. The clusters obtained by using possibilistic C-Means clustering methods are used to define the boundary areas, and the conditional fuzzy C-Means clustering technique is used to determine the locations of prototypes within the already defined boundary areas. The design procedure is illustrated with the aid of numeric examples that provide a thorough insight into the effectiveness of the proposed method.