Novel Algorithms for Knowledge Discovery from Neural Networks in Classification Problems

Abstract

Large datasets encompass hidden trends which convey valuable knowledge about the dataset. Data mining research deals with extraction of useful and valuable information from such large datasets. The process of data mining can be viewed as exploration and analysis of large quantities of data, by automatic or semiautomatic means, in order to discover meaningful patterns and rules. One of the newlinemost important function of data mining is classification. It recognizes patterns that newlinedescribe the group to which an item belongs. It does this by examining existing newlineitems that already have been classified and inferring a set of rules. Artificial neural newlinenetworks have been widely used to develop highly accurate classifiers for the realworld newlineproblem domains using different learning algorithms. newlineEventhough there exists a lot of learning algorithms for neural networks to resolve newlinedifferent types of problems, still the artificial intelligence incorporated in the newlineneural network is only to the level of tapeworm. Researches are going, in different newlinedirections by finding new preprocessing methods, topology and rule extraction algorithms to maximize the classification accuracy and to extract the knowledge in newlinethe form of rules to classify the real life complex problems. In this research, focus newlinehas been given to overcome the problems faced in classification using neural networks, newlineand new novel algorithms have been proposed for the success of feedforward neural networks on classification problems. newlineThe thesis first proposes discretization algorithms for preprocessing the data for neural networks classifier. The proposed algorithms discretize the data based on newlinethe mean value / the range coefficient of dispersion and skewness. They automate newlinethe discretization process by computing the number of intervals and stopping criterion. newlineThe Backpropagation(BP) with momentum training algorithm and conjugate gradient training algorithm are used to compute the accuracy of classification on feedforward neural network from thedata discretized by these algorithms