Fuzzy Pattern Trees

Machine Learning Method for Classification and Regression

 

Fuzzy pattern tree induction was recently introduced as a novel machine learning method for classification. Roughly speaking, a pattern tree is a hierarchical, tree-like structure, whose inner nodes are marked with generalized (fuzzy) logical operators and whose leaf nodes are associated with fuzzy predicates on input attributes. A pattern tree classifier is composed of an ensemble of such pattern trees, one for each class label. This type of classifier is interesting for several reasons. For example, since a single pattern tree can be considered as a kind of logical description of a class, it is quite appealing from an interpretation point of view. Moreover, in terms of classification accuracy, the method has shown promising performance in first experimental studies.

 

Evolving Fuzzy Pattern Trees

 

In the context of data streams, the aspect of efficiency plays an important role, since learning has to be accomplished under hard time (and memory) constraints. Moreover, a learning algorithm should be adaptive in the sense that an up-to-date model is offered at any time, taking new data items into consideration as soon as they arrive and perhaps forgetting old ones that have become obsolete due to a change of the underlying data generating process. To meet these requirements, we develop an evolving version of fuzzy pattern tree learning, in which model adaptation is realized by anticipating possible local changes of the current model, and confirming these changes through statistical hypothesis testing.

 

Related Publications

 
R. Senge and E. Hüllermeier.
Top-Down Induction of Fuzzy Pattern Trees.
IEEE Transactions on Fuzzy Systems, Volume 19, Issue 2, Pages 241-252.
[ Draft-PDF ]
 
R. Senge and E. Hüllermeier.
Pattern Trees for Regression and Fuzzy Systems Modeling.
Proc. WCCI-2010, World Congress on Computational Intelligence.
Barcelona, July 2010.
PDF ] [  Slides/fileadmin-eim/informatik/fg/is/Software/fpt/FPT_WCCI2010.ppsx ] 
 
E. Hüllermeier.
Fuzzy Sets in Machine Learning and Data Mining.
Applied Soft Computing Journal, 11:1493-1505, 2011.
Draft-PDF ]
 

A. Shaker, R. Senge, E. Hüllermeier.
Evolving Fuzzy Pattern Trees for Binary Classification on Data Streams.
Information Sciences, 220:34–45, 2013.

Draft-PDF ]

Related Software


Implementation of Fuzzy Pattern Trees for the WEKA machine learning framework.
Fuzzy Pattern Trees for Classification and Regression ]
 
Implementation of the Evolving Fuzzy Pattern Trees for Binary Classification on Data Streams, the development is done for MOA and WEKA.
Evolving Fuzzy Pattern Trees]
 
Implementation of a graphical user interface for visualization and expert interaction.
[ link is coming soon... ]
 
Screenshot: Structural Visualization
 
Screenshot: Decision Boundary Visualization

 

Further information: