Decision Trees Tutorial 17: Conclusion

Decision Trees Tutorial > Conclusion

What have we looked at?

  • Decision tree learning is one of the most important techniques in machine learning and data mining. It is a supervised technique that is often used when a disjunction of hypothese is required or when dealing (not exclusively) with categorical attributes.
  • We build decision trees in order to capture underlying relaltionships in a datset. This can help us in classification and prediction as well as in data visualisation. It is preferrable largely because of the intuitive tree representationsof data that it produces.
  • Many possible trees can be built that perfectly classify a given dataset. It is often preferrable to have small trees as they are easier to understand.
  • Various algorithms exist to construct Decision Trees. All of them need some sort of criteria for selecting attributes to split data on. We looked at Information Gain, Gain Ratio and the use of the chi-squared distribution.
  • Overfitting is a problem which can occur when constructing trees that capture the training data too closely.
  • We can prune decision trees to stop them overfitting the training data. This leads to better accuracy in prediction as well as smaller trees.
  • Hybrid methods exist with other machine learning schemes.
  • Decision Tree Learning compares well with other machine learning methods.

Hopefully you will have grasped the concepts and techniques without being too bored :) Thanks!

6 Responses to Decision Trees Tutorial 17: Conclusion

  1. Wolex says:

    Thank you for the simplified tutorial. I will however appreciate it more if you can include a topic on ROC (Receiver Operating Characteristics).

  2. Newbie says:

    I liked this tutorial very much. Helped me understand the main concept. I wish there were others like this for other machine learning techniques. Thanks.

  3. Anonymous says:

    Excellent way to make understand a complex topic like decision trees. Looking forward to see more tutorials like this on other models too. Thanks.

  4. Anonymous says:

    Oh my God! this tutorial has been very helpful. I have learnt so much.

    However, I would have love to see how to assess the performance measures of the tree, with respect to accuracy/profit or loss, stability, lift and simplicity nonetheless I really enjoyed going through this tutorial.

    Thanks and God Bless!

  5. Joe Zanotti says:

    A decision tree can be used to classify an example by starting at the root of the tree and moving through it until a leaf node, which provides the classification of the instance. Joe Zanotti

  6. Anonymous says:

    I have found the Tutorial and especially the Interactive Exercises very helpful! Thank you and well done!

Leave a Reply to Wolex Cancel reply

Your email address will not be published. Required fields are marked *

* Copy This Password *

* Type Or Paste Password Here *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>