Starting from:

$30

DT and AdaBoost

DT and AdaBoost
1. Here is some randomly generated data for two classes, A and B, with eight boolean attributes.Generate the first two levels of a decision tree for these classes. Specifically, you should identifywhich of the eight attributes to test first, based on information gain, and for either value of thatattribute, which one to test next - then, for each of these four cases, which prediction to give (A orB). It is suggested (but not necessary) you write some code to help you, you can use this code laterin your second programming project.
2. If you were to run Adaboost on the preceding problem, using decision stumps, assuming the use ofinformation gain, consider the first iteration of the Adaboost algorithm. The first stump should bethe same as the root of your previous tree. (R&N 751) Now:
a. What would the error rate of the first stump be?
b. What would be the hypothesis weight of the first stump?
c. What would be the initial weights of each example?
d. What would be the new weights of each example that was correctly classified, and each thatwas incorrectly classified?

More products