ARCHIVE Snapshot of the Rätsch lab website (Tübingen, then New York) as of February 2016: preserved, not maintained. The group today: bmi.inf.ethz.ch
Personal tools
Home → Rätsch Lab → People → Gunnar Rätsch, Ph.D. → Publications → Ensemble Learning Methods for Classification
Navigation
 

Gunnar Rätsch (1998)

Ensemble Learning Methods for Classification

Diplom thesis, University of Potsdam, Neues Palais 10, Potsdam.

In this thesis ensemble learning methods for classification are presented, especially AdaBoost and Arcing algorithms are analyzed. It is theoretically shown why AdaBoost and Arcing are working well and explained what kind of target function is optimized. It is pointed out that AdaBoost's optimization is similar to a annealing process and linear programming. From an asymptotic analysis of AdaBoost's learning process it is shown that those algorithms are not noise robust asymptotically. In order to get a noise robustness, several improvements of AdaBoost are proposed. The concept of slack variables is introduced into AdaBoost and is motivated from the margin's point of view. These improvements are experimentally compared for artificial and real-world datasets. They generally show much better results than the original AdaBoost algorithm and also a better overall performance than the Support Vector algorithm, which is considered to be an excellent classifier.
In German