Online learning with ensembles

Robert Urbanczik

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics · 2000 · 21 citations · 8 references

DOIFull text

Open access

Concepts

Abstract

Supervised online learning with an ensemble of students randomized by the choice of initial conditions is analyzed. For the case of the perceptron learning rule, asymptotically the same improvement in the generalization error of the ensemble compared to the performance of a single student is found as in Gibbs learning. For more optimized learning rules, however, using an ensemble yields no improvement. This is explained by showing that for any learning rule f a transform f exists, such that a single student using f has the same generalization behavior as an ensemble of f students.

References

8