Here are some of the previous work on online learning that I find interesting:

(all documents are copyrighted to original authors)