Theoretical foundations of multi-task lifelong learning

Pentina, Anastasia (2016) Theoretical foundations of multi-task lifelong learning. PhD thesis, IST Austria.

[img] Text
Pentina_Thesis_2016.pdf - Published Version
Available under License All rights reserved.
[IST-2017-776-v1+1]
Download (2089Kb)

Abstract

Traditionally machine learning has been focusing on the problem of solving a single task in isolation. While being quite well understood, this approach disregards an important aspect of human learning: when facing a new problem, humans are able to exploit knowledge acquired from previously learned tasks. Intuitively, access to several problems simultaneously or sequentially could also be advantageous for a machine learning system, especially if these tasks are closely related. Indeed, results of many empirical studies have provided justification for this intuition. However, theoretical justifications of this idea are rather limited. The focus of this thesis is to expand the understanding of potential benefits of information transfer between several related learning problems. We provide theoretical analysis for three scenarios of multi-task learning - multiple kernel learning, sequential learning and active task selection. We also provide a PAC-Bayesian perspective on lifelong learning and investigate how the task generation process influences the generalization guarantees in this scenario. In addition, we show how some of the obtained theoretical results can be used to derive principled multi-task and lifelong learning algorithms and illustrate their performance on various synthetic and real-world datasets.

Item Type: Thesis (PhD)
DOI: 10.15479/AT:ISTA:TH_776
Subjects: 000 Computer science, knowledge & general works > 000 Computer science, knowledge & systems > 006 Special computer methods
Research Group: Lampert Group
Depositing User: Sword Import User
Date Deposited: 28 Feb 2017 09:10
Last Modified: 28 Feb 2017 09:24
URI: https://repository.ist.ac.at/id/eprint/776

Actions (login required)

View Item View Item