This paper got accepted for publication at the Conference on Robot Learning (CoRL) 2019. You can expect the full paper to be linked here in October.