Thanks for the update.
I just noticed that on an already installed libertine you need to edit
~/.cache/libertine-container/first/rootfs/etc/apt/sources.list
changing the URLs therein to
http://old-releases.ubuntu.com/ubuntu

Cheers