I now decided for a different approach.
Press and hold on somewhere on the screen will bring up a dock with two buttons for downloading and adding to bookmarks.
I also added those two options to the details page aswell.

If this dock fills up it could be necessary to switch to icons though.
I uploaded this approach to git already for those who want to try it.