maemo.org - Talk - Installing Gentoo Prefix under SailfishOS (on the Pro1)

Here's a guide on how to get Gentoo Prefix running under SailfishOS. I've made it for the Pro1, but you might be able to use it for another device.

If you know what Gentoo Prefix is, do not expect it to be the smooth ride I'm sure it usually is.

If you know what Gentoo is, but not what Gentoo Prefix is: the short of it is that this basically lets you install Gentoo as a normal user in the directory of your choice, minus the kernel (since one is already running). You cannot mess up your SailfishOS install with this, so it's pretty safe to play around with.

If you don't know what Gentoo is, it's a distribution aimed at power-users that lets you customize quite a lot of stuff. Basically, a dedicated group of maintainers ensure that the configuration of your usual programs can be done through simple keywords in a standardized fashion (e.g. "ssl" to indicate you want your package to have the ssl options enabled). In practice, you basically have a set of text files in /etc/portage/ that describe the system you want, and a package manager (Portage) which will tell you if that's doable, or why not, and make it happen if it is. The downsides being that you are expected to have a coherent set of files in /etc/portage/, so you'll often face a "nope, you need to allow this in /etc/portage/ before I can do that" kind of issue if you're not careful. Also, since you really can personalize stuff, packages have to be compiled, which can be annoying when installing new software (not so much when updating, since you can just let it compile in the background). This also means you can tailor your programs to your hardware to get better performance. There is somewhat of an expectation for users to read documentation, so if you don't want to take the time to learn what things are and how they work, you shouldn't be trying to customize them, and thus probably shouldn't be using Gentoo. Oh, and the TL;DR of compiling on a phone: it wasn't a good plan 20 years ago, but you have a gaming PC in your hands nowadays, so the only issue is the rewrite limits of flash memory. Just use tmux or Screen when merging huge packages (e.g. llvm, xorg, firefox, webkit-gtk, icedtea, ...) so that you don't lose progress if the Sailfish terminal application stops for some reason (I've noticed it did that sometimes, and that was even before I installed the Prefix).

SailfishOS runs a 64bit kernel (aarch64) with a strictly 32bit userland (armhf). I'd ask, but I don't know who to.
Whatever. The point is: you're not easily getting a 64bit toolchain set up on that, so this guide goes for a 32bit Gentoo Prefix (armhf). Now, the interesting thing is: Gentoo is very good at setting up cross-toolchains, so it might be possible to use the 32bit Gentoo Prefix to create a 64bit toolchain that you could use to install a 64bit Gentoo Prefix (this... is to go... even further beyond!). You can see what your toolchain is by running "gcc -v".

Note that ${EPREFIX} refers to the folder you want your Gentoo Prefix installed in. Mine is /gentoo, so if you see that in this guide, assume that this means you have to actually write the name of the folder and not use the environment variable (and only in this case, otherwise, prefer using the env variable). You should export this environment variable (which you'll need to do anyway):

Code:

$ export EPREFIX="/gentoo"

For reference, commands starting with "#" (e.g. "# mkdir ${EPREFIX}") are commands ran as root, whereas commands starting with "$" (e.g. "$ mkdir ${EPREFIX}") are commands run as nemo (or any normal user). You shouldn't be using root for anything past "Getting Started".

Getting Started

Setting up an SD Card
I strongly recommend using an SD card (and one targeted at dashcams, so that it withstands a lot of rewrites) to store your prefix. If you don't want to, feel free to skip this step and create the EPREFIX folder.

This assumes you've just put a dedicated SD card in your phone. If this is not the case, make sure the SD card is formatted in something that can support a Linux system (e.g. ext4).

Formatting the SD card:

Code:

# cfdisk /dev/mmcblk0

Choose Linux as partition type. Write the new partition table.

Code:

# mkfs.ext4 /dev/mmcblk0p1

This makes your partition use ext4.

Preparing the Prefix folder:

Code:

# mkdir ${EPREFIX}

This creates the folder (if you didn't know that, it's a strong sign that you should probably not be trying Gentoo yet).

As root, edit /etc/fstab to add the line:

Code:

/dev/mmcblk0p1 /gentoo ext4 defaults 0 0

This will make it be mounted automatically at boot.

Code:

# mount ${EPREFIX}

This mounts it right now.

Code:

# chown -R nemo:nemo ${EPREFIX}

This makes it owned by nemo, meaning that you don't need root privileges to read or write in there.

Installing the required packages:

SailfishOS has a package manager called pkcon. I'm very new to that OS, so there may be a better one, but this one will do.

You will need to install "make", "gcc", "gcc++", and "python" (that last dependency is not standard for a Gentoo Prefix install, but you'll need it for a workaround).

Code:

# pkcon install make gcc gcc++ python

I've actually done that with one command per program installed, but I assume you can do it in a single call.

Tinkering some stuff in the install script:

Download the Gentoo Prefix bootstrap script from https://wiki.gentoo.org/wiki/Project:Prefix and put it in ${EPREFIX}.

Make the script executable:

Code:

$ chmod +x ./bootstrap-prefix.sh

Open it in your favorite text editor (i.e. vim :p).

Find:

Code:

        if [[ ${PN} == "m4" ]] ; then

                # drop _GL_WARN_ON_USE which gets turned into an error with

                # recent GCC 1.4.17 and below only, on 1.4.18 this expression

                # doesn't match

                sed -i -e '/_GL_WARN_ON_USE (gets/d' lib/stdio.in.h lib/stdio.h

Add before:

Code:

        if [[ ${PN} == "tar" ]] ; then

                # drop _GL_WARN_ON_USE which gets turned into an error with

                # recent GCC 1.4.17 and below only, on 1.4.18 this expression

                # doesn't match

                sed -i -e '/_GL_WARN_ON_USE (gets/d' gnu/stdio.in.h gnu/stdio.h

        fi

tar won't compile if you don't do that.

Find and comment out:

Code:

        [[ ${PN} == "bash" && ${CHOST} != *-cygwin* ]] \

                && myconf="${myconf} --disable-readline"

bash won't compile if you don't do that.

Find:

Code:

        einfo "running emerge -u system"

        CPPFLAGS="-DGNUSTEP_BASE_VERSION" \

        CFLAGS= CXXFLAGS= emerge -u system || return 1

Add before:

Code:

        einfo "fixing virtual/libc"

        CPPFLAGS="-DGNUSTEP_BASE_VERSION" \

        CFLAGS= CXXFLAGS= emerge -1 --nodeps -n --ask virtual/libc glibc || return 1

The script won't be able to do the "emerge -u" you just saw without that.

Find:

Code:

        [[ ${OFFLINE_MODE} ]] || type -P wget > /dev/null \

                || (bootstrap_wget) || return 1

Add before:

Code:

        [[ ${OFFLINE_MODE} ]] || type -P wget > /dev/null \

                || (bootstrap_libpsl) || return 1

wget needs libpsl to compile.

Find:

Code:

bootstrap_wget() {

        bootstrap_gnu wget 1.20.1 || \

        bootstrap_gnu wget 1.17.1 || bootstrap_gnu wget 1.13.4

}

Replace with (yes the extra function should be added):

Code:

bootstrap_wget() {

        bootstrap_gnu wget 1.20.1 #|| \

#        bootstrap_gnu wget 1.17.1 || bootstrap_gnu wget 1.13.4

}



bootstrap_libpsl() {

        bootstrap_gnu libpsl 0.21.0

}

wget will crash anyway, so let's not lose too much time trying the other versions. We also need to add something to install libpsl, hence the added function.

You're done with pre-installation stuff.

Stage 1
I'll repeat it again, just in case: from now on, no root, only nemo.

Go to ${EPREFIX}

Code:

$ cd ${EPREFIX}

Create a file called prefix_env_stage1_2.sh, with the following:

Code:

export EPREFIX="/gentoo"

export CHOST="armv7hl-hardfloat-linux-gnueabi"



export CFLAGS="-march=armv8-a -mtune=cortex-a73.cortex-a53"



export PRESTAGE_1_PATH="${PATH}"

export PATH="${EPREFIX}/usr/bin:${EPREFIX}/bin:${EPREFIX}/tmp/usr/bin:${EPREFIX}/tmp/bin:${PATH}"

export LDFLAGS=""

export LD_LIBRARY_PATH=""

export CFFLAGS=""

export PKG_CONFIG_PATH=""

export PATH="${EPREFIX}/usr/sbin:${EPREFIX}/sbin:${EPREFIX}/tmp/usr/sbin:${EPREFIX}/tmp/sbin:${PATH}"

If you are indeed using the Pro1, you should only modify the EPREFIX line to match your own. Otherwise, I believe the CHOST is mostly linked to the toolchain provided by SailfishOS and should thus stay unchanged. the CLFAGS must match something that fits your CPU. Do not simply remove them, this will not work here and will force you to restart the whole thing way down the line (can you tell I'm speaking from experience? :o).

Source prefix_env_stage1_2.sh. You'll need to do that again every time you close the terminal during the stage 1 and stage 2 process (which you have no reason to, but just in case, it's nice to have it available):

Code:

$ source prefix_env_stage1_2.sh

Stage 1 is now about to start for real...

Code:

$ ./bootstrap-prefix.sh "${EPREFIX}" stage1

If you see a nice logo in ASCII art, you failed to source prefix_env_stage1_2.sh.

Bootstrapping WGET fails:

Yeah, it will do that in this install. I did warn about this not being a smooth ride, didn't I?

Code:

$ mv ${EPREFIX}/tmp/bin/wget{,_back}

This renames wget into wget_back. We'll create a shim. Using your favorite text editor, create the file ${EPREFIX}/tmp/bin/wget with the following content:

Code:

#!/bin/bash

LD_LIBRARY_PATH="/gentoo/tmp/lib" /gentoo/tmp/bin/wget_back $@

It is important that you do not use the ${EPREFIX} environment variable here. Hardcode the location.

Make it executable:

Code:

$ chmod +x ${EPREFIX}/tmp/bin/wget

Resume stage 1:

Code:

$ ./bootstrap-prefix.sh "${EPREFIX}" stage1

Bison will try multiple versions before succeeding.

Missing Profile:
Near the end of stage 1, you'll get a message about the profile for your setup not being automatically found.

Code:

$ ln -s ${EPREFIX}/var/db/repos/gentoo/profiles/prefix/linux/arm/ ${EPREFIX}/etc/portage/make.profile

Let's do everything we need to do in ${EPREFIX}/etc/portage right now, so we don't have to later.

Modifications in ${EPREFIX}/etc/portage:

Here's my ${EPREFIX}/etc/portage/make.conf. Make yours match so that the compilation succeeds. Note that some of these fields might not be doing anything. Also, don't worry if one of the values do not match the environment variables you sourced before, we don't want them to until stage 3 (hence the name of the sourced file):

Code:

# Added by bootstrap-prefix.sh for armv7hl-hardfloat-linux-gnueabi

CHOST="armv7hl-hardfloat-linux-gnueabi"

USE="-X wayland pulseaudio dbus ssl unicode nls"

CFLAGS="-march=armv8-a -mtune=cortex-a73.cortex-a53"

#LDFLAGS="-Wl,--dynamic-linker=/gentoo/lib/ld-linux-armhf.so.3"

LDFLAGS="-Wl,--dynamic-linker=/gentoo/lib/ld-linux-armhf.so.3 -Wl,-rpath=/gentoo/lib"

CFLAGS="${CFLAGS} -O2 -pipe"

CXXFLAGS="${CFLAGS}"

MAKEOPTS=""

CONFIG_SHELL="/gentoo/bin/bash"

DISTDIR="/gentoo/var/cache/distfiles"

# sandbox does not work well on Prefix, bug 490246

FEATURES="${FEATURES} -usersandbox -sandbox"

LIBRARY_PATH="/gentoo/lib/:/gentoo/usr/lib"

RPATH="/gentoo/lib/:/gentoo/usr/lib"

${EPREFIX}/etc/portage/package.accept_keywords:

Code:

=sys-apps/baselayout-prefix-2.6-r2::gentoo ~arm

Not having that will interrupt the install script when it comes time to install that package: they're all marked as unstable and thus, masked.

${EPREFIX}/etc/portage/package.env:

Code:

dev-lang/perl perl

Perl... has some issues getting installed.

${EPREFIX}/etc/portage/env/perl: (You will need to create the directory first)

Code:

EXTRA_ECONF="-Dosname='linux' -Dhintfile='linux' -Duserelocatableinc='false'"

Perl considers that any OS with a Linux kernel in which /system/lib/libandroid.so exists must be Android. We need to really insist on being Linux. Also, it'll try and fail to install with incompatible options, so we disable the one that isn't hardcoded in the Gentoo package file.

${EPREFIX}/etc/portage/package.unmask:

Code:

=sys-kernel/linux-headers-4.4

Not too sure about this being a good idea, but we need one and that matches the numbers I get when I use "uname -a".

Stage 2

We've got one last thing to do before starting Stage 2: fixing some stuff the script did incorrectly.

Print $PRESTAGE_1_PATH:

Code:

$ echo $PRESTAGE_1_PATH

Does it contain anything related to Gentoo Prefix? The goal here is to get the $PATH you were using before adding the Gentoo Prefix directories to it.

You'll need to edit two files, but their content are the same. Make it so ${EPREFIX}/tmp/usr/local/bin/{gcc,g++} contain only one copy of the three lines (you'll be able to see it clearly if the content has been duplicated). Make it so that their content is similar to:

Code:

#! /bin/sh

PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/home/nemo/bin" export PATH

exec "${0##*/}" "$@"

Replacing the value I've put there with the one you have in $PRESTAGE_1_PATH (which is the same if you haven't modified your PATH outside of this guide).

You can now run Stage 2:

Code:

$ ./bootstrap-prefix.sh "${EPREFIX}" stage2

Stage 3

Code:

$ mv prefix_env_stage1_2.sh prefix_env_stage3.sh

$ echo 'export LDFLAGS="-Wl,--dynamic-linker=/gentoo/lib/ld-linux-armhf.so.3 -Wl,-rpath=/gentoo/lib"' >> prefix_env_stage3.sh

$ source prefix_env_stage3.sh

The binaries we compile from now on have a little problem with finding the right libraries. So we're going to use a dynamic linker that works for them.

You can now run Stage 3:

Code:

$ ./bootstrap-prefix.sh "${EPREFIX}" stage3

emerge --depclean failed:
Yeah, and you know what? Let's not bother fixing that. Look at the very last line there. It should tell you have successfully passed stage 3.

... post size limit reached ...