Packaging xLights for linux as AppImage

Now that I have xLights being built fine within docker (see Automatic testing of xLights builds via Travis-CI/Docker/Github) the next step is to package up the application as an appimage binary so that it can easily be run on varied linux systems.

It is being built based on Ubuntu Trusty and has been tested to work on Ubuntu 16.04, 16.10, Fedora 25 and OpenSuse 42.2 (and should hopefully work pretty much anywhere else as well)

The creation of the AppImage is done by the Recipe.appimage file that I included in the docker image.  This means that building of the appimage is simply:

$ docker pull debenham/xlights
$ docker run --name buildvm debenham/xlights /bin/bash Recipe.appimage

I’ll break down the Recipe now to explain how it works:

First up we run the Recipe script to build xLights (as shown in previous post).

#!/bin/bash
./Recipe

Next up we setup the environment ready for later on.  The $VERSION number is generated using the version number in the xLights_4_64bit.iss (which is where the version number is explicitly set for the windows install and so is a good/safe place to grab from).   If I am generating a release version (by passing ‘release’ as the command-line option) it will leave it at that.  If this is not a release version (such as for testing/development) then it will also add the short hash of the last commit.  This is handy so I can easily tell which commit the package was built from.

export BASEDIR=/xLights
cd ${BASEDIR}/xlights-git
APP=xLights
COMMIT=`git log --pretty=format:'%h' -n 1`
VERS=`grep AppVersion xLights_4_64bit.iss |sed -e 's/^.*=//g'`
if [ "$1" = "release" ]
then VERSION=${VERS}
else VERSION=${VERS}-${COMMIT}
fi

Now we install xLights into the target AppDir directory

rm -rf ${BASEDIR}/$APP/
 mkdir ${BASEDIR}/$APP/
 make install DESTDIR=${BASEDIR}/$APP/$APP.AppDir PREFIX=/usr

Okay, we have xLights installed in ${BASEDIR}/$APP/$APP.AppDir so the next step is to setup this directory ready to be packaged up.  To do this we import the functions.sh script which contains a bunch of handy functions needed for building AppImages

cd ${BASEDIR}/$APP/

wget -q https://raw.githubusercontent.com/AppImage/AppImages/master/functions.sh -O ./functions.sh
 . ./functions.sh

Lets put the appicons/desktop launcher in place ready to go

cd ${BASEDIR}/$APP/$APP.AppDir

cp usr/share/icons/hicolor/256x256/apps/xlights.png .
cp usr/share/icons/hicolor/256x256/apps/xschedule.png .
cp ./usr/share/applications/xlights.desktop .

Next we need to grab the AppRun binary (which is basically a wrapper which takes care of setting up all the environment so the binary inside the AppImage uses the right libraries/paths etc).   Since xLights needs a newer libstdc++.so.6 than is included in Ubuntu Trusty we needed a specially patched AppRun which allows for the bundling of the newer library without breaking systems which already have a newer library.  See https://github.com/darealshinji/AppImageKit-checkrt/ for details of why this is needed.

wget -O AppRun https://github.com/darealshinji/AppImageKit-checkrt/releases/download/continuous/AppRun-patched-x86_64
 chmod +x AppRun

Now we need to find all the libraries needed by xLights and put them in place.  This is handled automatically by the copy_deps function we imported previously from functions.sh.  I have to manually move the pulseaudio libraries to the common directory (so AppRun doesn’t need to be modified further) and also remove libharfbuzz.* as it causes xLights to be unable to run if it is included.  I also manually copy libstdc++.so.6 to the special path as needed by the modified AppRun.  We finish up by stripping the libraries to save space.

export LD_LIBRARY_PATH=./usr/lib/:$LD_LIBRARY_PATH

copy_deps ; copy_deps ; copy_deps # Three runs to ensure we catch indirect ones
 move_lib
 mv usr/lib/x86_64-linux-gnu/pulseaudio/* usr/lib/x86_64-linux-gnu
 rm usr/lib/x86_64-linux-gnu/libharfbuzz.*
 mkdir -p usr/optional/libstdc++
 cp /usr/lib/x86_64-linux-gnu/libstdc++.so.6 usr/optional/libstdc++/
 delete_blacklisted

strip usr/lib/* usr/lib/*/* || true

 

Almost done now. Just tell AppImageKit what the target launcher will be

get_desktopintegration xlights

Final steps now.  First we check if we are running within Docker. This is needed so that the generate function knows to not use FUSE to mount the image (since FUSE doesn’t work properly within a standard docker container)

cd ..

########################################################################
 # AppDir complete
 # Now packaging it as an AppImage
 ########################################################################

if [[ ! $(cat /proc/1/sched | head -n 1 | grep init) ]]; then {
 echo in docker
 DOCKER_BUILD="yes"
 } fi

And the very last step is to call generate_type2_appimage to actually create the appimage file itself

generate_type2_appimage

After all this is done we are left with a xLights.xxxxxx.AppImage file sitting in ${BASEDIR}/out – ready for uploading to the web and people to use!

For me I then scp them to my web server and wordpress will show the new file automatically at https://www.adebenham.com/xlights-linux/

12 thoughts on “Packaging xLights for linux as AppImage”

  1. Hi Chris,
    Thanks for providing support for those of us who like to run linux. I saw we have AppImage file now so I tried to run it on my Fedora 26 workstation. Unfortunately, it failed with the following output.

    ./xLights-2017.37.glibc2.17-x86_64.AppImage
    /tmp/.mount_xLightOwz3ln/usr/bin//xLights.wrapper: line 125: 4099 Aborted (core dumped) LD_LIBRARY_PATH=”” zenity –question –title=”$TITLE” –text=”$TEXT” 2> /dev/null
    /tmp/.mount_xLightOwz3ln/usr/bin//xLights.wrapper: line 125: 4104 Aborted (core dumped) LD_LIBRARY_PATH=”” zenity –question –title=”$TITLE” –text=”$TEXT” 2> /dev/null
    /tmp/.mount_xLightOwz3ln/usr/bin/xLights: symbol lookup error: /lib64/libharfbuzz.so.0: undefined symbol: FT_Get_Var_Blend_Coordinates

    Keep up the good fight and let me know if I can test anything for you.

    regards,
    Paul

    Reply
  2. Hi Chris,
    I can’t seem to get xLights to run on Debian
    3.16.0-4-amd64 (#1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19))

    If I click on the panel icon it just blinks. From the cli:
    sh: 1: ldconfig: not found
    /tmp/.mount_xLightIEA785/usr/bin/xLights: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: version `CXXABI_1.3.9′ not found (required by /tmp/.mount_xLightIEA785/usr/bin/xLights)

    any ideas??
    Thanks Rick

    Reply
  3. I am new to Ubuntu, but VERY familar with xlights.
    I have tried to install the xlights app here to no avail. can you please explain to me what I am doing incorrectly.

    I am running Ubuntu 16.04
    so, I copied the xlights program to the Downloads folder
    I opened a terminal window [CTRL, ALT T]
    changed directories to Downloads
    entered command: sudo chmod +x xLights-2020.23-x86_64.AppImage
    nothing happened, just gave me a new line

    I know im missing something, but i have no clue what it is.

    please help
    Ken

    Reply
  4. udate,
    i found out that the chmod commnd will not invoke the program, ony change the attribues. the +x is making it executable.
    so, what am i missing that actually executes the program

    Reply
  5. Hey,
    something changed since .31 the appimage size went down from 79mb to 45mb.

    releases since .35 cant run under ubuntu anymore since shared libaries are missing.

    Reply

Leave a Reply to Chris Debenham Cancel reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.