Compiling for Android

kramnik · Post by **kramnik** » 17/02/2023, 22:36

I made one for the 64-bit version:

<?xml version="1.0" encoding="utf-8"?>
<enginelist>

<engine
name="Stockfish 15.1 64-bit"
filename="libstockfish_polyglot_15_1-64bit.so"
target="armeabi-v7a|arm64-v8a|x86|x86_64" />

</enginelist>

which produce a very large apk file (150 Megabytes) - maybe just x86_64 should work for the most of the Android devices, plus I've compiled only one
libstockfish_polyglot_15_1-64bit.so.

And I made one for the 32-bit version, I don't know if the syntax is correct:

<?xml version="1.0" encoding="utf-8"?>
<enginelist>

<engine
name="Stockfish 15.1 32-bit"
filename="libstockfish_polyglot_15_1-32bit.so"
target="armv7" />

</enginelist>

On my device this last apk doesn't install, it says "not compatible with your phone".

The 150 MBs 64-bit APK gets installed, though, and Stockfish Polyglot 64-bit works. Tested with Acid Ape GM edition.

Archimedes wrote: ↑12/02/2023, 10:36
kramnik wrote: ↑12/02/2023, 0:37 I compiled Stockfish with both Termux clang and Windows ndk clang, added it to the (before working) Texel project and modified enginelist.xml to use the new engines but it gave me error once loaded on Droidfish:
Post your enginelist.xml.

Archimedes · Post by **Archimedes** » 18/02/2023, 9:11

If you want to provide support for all four architectures, then the jniLibs directory must contain all directories including all executables (e.g. libstockfish.so).

Code: Select all

arm64-v8a
armeabi-v7a
x86
x86_64

The engine.xml then looks like this in the case of Stockfish:

Code: Select all

<?xml version="1.0" encoding="utf-8"?>
<enginelist>

    <engine
        name="Stockfish 15.1"
        filename="libstockfish.so"
        target="armeabi-v7a|arm64-v8a|x86|x86_64" />

</enginelist>

If you want to provide support for only one architecture (e.g. arm64-v8a), then the jniLibs directory must contain only one directory including one executable (e.g. libstockfish.so). That should be obvious.

Code: Select all

arm64-v8a

The engine.xml then looks like this in the case of Stockfish:

Code: Select all

<?xml version="1.0" encoding="utf-8"?>
<enginelist>

    <engine
        name="Stockfish 15.1"
        filename="libstockfish.so"
        target="arm64-v8a" />

</enginelist>

Take care of your targets and use the right name for it. If it says "not compatible with your phone", test the native chess engine without the APK file first. Maybe the file is really not compatible.

kramnik · Post by **kramnik** » 19/02/2023, 23:18

Archimedes wrote: ↑18/02/2023, 9:11 If you want to provide support for all four architectures, then the jniLibs directory must contain all directories including all executables (e.g. libstockfish.so).
Code: Select all
arm64-v8a
armeabi-v7a
x86
x86_64

I'm looking on Internet... armeabi-v7a stands for the old 32-bit processor, while arm64-v8a is for the newer 64-bit processor... At this point I have a question: are x86 and x86_64 targets for Android devices running on Intel?

Since I produced just two binaries - armv7 and armv8 - using make and the ndk compiler, I think I could exclude the targets x86 and x86_64 from the enginelist.xml file...

Archimedes · Post by **Archimedes** » 20/02/2023, 13:58

kramnik wrote: ↑19/02/2023, 23:18 I'm looking on Internet... armeabi-v7a stands for the old 32-bit processor, while arm64-v8a is for the newer 64-bit processor... At this point I have a question: are x86 and x86_64 targets for Android devices running on Intel?

Yes, but I don't know if there are other processors with Android support.

kramnik wrote: ↑19/02/2023, 23:18 Since I produced just two binaries - armv7 and armv8 - using make and the ndk compiler, I think I could exclude the targets x86 and x86_64 from the enginelist.xml file...

Yes.

alex67a · Post by **alex67a** » 21/02/2023, 14:21

Berserk 11.1 doesn't seem to work on my android...

Archimedes · Post by **Archimedes** » 21/02/2023, 18:37

alex67a wrote: ↑21/02/2023, 14:21 Berserk 11.1 doesn't seem to work on my android...

Berserk was compiled entirely with Android NDK.

Maybe one of the following versions will work.
https://pixeldrain.com/l/tuYhKqqB

kramnik · Post by **kramnik** » 28/02/2023, 16:31

This should work, does it?

https://www.mediafire.com/file/xrv85n0efwsbh8i/Stockfish_Polyglot_15.1.apk/file

Archimedes wrote: ↑20/02/2023, 13:58 Yes.

Archimedes · Post by **Archimedes** » 28/02/2023, 23:23

kramnik wrote: ↑28/02/2023, 16:31 This should work, does it?

https://www.mediafire.com/file/xrv85n0efwsbh8i/Stockfish_Polyglot_15.1.apk/file

Yes, looks good and works so far. However, file version shows 1.08a18 when trying to install with an external file manager.

kramnik · Post by **kramnik** » 01/03/2023, 8:12

Archimedes wrote: ↑28/02/2023, 23:23Yes, looks good and works so far. However, file version shows 1.08a18 when trying to install with an external file manager.

And what it means?

Archimedes · Post by **Archimedes** » 01/03/2023, 8:31

You can think of it as cosmetics. Anyway, you should set the version number also correctly in the AndroidManifest.xml file (not only in enginelist.xml).

This version number is also displayed under Settings --> Apps --> <Your Chess Engine>. Could lead to irritation if it always says 1.08a18.

Kepcuk · Post by **Kepcuk** » 12/04/2023, 9:31

make build ARCH=armv8 COMP=clang
Default net: nn-62ef826d1a6d.nnue
Downloading https://tests.stockfishchess.org/api/nn/nn-62ef826d1a6d.nnue

Config:
debug: 'no'
sanitize: 'no'
optimize: 'yes'
arch: 'armv8'
bits: '64'
kernel: 'Linux'
os: 'Android'
prefetch: 'yes'
popcnt: 'yes'
pext: 'no'
sse: 'no'
mmx: 'no'
sse2: 'no'
ssse3: 'no'
sse41: 'no'
avx: 'no'
avx2: 'no'
avx512: 'no'
vnni: 'no'
neon: 'yes'
native: 'no'
embed: 'no'

Flags:
CC: clang
CFLAGS: -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto
LDFLAGS: -lm -latomic -m64 -lnuma -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto

Testing config sanity. If this fails, try 'make help' ...

make ARCH=armv8 COMP=clang all
make[1]: Entering directory '/data/data/com.termux/files/home/Cfish/src'
clang -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto -c -o benchmark.o benchmark.c
clang-16: error: unknown argument: '-fexperimental-new-pass-manager'
make[1]: *** [<builtin>: benchmark.o] Error 1
make[1]: Leaving directory '/data/data/com.termux/files/home/Cfish/src'
make: *** [Makefile:866: build] Error 2

kramnik · Post by **kramnik** » 12/04/2023, 14:08

Use the cecsa gcc.

Kepcuk wrote: ↑12/04/2023, 9:31 make build ARCH=armv8 COMP=clang
Default net: nn-62ef826d1a6d.nnue
Downloading https://tests.stockfishchess.org/api/nn/nn-62ef826d1a6d.nnue

Config:
debug: 'no'
sanitize: 'no'
optimize: 'yes'
arch: 'armv8'
bits: '64'
kernel: 'Linux'
os: 'Android'
prefetch: 'yes'
popcnt: 'yes'
pext: 'no'
sse: 'no'
mmx: 'no'
sse2: 'no'
ssse3: 'no'
sse41: 'no'
avx: 'no'
avx2: 'no'
avx512: 'no'
vnni: 'no'
neon: 'yes'
native: 'no'
embed: 'no'

Flags:
CC: clang
CFLAGS: -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto
LDFLAGS: -lm -latomic -m64 -lnuma -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto

Testing config sanity. If this fails, try 'make help' ...

make ARCH=armv8 COMP=clang all
make[1]: Entering directory '/data/data/com.termux/files/home/Cfish/src'
clang -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto -c -o benchmark.o benchmark.c
clang-16: error: unknown argument: '-fexperimental-new-pass-manager'
make[1]: *** [<builtin>: benchmark.o] Error 1
make[1]: Leaving directory '/data/data/com.termux/files/home/Cfish/src'
make: *** [Makefile:866: build] Error 2

Kepcuk · Post by **Kepcuk** » 12/04/2023, 15:34

I tried it also. I cant and Archimedes doesnt looking for requests

LittleJoe · Post by **LittleJoe** » 12/04/2023, 15:44

Kepcuk wrote: ↑12/04/2023, 9:31 make build ARCH=armv8 COMP=clang
Default net: nn-62ef826d1a6d.nnue
Downloading https://tests.stockfishchess.org/api/nn/nn-62ef826d1a6d.nnue

Config:
debug: 'no'
sanitize: 'no'
optimize: 'yes'
arch: 'armv8'
bits: '64'
kernel: 'Linux'
os: 'Android'
prefetch: 'yes'
popcnt: 'yes'
pext: 'no'
sse: 'no'
mmx: 'no'
sse2: 'no'
ssse3: 'no'
sse41: 'no'
avx: 'no'
avx2: 'no'
avx512: 'no'
vnni: 'no'
neon: 'yes'
native: 'no'
embed: 'no'

Flags:
CC: clang
CFLAGS: -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto
LDFLAGS: -lm -latomic -m64 -lnuma -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto

Testing config sanity. If this fails, try 'make help' ...

make ARCH=armv8 COMP=clang all
make[1]: Entering directory '/data/data/com.termux/files/home/Cfish/src'
clang -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto -c -o benchmark.o benchmark.c
clang-16: error: unknown argument: '-fexperimental-new-pass-manager'
make[1]: *** [<builtin>: benchmark.o] Error 1
make[1]: Leaving directory '/data/data/com.termux/files/home/Cfish/src'
make: *** [Makefile:866: build] Error 2

Clang-16 very clearly tells you what the problem is.
Therefore, just delete this 'problem' in the Makefile.
Or wait for Archimedes or PM him, as I've already told you some time ago.

SkyNet · Post by **SkyNet** » 13/04/2023, 0:11

Kepcuk wrote: ↑12/04/2023, 9:31
make ARCH=armv8 COMP=clang all
make[1]: Entering directory '/data/data/com.termux/files/home/Cfish/src'
clang -Wall -std=c11 -pedantic -Wextra -Wshadow -m64 -D_DEFAULT_SOURCE -D_BSD_SOURCE -DNDEBUG -O3 -fexperimental-new-pass-manager -DIS_64BIT -DUSE_POPCNT -DUSE_NEON -DNUMA -DNNUE -DNNUE_SPARSE -flto -c -o benchmark.o benchmark.c
clang-16: error: unknown argument: '-fexperimental-new-pass-manager'
make[1]: *** [<builtin>: benchmark.o] Error 1
make[1]: Leaving directory '/data/data/com.termux/files/home/Cfish/src'
make: *** [Makefile:866: build] Error 2

Try to delete flags from Makefile -> "-fexperimental-new-pass-manager" and "-DNUMA" (NUMA was never supported on android).

Outskirts CheSS ForuM

Outskirts CheSS ForuM

Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android

Re: Compiling for Android