Android engines tests.

Skynet · Post by **Skynet** » 22/02/2022, 23:45

Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8moves.pgn (60 pos) - Resign 600 cp
ELO rating has been set to 3498 (Houdini 6.03 with 4 cores and TC: more then 2 min). Engines armv7.

Code: Select all

# PLAYER           :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Berserk 8.5.1    :    3578     31     360  82.8  261   74   25  20.6     100
2 Houdini 6.03     :    3498     31     360  73.2  221   85   54  23.6     100
3 Minic 3.18       :    3158     30     360  29.6   64   85  211  23.6     100
4 Drofa 3.3.0      :    3029     34     360  14.4   23   58  279  16.1     ---

Games https://pixeldrain.com/u/Pxy2Sag5

Skynet · Post by **Skynet** » 25/02/2022, 16:25

Tablet - Lenovo android 4.4.2 - 32 bit - Quad Core (4x Cortex A7) - 1GB RAM - 1,3 GHz
GUI=Cfa - Hash 64 mb - 4 cores per engine - TC: 2min+1sec - Book=8moves.pgn (100 pos) - Resign 600 cp
ELO rating has been set to 3498 (Houdini 6.03 with 4 cores and TC: more then 2 min). Engines armv7.

Code: Select all

# PLAYER            :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
1 Fire 8.NN.MC.3    :    3616     18     400  58.4  125  217   58  54.3      64
2 Berserk 8.5.1     :    3610     16     400  57.3  127  204   69  51.0     100
3 Houdini 6.03      :    3498     17     400  34.4   59  157  184  39.3     ---

Games https://pixeldrain.com/u/rDoSR6B8

Archimedes · Post by **Archimedes** » 31/07/2022, 0:29

Polyfish 20220716 with Cerebellum3Merge book versus Stockfish 220724.

Both engines were compiled with GCC and PGO.

Tournament was played on Samsung Galaxy Tab A7 (Android 12, Snapdragon 662) with Termux and the CETSA script.
Offset for rating of one of the engines was not set in Bayeselo.

c-chess-cli.conf:

Code: Select all

../bin/c-chess-cli/$CETSA_ABI/c-chess-cli \
  -each tc=10+0.1 option.Hash=16 option.Threads=1 \
  -engine cmd=../uci/Polyfish "option.Book 1 File=Cerebellum3Merge.bin" \
  -engine cmd=../uci/Stockfish \
  -games 500 \
  -concurrency 2 \
  -openings file=../epd/5mvs_30k_analyzed.epd order=random \
  -repeat \
  -resign number=150 count=5 score=900 \
  -draw number=150 count=5 score=5 \
  -pgn games.pgn

c-chess-cli.txt:

Code: Select all

3-fold repetition: 150
50 moves rule: 28
Adjudication: 8
Checkmate: 192
Insufficient material: 117
Rules infraction: 0
Stalemate: 5
Time forfeit: 0
Unterminated: 0

Bayeselo.txt:

Code: Select all

Rank Name               Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
---------------------------------------------------------------------------------------------------------
   1 Polyfish 20220716   3107   0.0    9   10   500  260.5  52.1  107   86  307  21.4  61.4  3093 
   2 Stockfish 220724    3093  14.2   10    9   500  239.5  47.9   86  107  307  17.2  61.4  3107 
---------------------------------------------------------------------------------------------------------
  Δ = delta from the next higher rated opponent
  # = number of games played
  Σ = total score, 1 point for win, 1/2 point for draw

Games:
https://app.box.com/s/gjuqskzyhumc68xmd2eju9z0g8j5croy

Archimedes · Post by **Archimedes** » 01/08/2022, 6:03

Polyfish 20220716 with Cerebellum3Merge book versus Stockfish 220724.

Now, with another opening file for c-chess-cli. I'm by far not an expert in such things, but the question is, is the Cerebellum3Merge book really outdated? I would say no.

Tournament was played on Samsung Galaxy Tab A7 (Android 12, Snapdragon 662) with Termux and the CETSA script.
Offset for rating of one of the engines was not set in Bayeselo.

c-chess-cli.conf:

Code: Select all

../bin/c-chess-cli/$CETSA_ABI/c-chess-cli \
  -each tc=10+0.1 option.Hash=16 option.Threads=1 \
  -engine cmd=../uci/Polyfish "option.Book 1 File=Cerebellum3Merge.bin" \
  -engine cmd=../uci/Stockfish \
  -games 500 \
  -concurrency 2 \
  -openings file=../epd/IM_4mvs.epd order=random \
  -repeat \
  -resign number=150 count=5 score=900 \
  -draw number=150 count=5 score=5 \
  -pgn games.pgn

c-chess-cli.txt:

Code: Select all

3-fold repetition: 146
50 moves rule: 46
Adjudication: 5
Checkmate: 171
Insufficient material: 125
Rules infraction: 0
Stalemate: 7
Time forfeit: 0
Unterminated: 0

Bayeselo.txt:

Code: Select all

Rank Name               Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
---------------------------------------------------------------------------------------------------------
   1 Polyfish 20220716   3112   0.0    9    9   500  267.0  53.4  103   69  328  20.6  65.6  3088 
   2 Stockfish 220724    3088  23.3    9    9   500  233.0  46.6   69  103  328  13.8  65.6  3112 
---------------------------------------------------------------------------------------------------------
  Δ = delta from the next higher rated opponent
  # = number of games played
  Σ = total score, 1 point for win, 1/2 point for draw

Games:
https://app.box.com/s/2vokfur76q29raqp1s6a40il0vl6h7v6

fuddur · Post by **fuddur** » 24/09/2022, 6:52

Rank Name Rating Δ + - # Σ Σ% W L D W% =% OppR
---------------------------------------------------------------------------------------------------------
1 Stockfish 13 3116 0.0 12 12 397 217.0 54.7 108 71 218 27.2 54.9 3084
2 Berserk 20220912 3084 32.4 12 12 397 180.0 45.3 71 108 218 17.9 54.9 3116
---------------------------------------------------------------------------------------------------------
Δ = delta from the next higher rated opponent
# = number of games played
Σ = total score, 1 point for win, 1/2 point for draw

Cutechess cli configuration
../bin/c-chess-cli/$CETSA_ABI/c-chess-cli \
-each tc=10+0.1 option.Hash=16 option.Threads=1 \
-engine cmd=../uci/stockfish.android.armv8 \
-engine cmd=../uci/Berserk \
-games 500 \
-concurrency 2 \
-openings file=../epd/IM_4mvs.epd order=random \
-repeat \
-resign number=150 count=5 score=900 \
-draw number=150 count=5 score=5 \
-pgn games.pgn

3-fold repetition: 80
50 moves rule: 60
Adjudication: 41
Checkmate: 169
Insufficient material: 39
Rules infraction: 0
Stalemate: 4
Time forfeit: 4
Unterminated: 0

Phn -https://pixeldrain.com/u/Kq3r93FD
Not played 500 games because my phone facing ghost touched problem so tournament terminated

Here is berserk vs sf 13 game ....time forfeit due do my phone have ghost touched problem

fuddur · Post by **fuddur** » 26/09/2022, 11:14

Hello,
Here I made tournament just 200 games due to my ghost touched problem,
Berserk going strong excellent...

Tournament was played on Realme 5pro(Android 11, Snapdragon 712) with Termux and the CETSA script.

../bin/c-chess-cli/$CETSA_ABI/c-chess-cli \
-each tc=20+0.1 option.Hash=16 option.Threads=1 \
-engine cmd=../uci/Koivisto \
-engine cmd=../uci/Berserk \
-games 200 \
-concurrency 2 \
-openings file=../epd/IM_4mvs.epd order=random \
-repeat \
-resign number=150 count=5 score=900 \
-draw number=150 count=5 score=5 \
-pgn games.pgn

. Rank Name Rating Δ + - # Σ Σ% W L D W% =% OppR
---------------------------------------------------------------------------------------------------------
1 Berserk 20220925 3128 0.0 15 16 200 116.5 58.2 61 28 111 30.5 55.5 3072
2 Koivisto 8.16 3072 56.4 16 15 200 83.5 41.8 28 61 111 14.0 55.5 3128
---------------------------------------------------------------------------------------------------------
Δ = delta from the next higher rated opponent
# = number of games played
Σ = total score, 1 point for win, 1/2 point for draw

3-fold repetition: 29
50 moves rule: 38
Adjudication: 10
Checkmate: 88
Insufficient material: 32
Rules infraction: 0
Stalemate: 3
Time forfeit: 0
Unterminated: 0

Games pgn..https://pixeldrain.com/u/oWEpHPNw

All thanks goes to sir Archimedes....
Superb compilation...
Thanks sir...

Archimedes · Post by **Archimedes** » 26/09/2022, 14:49

Nice to see, that you managed the installation of the CETSA script.

There were several updates yesterday for Berserk. The latest version has a larger network.

Archimedes · Post by **Archimedes** » 26/09/2022, 15:01

Berserk 20220925 vs Koivisto 8.16

Tournament was played on Motorola Moto G7 Power (Android 10, Snapdragon 632) with Termux and the CETSA script.
Offset for rating of one of the engines was not set in Bayeselo.

c-chess-cli.conf:

Code: Select all

../bin/c-chess-cli/$CETSA_ABI/c-chess-cli \
  -each tc=10+0.1 option.Hash=16 option.Threads=1 \
  -engine cmd=../uci/Berserk "option.Contempt=0" \
  -engine cmd=../uci/Koivisto \
  -games 500 \
  -concurrency 2 \
  -openings file=../epd/IM_4mvs.epd order=random -repeat \
  -resign number=150 count=5 score=900 \
  -draw number=150 count=5 score=5 \
  -pgn games.pgn

c-chess-cli.txt:

Code: Select all

3-fold repetition: 120
50 moves rule: 64
Adjudication: 15
Checkmate: 232
Insufficient material: 64
Rules infraction: 0
Stalemate: 5
Time forfeit: 0
Unterminated: 0

Bayeselo.txt:

Code: Select all

Rank Name              Rating   Δ     +    -     #     Σ    Σ%     W    L    D   W%    =%   OppR 
---------------------------------------------------------------------------------------------------------
   1 Berserk 20220925   3116   0.0   11   11   500  272.5  54.5  140   95  265  28.0  53.0  3084 
   2 Koivisto 8.16      3084  31.4   11   11   500  227.5  45.5   95  140  265  19.0  53.0  3116 
---------------------------------------------------------------------------------------------------------
  Δ = delta from the next higher rated opponent
  # = number of games played
  Σ = total score, 1 point for win, 1/2 point for draw

Games:
https://app.box.com/s/gi94zccdk1lnti3b62qyni21s4k5lvz7

fuddur · Post by **fuddur** » 01/10/2022, 17:16

Fire NN vs Fire zero
I kept nn.bin file in CETSA uci folder....

Tournament was played on Realme 5pro(Android 11, Snapdragon 712) with Termux and the CETSA script.

Rank Name Rating Δ + - # Σ Σ% W L D W% =% OppR
---------------------------------------------------------------------------------------------------------
1. Fire NN 08272022 3237 0.0 16 15 200 178.0 89.0 158 2 40 79.0 20.0 2963
2. Fire Zero 09282022 2963 274.0 15 16 200 22.0 11.0 2 158 40 1.0 20.0 3237
---------------------------------------------------------------------------------------------------------
Δ = delta from the next higher rated opponent
# = number of games played
Σ = total score, 1 point for win, 1/2 point for draw

c-chess cli.conf

../bin/c-chess-cli/$CETSA_ABI/c-chess-cli \
-each tc=20+0.1 option.Hash=16 option.Threads=1 \
-engine cmd=../uci/Fire_NN \
-engine cmd=../uci/Fire_Zero \
-games 200 \
-concurrency 4 \
-openings file=../epd/IM_4mvs.epd order=random \
-repeat \
-resign number=150 count=5 score=900 \
-draw number=150 count=5 score=5 \
-pgn games.pgn

             
3-fold repetition: 35
50 moves rule: 2
Adjudication: 0
Checkmate: 144
Insufficient material: 2
Rules infraction: 0
Stalemate: 1
Time forfeit: 16
Unterminated: 0

games:
https://pixeldrain.com/u/CbRe6BJU

Fire Zero time forfeit more when I set threads 4...

fuddur · Post by **fuddur** » 03/10/2022, 2:52

Halogen vs Marvin 6.0

Tournament was played on Realme 5pro(Android 11, Snapdragon 712) with Termux and the CETSA script.

c -chess cli.conf.
../bin/c-chess-cli/$CETSA_ABI/c-chess-cli \
-each tc=10+0.1 option.Hash=16 option.Threads=1 \
-engine cmd=../uci/Berserk "option.Contempt=0" \
-engine cmd=../uci/Koivisto \
-games 500 \
-concurrency 2 \
-openings file=../epd/IM_4mvs.epd order=random -repeat \
-resign number=150 count=5 score=900 \
-draw number=150 count=5 score=5 \
-pgn games.pgn

c-chess cli.txt

3-fold repetition: 29
50 moves rule: 7
Adjudication: 0
Checkmate: 156
Insufficient material: 7
Rules infraction: 0
Stalemate: 1
Time forfeit: 0
Unterminated: 0

Bayeselo.txt

Rank Name Rating Δ + - # Σ Σ% W L D W% =% OppR
---------------------------------------------------------------------------------------------------------
1 Halogen 10.23.13 3161 0.0 22 21 200 134.0 67.0 112 44 44 56.0 22.0 3039
2 Marvin 6.0.0 3039 121.4 21 22 200 66.0 33.0 44 112 44 22.0 22.0 3161
---------------------------------------------------------------------------------------------------------
Δ = delta from the next higher rated opponent
# = number of games played
Σ = total score, 1 point for win, 1/2 point for draw

games:https://pixeldrain.com/u/RffhAB7L

fuddur · Post by **fuddur** » 03/10/2022, 3:04

Halogen vs Marvin 6.1.0

Marvin gain nice elo but it's time Marvin 6.10 time forfeit..

Tournament was played on Realme 5pro(Android 11, Snapdragon 712) with Termux and the CETSA script.

c-chess-cli.conf

../bin/c-chess-cli/$CETSA_ABI/c-chess-cli \
-each tc=10+0.1 option.Hash=16 option.Threads=1 \
-engine cmd=../uci/Berserk "option.Contempt=0" \
-engine cmd=../uci/Koivisto \
-games 500 \
-concurrency 4 \
-openings file=../epd/IM_4mvs.epd order=random -repeat \
-resign number=150 count=5 score=900 \
-draw number=150 count=5 score=5 \
-pgn games.pgn

c-chess cli.txt

3-fold repetition: 38
50 moves rule: 3
Adjudication: 0
Checkmate: 146
Insufficient material: 9
Rules infraction: 0
Stalemate: 2
Time forfeit: 2
Unterminated: 0

Bayeselo.txt

Rank Name Rating Δ + - # Σ Σ% W L D W% =% OppR
---------------------------------------------------------------------------------------------------------
1 Marvin 6.1.0 3132 0.0 21 21 200 118.0 59.0 92 56 52 46.0 26.0 3068
2 Halogen 10.23.13 3068 63.9 21 21 200 82.0 41.0 56 92 52 28.0 26.0 3132
---------------------------------------------------------------------------------------------------------
Δ = delta from the next higher rated opponent
# = number of games played
Σ = total score, 1 point for win, 1/2 point for draw

games:https://pixeldrain.com/u/e2WS5A6e

Huge improvement in Marvin..
Again thanks goes to sir Archimedes for his fastest compilation..
Thanks!!

SkyNet · Post by **SkyNet** » 24/02/2023, 2:20

Well folks, i wanted to do more games but unfortunately tournament was terminated because i forgot to put the charger so battery dies.

Tablet - Samsung Galaxy A10.1 (32GB) - Android 9 / 64bit - 2GB RAM - 8x Cortex-A53 - 1,59 GHz
GUI: CuteChess-cli / 1core per engine / TC: 120sec+1sec / hash 64 / Book=8moves_v3 - Openings: sequential / repeat opening=yes / Concurrency=7 / Resignation=480cp

Code: Select all

   # PLAYER                  :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
   1 Spider 1.1dT 64 NEON    :    3205      5     909  51.4   98  739   72  81.3      97
   2 Cfish 13 64 NEON        :    3195      5     909  48.6   72  739   98  81.3     ---

Games https://pixeldrain.com/u/Kfw5VDia
=========================================
Regarding both Cfishes (Leo's and Joachim's versions), they both crashes in cutechess, funny thing is that they both execute bench commands (via SManager) and working in Droidfish & Cfa, but in cutechess i'm getting "segmentation fault" all the time.

► Show Spoiler

Anyway, i'll test them in Cfa but the number of games will be much less.

SkyNet · Post by **SkyNet** » 24/02/2023, 3:51

SkyNet wrote: ↑24/02/2023, 2:20 Well folks, i wanted to do more games but unfortunately tournament was terminated because i forgot to put the charger so battery dies.
Book=8moves_v3

Sorry, book topGM 4moves.

Joachim26 · Post by **Joachim26** » 24/02/2023, 9:45

SkyNet wrote: ↑24/02/2023, 2:20 Regarding both Cfishes (Leo's and Joachim's versions), they both crashes in cutechess, funny thing is that they both execute bench commands (via SManager) and working in Droidfish & Cfa, but in cutechess i'm getting "segmentation fault" all the time.
► Show Spoiler
Anyway, i'll test them in Cfa but the number of games will be much less.

It's a pitty that these new builds are only working properly (bench is OK!) on newer Android 11 or 12 devices. I've tried several things but without success. But at least you, SkyNet, can make tests on CfA. On my old tablet even this is not possible.
However, some time ago I used the Android app "Parallel Spaces" to start two instances of CfA. It worked fine. Even more parallel CfAs may be possible with 8 cores.
Concerning the builds,
Houston, ah I mean, Archimedes, we have a problem!

SkyNet · Post by **SkyNet** » 26/02/2023, 12:51

That was Leo's compilation, next Joakim's.
Tablet - Samsung Galaxy A10.1 (32GB) - Android 9 / 64bit - 2GB RAM - 8x Cortex-A53 - 1,59 GHz
GUI=C4a - Hash 128 mb - 2min+1sec - Book=topGM 4moves - 6 cores per engine - ponder=NO
syzygy=NO, Adjudication Rule=Resign - Move 25, Move Count 3, Score (in cp) 480
Draw=Move Number 30, Move count 4, Score (in cp) 0

Code: Select all

   # PLAYER                  :  RATING  ERROR  PLAYED   (%)    W    D    L  D(%)  CFS(%)
   1 Spider 1.1dT 64 NEON    :    3213      4     622  53.5   72  522   28  83.9     100
   2 Cfish Sopel 64 NEON     :    3187      4     622  46.5   28  522   72  83.9     ---

Games https://pixeldrain.com/u/9uNZAhBc

Outskirts CheSS ForuM

Outskirts CheSS ForuM

Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.

Re: Android engines tests.