gui : cutechess-cli.exe -concurrency 1 -maxmoves 200 -draw movenumber=40 movecount=5 score=10 -tb "C:\Syzygy" -tbpieces 6
engines : Eman 7.80 AVX2, nn-ac07bd334b62.nnue (last green net), tc 1min+1sec, hash 1GB, move overhead 1sec
openings : 20 first legal moves with reversed colors => 40 games
engines.json :
Code: Select all
[
{
"command" : "Eman 7.80 64-bit AVX2.exe",
"name" : "12T Eman ponder on",
"options" : [
{
"alias" : "",
"default" : 24,
"max" : 100,
"min" : -100,
"name" : "Contempt",
"type" : "spin",
"value" : 0
},
{
"alias" : "",
"default" : true,
"name" : "Dynamic Contempt",
"type" : "check",
"value" : true
},
{
"alias" : "",
"default" : 1,
"max" : 512,
"min" : 1,
"name" : "Threads",
"type" : "spin",
"value" : 12
},
{
"alias" : "",
"default" : 16,
"max" : 33554432,
"min" : 1,
"name" : "Hash",
"type" : "spin",
"value" : 1024
},
{
"alias" : "",
"default" : "Eman.exp",
"name" : "Experience File",
"type" : "text",
"value" : "work1.exp"
},
{
"alias" : "",
"default" : false,
"name" : "Experience Read Only",
"type" : "check",
"value" : false
},
{
"alias" : "",
"default" : false,
"name" : "Experience Book",
"type" : "check",
"value" : false
},
{
"alias" : "",
"default" : 16,
"max" : 100,
"min" : 1,
"name" : "Experience Book Max Moves",
"type" : "spin",
"value" : 100
},
{
"alias" : "",
"default" : "eval.nnue",
"name" : "NNUE Eval File",
"type" : "text",
"value" : "nn-ac07bd334b62.nnue"
},
{
"alias" : "",
"default" : 10,
"max" : 5000,
"min" : 0,
"name" : "Move Overhead (ms)",
"type" : "spin",
"value" : 1000
},
{
"alias" : "",
"default" : "Eman.bin",
"name" : "Book 1 File",
"type" : "text",
"value" : "<empty>"
},
{
"alias" : "",
"default" : "<empty>",
"name" : "SyzygyPath",
"type" : "text",
"value" : "<empty>"
}
],
"protocol" : "uci",
"stderrFile" : "",
"whitepov" : true,
"ponder" : true,
"variants" : [
"standard",
"fischerandom"
],
"workingDirectory" : "E:\\JEUX\\CUTECHESS GUI\\moteurs\\eman"
},
{
"command" : "Eman 7.80 64-bit AVX2.exe",
"name" : "24T Eman ponder off",
"options" : [
{
"alias" : "",
"default" : 24,
"max" : 100,
"min" : -100,
"name" : "Contempt",
"type" : "spin",
"value" : 0
},
{
"alias" : "",
"default" : true,
"name" : "Dynamic Contempt",
"type" : "check",
"value" : true
},
{
"alias" : "",
"default" : 1,
"max" : 512,
"min" : 1,
"name" : "Threads",
"type" : "spin",
"value" : 24
},
{
"alias" : "",
"default" : 16,
"max" : 33554432,
"min" : 1,
"name" : "Hash",
"type" : "spin",
"value" : 1024
},
{
"alias" : "",
"default" : "Eman.exp",
"name" : "Experience File",
"type" : "text",
"value" : "work2.exp"
},
{
"alias" : "",
"default" : false,
"name" : "Experience Read Only",
"type" : "check",
"value" : false
},
{
"alias" : "",
"default" : false,
"name" : "Experience Book",
"type" : "check",
"value" : false
},
{
"alias" : "",
"default" : 16,
"max" : 100,
"min" : 1,
"name" : "Experience Book Max Moves",
"type" : "spin",
"value" : 100
},
{
"alias" : "",
"default" : "eval.nnue",
"name" : "NNUE Eval File",
"type" : "text",
"value" : "nn-ac07bd334b62.nnue"
},
{
"alias" : "",
"default" : 10,
"max" : 5000,
"min" : 0,
"name" : "Move Overhead (ms)",
"type" : "spin",
"value" : 1000
},
{
"alias" : "",
"default" : "Eman.bin",
"name" : "Book 1 File",
"type" : "text",
"value" : "<empty>"
},
{
"alias" : "",
"default" : "<empty>",
"name" : "SyzygyPath",
"type" : "text",
"value" : "<empty>"
}
],
"protocol" : "uci",
"stderrFile" : "",
"whitepov" : true,
"ponder" : false,
"variants" : [
"standard",
"fischerandom"
],
"workingDirectory" : "E:\\JEUX\\CUTECHESS GUI\\moteurs\\eman"
}
]
Code: Select all
@cutechess-cli -engine conf="12T Eman ponder on" -engine conf="24T Eman ponder off" -each tc=60+1 -games 40 -openings file="20_court.pgn" start=1 -pgnout "eman_vs_ponder.pgn" fi -repeat -recover -concurrency 1 -maxmoves 200 -draw movenumber=40 movecount=5 score=10 -tb "C:\Syzygy" -tbpieces 6 -event %computername% -site "dual xeon e5-2660v3" -ratinginterval 10
@pause
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%) W D L D(%) OppAvg OppN
1 24T Eman ponder off : 9 82 20.5 40 51.3 2 37 1 92.5 0 1
2 12T Eman ponder on : 0 ---- 19.5 40 48.8 1 37 2 92.5 9 1
White advantage = -26.35 +/- 40.87
Draw rate (equal opponents) = 50.00 % +/- 0.00
Thanks to 24 threads, "ponder off" saw 1 deeper ply in average and 8 deeper plies in max.12T Eman ponder on with 1/40 wins (2,50%, D42/32, 1 620 ms) :
1. g4 @ 100,00%
24T Eman ponder off with 2/40 wins (5,00%, D43/40, 1 784 ms) :
1. f3 @ 50,00%
1. g4 @ 50,00%
Averages :
181 sec/game
109 plies/game
I take the first game as an example to understand what happened between both engines :
In this game :
> thanks to 24 threads, "ponder off" saw 2 deeper plies in average despite a shorter time/move
> +83 seconds of analysis (+80% extra work) were useless for "ponder on"
I looked at the 40 games and "ponder on" almost lost in game #3 and failed to win the game #22.
ENJOY !
edit : https://mega.nz/file/yxRGUZDK#YwvOgHFOQoVEV7SbuU70s4rM1LmBRlpaCXT-TncEFFg