Permanent Brain

Sedat Canbaz
I've been banned!
Points: 49 635,00 
Forum Contributions
Posts: 1840
Joined: 04/11/2019, 3:02
Status: Offline (Active 8 Months, 4 Days, 16 Hours, 58 Minutes ago)
Topics: 17
Reputation: 5880
1
Has thanked: 1742 times
Been thanked: 5098 times

Re: Permanent Brain

Post by Sedat Canbaz »

unofficial wrote: ↑16/01/2022, 13:32 hardware : win7 64 pro sp1, dual e5-2660v3, 2 numa nodes, cluster-on-die off, hyperthreading on, ecc registered ram
gui : cutechess-cli.exe -concurrency 1 -maxmoves 200 -draw movenumber=40 movecount=5 score=10 -tb "C:\Syzygy" -tbpieces 6
engines : Eman 7.80 AVX2, nn-ac07bd334b62.nnue (last green net), tc 1min+1sec, hash 1GB, move overhead 1sec
openings : 20 first legal moves with reversed colors => 40 games

engines.json :

Code: Select all

[
	{
		"command" : "Eman 7.80 64-bit AVX2.exe",
		"name" : "12T Eman ponder on",
		"options" : [
			{
				"alias" : "",
				"default" : 24,
				"max" : 100,
				"min" : -100,
				"name" : "Contempt",
				"type" : "spin",
				"value" : 0
			},
			{
				"alias" : "",
				"default" : true,
				"name" : "Dynamic Contempt",
				"type" : "check",
				"value" : true
			},
			{
				"alias" : "",
				"default" : 1,
				"max" : 512,
				"min" : 1,
				"name" : "Threads",
				"type" : "spin",
				"value" : 12
			},
			{
				"alias" : "",
				"default" : 16,
				"max" : 33554432,
				"min" : 1,
				"name" : "Hash",
				"type" : "spin",
				"value" : 1024
			},
			{
				"alias" : "",
				"default" : "Eman.exp",
				"name" : "Experience File",
				"type" : "text",
				"value" : "work1.exp"
			},
			{
				"alias" : "",
				"default" : false,
				"name" : "Experience Read Only",
				"type" : "check",
				"value" : false
			},
			{
				"alias" : "",
				"default" : false,
				"name" : "Experience Book",
				"type" : "check",
				"value" : false
			},
			{
				"alias" : "",
				"default" : 16,
				"max" : 100,
				"min" : 1,
				"name" : "Experience Book Max Moves",
				"type" : "spin",
				"value" : 100
			},
			{
				"alias" : "",
				"default" : "eval.nnue",
				"name" : "NNUE Eval File",
				"type" : "text",
				"value" : "nn-ac07bd334b62.nnue"
			},
			{
				"alias" : "",
				"default" : 10,
				"max" : 5000,
				"min" : 0,
				"name" : "Move Overhead (ms)",
				"type" : "spin",
				"value" : 1000
			},
			{
				"alias" : "",
				"default" : "Eman.bin",
				"name" : "Book 1 File",
				"type" : "text",
				"value" : "<empty>"
			},
			{
				"alias" : "",
				"default" : "<empty>",
				"name" : "SyzygyPath",
				"type" : "text",
				"value" : "<empty>"
			}
		],
		"protocol" : "uci",
		"stderrFile" : "",
		"whitepov" : true,
		"ponder" : true,
		"variants" : [
			"standard",
			"fischerandom"
		],
		"workingDirectory" : "E:\\JEUX\\CUTECHESS GUI\\moteurs\\eman"
	},
	{
		"command" : "Eman 7.80 64-bit AVX2.exe",
		"name" : "24T Eman ponder off",
		"options" : [
			{
				"alias" : "",
				"default" : 24,
				"max" : 100,
				"min" : -100,
				"name" : "Contempt",
				"type" : "spin",
				"value" : 0
			},
			{
				"alias" : "",
				"default" : true,
				"name" : "Dynamic Contempt",
				"type" : "check",
				"value" : true
			},
			{
				"alias" : "",
				"default" : 1,
				"max" : 512,
				"min" : 1,
				"name" : "Threads",
				"type" : "spin",
				"value" : 24
			},
			{
				"alias" : "",
				"default" : 16,
				"max" : 33554432,
				"min" : 1,
				"name" : "Hash",
				"type" : "spin",
				"value" : 1024
			},
			{
				"alias" : "",
				"default" : "Eman.exp",
				"name" : "Experience File",
				"type" : "text",
				"value" : "work2.exp"
			},
			{
				"alias" : "",
				"default" : false,
				"name" : "Experience Read Only",
				"type" : "check",
				"value" : false
			},
			{
				"alias" : "",
				"default" : false,
				"name" : "Experience Book",
				"type" : "check",
				"value" : false
			},
			{
				"alias" : "",
				"default" : 16,
				"max" : 100,
				"min" : 1,
				"name" : "Experience Book Max Moves",
				"type" : "spin",
				"value" : 100
			},
			{
				"alias" : "",
				"default" : "eval.nnue",
				"name" : "NNUE Eval File",
				"type" : "text",
				"value" : "nn-ac07bd334b62.nnue"
			},
			{
				"alias" : "",
				"default" : 10,
				"max" : 5000,
				"min" : 0,
				"name" : "Move Overhead (ms)",
				"type" : "spin",
				"value" : 1000
			},
			{
				"alias" : "",
				"default" : "Eman.bin",
				"name" : "Book 1 File",
				"type" : "text",
				"value" : "<empty>"
			},
			{
				"alias" : "",
				"default" : "<empty>",
				"name" : "SyzygyPath",
				"type" : "text",
				"value" : "<empty>"
			}
		],
		"protocol" : "uci",
		"stderrFile" : "",
		"whitepov" : true,
		"ponder" : false,
		"variants" : [
			"standard",
			"fischerandom"
		],
		"workingDirectory" : "E:\\JEUX\\CUTECHESS GUI\\moteurs\\eman"
	}
]
eman_vs_ponder.cmd :

Code: Select all

@cutechess-cli -engine conf="12T Eman ponder on" -engine conf="24T Eman ponder off" -each tc=60+1 -games 40 -openings file="20_court.pgn" start=1 -pgnout "eman_vs_ponder.pgn" fi -repeat -recover -concurrency 1 -maxmoves 200 -draw movenumber=40 movecount=5 score=10 -tb "C:\Syzygy" -tbpieces 6 -event %computername% -site "dual xeon e5-2660v3" -ratinginterval 10
@pause
Ordo :

Code: Select all

   # PLAYER                 :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 24T Eman ponder off    :       9     82    20.5      40  51.3    2   37    1  92.5       0     1
   2 12T Eman ponder on     :       0   ----    19.5      40  48.8    1   37    2  92.5       9     1

White advantage = -26.35 +/- 40.87
Draw rate (equal opponents) = 50.00 % +/- 0.00
pgnStats eman_vs_ponder.pgn :
12T Eman ponder on with 1/40 wins (2,50%, D42/32, 1 620 ms) :

1. g4 @ 100,00%

24T Eman ponder off with 2/40 wins (5,00%, D43/40, 1 784 ms) :

1. f3 @ 50,00%
1. g4 @ 50,00%

Averages :
181 sec/game
109 plies/game
Thanks to 24 threads, "ponder off" saw 1 deeper ply in average and 8 deeper plies in max.

I take the first game as an example to understand what happened between both engines :
Image
In this game :
> thanks to 24 threads, "ponder off" saw 2 deeper plies in average despite a shorter time/move
> +83 seconds of analysis (+80% extra work) were useless for "ponder on"

I looked at the 40 games and "ponder on" almost lost in game #3 and failed to win the game #22.

ENJOY !

edit : https://mega.nz/file/yxRGUZDK#YwvOgHFOQoVEV7SbuU70s4rM1LmBRlpaCXT-TncEFFg
If your a owner of
2x E5-2660 v3 , which supports up to 20 Physical cores

Then, just a waste of time...a meaningless test for sure...sorry to say that...

Do you know why ? you are missing a lot of things again...

What I can suggest:
Disable HT from bios and re-run the test again...and let's see what will be the results

Otherwise as in your current test, all is wrong...

And if you need more help, about
How many cores per engine, which GUI etc..,
Do not hesitate to ask...ready to help

Greetings
Last edited by Sedat Canbaz on 16/01/2022, 14:29, edited 2 times in total.
Top

Return to “Programming, Technical Discussions, Chess related questions etc.”