OpenChess

Independent Computer Chess Discussion Forum
https://open-chess.org/

deeds_chess_system

https://open-chess.org/viewtopic.php?t=3527

Page 38 of 43

Re: free exp files : sanity check

Posted: Sun Feb 02, 2025 6:07 pm
by deeds
update :
deeds wrote: Wed Nov 27, 2024 8:43 pm Objective :
- checking the compatibility/sanity of each EXP file
- testing which playing styles fit the best with an engine
- revealing what experience data need to be reinforced
- revealing what missing openings need to be added
- etc.

hardware : dual xeon e5-2660v3, 40 threads, hash 4 GB
software : Arena 3.5.1, TC 1m+1s, partial syzygy 7men
engine : Eman 8.40 played with the nn-e1fb1ade4432.nnue net
experience data : free experience files

tourney mode :
- Experience Read Only=true
- Experience Book=true
- Experience Book Best Move=true
- Experience Book Min Depth=27
- Experience Book Eval Importance=5
- Experience Book Max Moves=100
- Move Overhead (ms)=1000

Opening list : startpos
After 2 rounds :
Image

Re: free exp files : sanity check

Posted: Wed Feb 05, 2025 10:49 am
by deeds
update :
deeds wrote: Fri Dec 13, 2024 4:19 pm Same test with D.C.S.

deeds_chess_system.ini :

Code: Select all

playing_engine = E:\JEUX\ARENA CHESS 3.5.1\Engines\Eman\20T Eman 8.40 x64 BMI2.exe
book_engine = E:\JEUX\ARENA CHESS 3.5.1\Engines\asmFish\20T asmFish 291118 x64 BMI2.exe
log = False
tourney mode :
- Move Overhead (ms)=1000
- OwnBook=false
- BookFile=<empty>
- Experience Read Only=true
- Experience Min Depth=4
- Experience Min Count=1
- DCS Concurrent EXP=false

Opening list : startpos
After 2 rounds :
Image

Re: opening book vs experience file

Posted: Wed Feb 05, 2025 10:55 am
by deeds
hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men, book width = 2

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :     204     71    71.5     100  71.5   43   57    0  57.0       0     1
   2 Cani 230323.bin (Eman 8.40)      :       0   ----    28.5     100  28.5    0   57   43  57.0     204     1

White advantage = 183.22 +/- 35.98
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

Re: pawn-value based exp file vs polyglot bin book

Posted: Wed Feb 05, 2025 11:02 am
by deeds
pawn-value based experience file : experience data purely trained by Eman engine until 8.40 release (before Nov 5, 2022 patch)

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men, book width = 2

Opening list : startpos

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :       0     49    50.0     100  50.0    0  100    0  100.0       0     1
   2 Cani 230323.bin (Eman 8.40)      :       0   ----    50.0     100  50.0    0  100    0  100.0       0     1

White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : GHPPN's 15 most popular openings (Cani 230323's Opening Rate : 53%)

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :       0     92    15.0      30  50.0    0   30    0  100.0       0     1
   2 Cani 230323.bin (Eman 8.40)      :       0   ----    15.0      30  50.0    0   30    0  100.0       0     1

White advantage = 0.00 +/- 46.89
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : 20 first legal moves (Cani 230323's Opening Rate : 20%)

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :       9     81    20.5      40  51.3    2   37    1  92.5       0     1
   2 Cani 230323.bin (Eman 8.40)      :       0   ----    19.5      40  48.8    1   37    2  92.5       9     1

White advantage = -26.35 +/- 40.96
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : Albert Silver's 25 gambit suit (Cani 230323's Opening Rate : 4%)

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :      28     70    27.0      50  54.0    9   36    5  72.0       0     1
   2 Cani 230323.bin (Eman 8.40)      :       0   ----    23.0      50  46.0    5   36    9  72.0      28     1

White advantage = 14.12 +/- 35.64
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings (Cani 230323's Opening Rate : 0%)

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :     204     71    71.5     100  71.5   43   57    0  57.0       0     1
   2 Cani 230323.bin (Eman 8.40)      :       0   ----    28.5     100  28.5    0   57   43  57.0     204     1

White advantage = 183.22 +/- 35.98
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games

Re: pawn-value based exp file vs polyglot bin book

Posted: Wed Feb 05, 2025 11:05 am
by deeds
Overall :

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :      54     27   184.0     320  57.5   54  260    6  81.3       0     1
   2 Cani 230323.bin (Eman 8.40)      :       0   ----   136.0     320  42.5    6  260   54  81.3      54     1

White advantage = 40.54 +/- 13.67
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

002 players               : avg. D31, 002 080 ms/move, 000 320 games, 00 032 457 moves

cani 230323 (eman 8.40)   : avg. D31, 002 167 ms/move, 000 320 games, 00 015 565 moves
depth4_120824 (eman 8.40) : avg. D31, 001 999 ms/move, 000 320 games, 00 016 892 moves

Averages :
0 211 sec/game (4 min/game)
114 plies/game (101 played plies/game)

Game stages :
- opening @ avg. D27, 003 294 ms/move
- middleg @ avg. D28, 001 724 ms/move
- endgame @ avg. D38, 001 260 ms/move

Re: opening book vs experience file

Posted: Mon Feb 10, 2025 12:33 pm
by deeds
hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men, book width = 2

Opening list : startpos

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :       4     50    50.5     100  50.5    1   99    0  99.0       0     1
   2 Brain 110323.bin (Eman 8.40)     :       0   ----    49.5     100  49.5    0   99    1  99.0       4     1

White advantage = 3.51 +/- 25.14
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

Re: opening book vs experience file

Posted: Tue Feb 11, 2025 11:19 am
by deeds
hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men, book width = 2

Opening list : GHPPN's 15 most popular openings

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :      12     94    15.5      30  51.7    1   29    0  96.7       0     1
   2 Brain 110323.bin (Eman 8.40)     :       0   ----    14.5      30  48.3    0   29    1  96.7      12     1

White advantage = 11.70 +/- 46.76
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

Re: opening book vs experience file

Posted: Wed Feb 12, 2025 2:44 pm
by deeds
hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men, book width = 2

Opening list : 20 first legal moves

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :      26     82    21.5      40  53.8    3   37    0  92.5       0     1
   2 Brain 110323.bin (Eman 8.40)     :       0   ----    18.5      40  46.3    0   37    3  92.5      26     1

White advantage = -26.49 +/- 41.17
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

Re: opening book vs experience file

Posted: Thu Feb 13, 2025 8:33 pm
by deeds
hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men, book width = 2

Opening list : Albert Silver's 25 gambit suit

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :      57     70    29.0      50  58.0   11   36    3  72.0       0     1
   2 Brain 110323.bin (Eman 8.40)     :       0   ----    21.0      50  42.0    3   36   11  72.0      57     1

White advantage = 14.40 +/- 35.25
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

Re: opening book vs experience file

Posted: Sun Feb 16, 2025 7:56 pm
by deeds
hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men, book width = 2

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_120824.exp (Eman 8.40)    :     170     65    69.0     100  69.0   39   60    1  60.0       0     1
   2 Brain 110323.bin (Eman 8.40)     :       0   ----    31.0     100  31.0    1   60   39  60.0     170     1

White advantage = 163.38 +/- 33.70
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
All times are UTC+01:00
Page 38 of 43

Powered by phpBB® Forum Software © phpBB Limited