Page 6 of 7

Re: Fringe- Special Engine and Book Tests

Posted: Sun Mar 24, 2024 2:19 pm
by OrgZ
Cengiz-Baba wrote:
Sun Mar 24, 2024 11:46 am
Test book: UHO 2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 killfish190324                 30      35     140   54.3%   62.9% 
   2 Marauders 3.0_avx2             15      32     140   52.1%   68.6% 
   3 Brainlearn27-x86-64-avx2        5      38     140   50.7%   57.1% 
   4 Big-SF 210324-avx2              0      39     140   50.0%   54.3% 
   5 stockfish_24032015             -2      34     140   49.6%   65.0% 
   6 INCOGNITO 7-avx2              -10      34     140   48.6%   64.3% 
   7 corchess_x64_avx2             -15      36     140   47.9%   61.4% 
   8 Raid depth--                  -22      37     140   46.8%   57.9%  
PGN:https://pixeldrain.com/u/JrqXmsuU
:difus_19

Re: Fringe- Special Engine and Book Tests

Posted: Sun Mar 24, 2024 3:11 pm
by Homayoun
Thanks, Cengiz Baba. :difus_19

Re: Fringe- Special Engine and Book Tests

Posted: Mon Mar 25, 2024 9:52 pm
by Cengiz-Baba
Test suit :UHO2024
Hash:64
Thread:1CPU
Time:1+1

Score of corchess220324 vs SF-PB-200324: 36 - 29 - 85 [0.523]
... corchess_x64_avx2 playing White: 35 - 0 - 40 [0.733] 75
... corchess_x64_avx2 playing Black: 1 - 29 - 45 [0.313] 75
... White vs Black: 64 - 1 - 85 [0.710] 150
Elo difference: 16.2 +/- 36.7, LOS: 80.7 %, DrawRatio: 56.7 %
SPRT: llr 0 (0.0%), lbound -inf, ubound inf
150 of 150 games finished.

pgn: https://pixeldrain.com/u/nCzcMEhp

Re: Fringe- Special Engine and Book Tests

Posted: Wed Mar 27, 2024 3:34 pm
by Cengiz-Baba
Test book: UHO 2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Big-SF 220324-avx2             22      37     140   53.2%   57.9% 
   2 Light 26.3-avx2                15      38     140   52.1%   57.1% 
   3 HypnoS-190324_x64_AVX2         15      38     140   52.1%   57.1% 
   4 killfish190324                  7      35     140   51.1%   62.1% 
   5 TacticaL Gear 3.1_avx2          0      38     140   50.0%   55.7% 
   6 Marauders 3.0_avx2            -15      37     140   47.9%   58.6% 
   7 Deep Blue                     -15      40     140   47.9%   52.9% 
   8 stockfish16.1                 -30      42     140   45.7%   47.1%   
pgn: https://pixeldrain.com/u/NNfmA9ge

Re: Fringe- Special Engine and Book Tests

Posted: Wed Mar 27, 2024 3:37 pm
by Cengiz-Baba
Test book: UHO 2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 corchess220324                 10      47     100   51.5%   53.0% 
   2 INCOGNITO 8                     7      45     100   51.0%   56.0% 
   3 HypnoS 240324                 -17      48     100   47.5%   51.0%    
pgn: https://pixeldrain.com/u/iDiPTXWm

Re: Fringe- Special Engine and Book Tests

Posted: Wed Mar 27, 2024 5:01 pm
by OrgZ
:difus_19
Thanks

Re: Fringe- Special Engine and Book Tests

Posted: Wed Mar 27, 2024 6:02 pm
by Cengiz-Baba
OrgZ wrote:
Wed Mar 27, 2024 5:01 pm
:difus_19
Thanks
You're welcome my friend :geek:

Re: Fringe- Special Engine and Book Tests

Posted: Sat Mar 30, 2024 10:49 pm
by Cengiz-Baba
First test:
Test book: Balsa270423
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Light 26.3                     14      11     180   51.9%   95.0% 
   2 SF-PB-220324                   10      10     180   51.4%   96.1% 
   3 JigSaw v5.1                    10       8     180   51.4%   97.2% 
   4 stockfish_24032617              6       8     180   50.8%   97.2% 
   5 Big-SF 220324                   6      11     180   50.8%   95.0% 
   6 HypnoS 240324                   4       9     180   50.6%   96.7% 
   7 INCOGNITO 8                     2       7     180   50.3%   98.3% 
   8 TacticaL Gear 3.1               0       9     180   50.0%   96.7% 
   9 corchess220324                 -2      11     180   49.7%   95.0% 
  10 dragon-3.3                    -49      19     180   43.1%   85.0%
  
1. pgn: https://pixeldrain.com/u/9pvmYAEM


Second test:
Test book: UHO2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Big-SF 220324                  35      38     180   55.0%   45.6% 
   2 SF-PB-220324                   29      35     180   54.2%   52.8% 
   3 HypnoS 240324                  21      37     180   53.1%   47.2% 
   4 Light 26.3                     15      36     180   52.2%   51.1% 
   5 TacticaL Gear 3.1              15      35     180   52.2%   52.2% 
   6 stockfish_24032617             14      35     180   51.9%   51.7% 
   7 corchess220324                 14      35     180   51.9%   51.7% 
   8 INCOGNITO 8                    -2      37     180   49.7%   47.2% 
   9 JigSaw v5.1                    -6      38     180   49.2%   45.0% 
  10 dragon-3.3                   -143      34     180   30.6%   52.2%
  
2. pgn: https://pixeldrain.com/u/cE441CCJ


Dear friends

Here are two tournaments with the same engine but different books. With the UHO opening book, we ensured fewer draws, while the Balsa opening book was evaluated by offering higher draws.

Conclusion:

I think we need more games to evaluate the results of the tournament where no parameters changed. As my dear friend Sedat said, we cannot see a similarity in the results.

Best regards,
Fringe.

Re: Fringe- Special Engine and Book Tests

Posted: Sun Mar 31, 2024 10:09 am
by OrgZ
Thanks for the tests dear Fringe :difus_19

Re: Fringe- Special Engine and Book Tests

Posted: Sun Mar 31, 2024 11:49 am
by Sedat Canbaz
Cengiz-Baba wrote:
Sat Mar 30, 2024 10:49 pm
First test:
Test book: Balsa270423
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Light 26.3                     14      11     180   51.9%   95.0% 
   2 SF-PB-220324                   10      10     180   51.4%   96.1% 
   3 JigSaw v5.1                    10       8     180   51.4%   97.2% 
   4 stockfish_24032617              6       8     180   50.8%   97.2% 
   5 Big-SF 220324                   6      11     180   50.8%   95.0% 
   6 HypnoS 240324                   4       9     180   50.6%   96.7% 
   7 INCOGNITO 8                     2       7     180   50.3%   98.3% 
   8 TacticaL Gear 3.1               0       9     180   50.0%   96.7% 
   9 corchess220324                 -2      11     180   49.7%   95.0% 
  10 dragon-3.3                    -49      19     180   43.1%   85.0%
  
1. pgn: https://pixeldrain.com/u/9pvmYAEM


Second test:
Test book: UHO2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Big-SF 220324                  35      38     180   55.0%   45.6% 
   2 SF-PB-220324                   29      35     180   54.2%   52.8% 
   3 HypnoS 240324                  21      37     180   53.1%   47.2% 
   4 Light 26.3                     15      36     180   52.2%   51.1% 
   5 TacticaL Gear 3.1              15      35     180   52.2%   52.2% 
   6 stockfish_24032617             14      35     180   51.9%   51.7% 
   7 corchess220324                 14      35     180   51.9%   51.7% 
   8 INCOGNITO 8                    -2      37     180   49.7%   47.2% 
   9 JigSaw v5.1                    -6      38     180   49.2%   45.0% 
  10 dragon-3.3                   -143      34     180   30.6%   52.2%
  
2. pgn: https://pixeldrain.com/u/cE441CCJ


Dear friends

Here are two tournaments with the same engine but different books. With the UHO opening book, we ensured fewer draws, while the Balsa opening book was evaluated by offering higher draws.

Conclusion:

I think we need more games to evaluate the results of the tournament where no parameters changed. As my dear friend Sedat said, we cannot see a similarity in the results.

Best regards,
Fringe.
Dear Fringe,

Many thanks.. useful, reasonable test!
Now we have more data to compare...

Greetings )