[STS 1-13] Critter 0.90

Discussion about chess-playing software (engines, hosts, opening books, platforms, etc...)
Post Reply
User avatar
Swaminathan
Posts: 375
Joined: Wed Jun 09, 2010 12:14 pm

[STS 1-13] Critter 0.90

Post by Swaminathan »

Results of STS 1-13 for
Critter 0.90:
Single CPU, Q6600, 32 bits, Arena 2.5 beta

Code: Select all

STS 01: 94
STS 02: 80
STS 03: 84
STS 04: 89
STS 05: 86
STS 06: 84
STS 07: 83
STS 08: 74
STS 09: 79
STS 10: 85
STS 11: 84
STS 12: 83
STS 13: 84
Total:

Code: Select all

1089/1300

I had sent the logfile to Gailhac to see if STS Stat could be made to work with scores from STS 13 taken into account.


Critter 0.80

Image

In comparison with Critter 0.70

Image

http://sites.google.com/site/strategict ... st-results

1000 Positions
10 seconds per position
Hardware: Q6600, 32 bits, 2 GB RAM, 2.4 GHZ. Arena 2.01 GUI.
Logo made by Ulysses P (Vytron)
Co-Authored with Dann Corbit: Strategic Test Suite
BB+
Posts: 1484
Joined: Thu Jun 10, 2010 4:26 am

Re: [STS 1-13] Critter 0.90

Post by BB+ »

Stockfish 1.9 only had 975/1200 on the first 12 tests, while Critter 0.90 got 1005.
kingliveson
Posts: 1388
Joined: Thu Jun 10, 2010 1:22 am
Real Name: Franklin Titus
Location: 28°32'1"N 81°22'33"W

Re: [STS 1-13] Critter 0.90

Post by kingliveson »

Take this with a grain of salt as it's a small sample. Both engines play the same positions as white/black:

PAWN : Knight >> Bishop >> Rook >>Queen
kingliveson
Posts: 1388
Joined: Thu Jun 10, 2010 1:22 am
Real Name: Franklin Titus
Location: 28°32'1"N 81°22'33"W

Re: [STS 1-13] Critter 0.90

Post by kingliveson »

Critter vs Houdini:


Critter vs IvanHoe:
PAWN : Knight >> Bishop >> Rook >>Queen
User avatar
Swaminathan
Posts: 375
Joined: Wed Jun 09, 2010 12:14 pm

Re: [STS 1-13] Critter 0.90

Post by Swaminathan »

BB+ wrote:Stockfish 1.9 only had 975/1200 on the first 12 tests, while Critter 0.90 got 1005.
Frank Quisinsky recommended me to test Stockfish 1.91 (which is reportedly much much better than 1.9)
I hadn't gotten around to testing it. I had only tested 1.9 which is slightly weaker.

From what I've seen

Stockfish 1.91 > Critter 0.9 > Stockfish 1.9
Logo made by Ulysses P (Vytron)
Co-Authored with Dann Corbit: Strategic Test Suite
User avatar
Swaminathan
Posts: 375
Joined: Wed Jun 09, 2010 12:14 pm

Re: [STS 1-13] Critter 0.90

Post by Swaminathan »

Another reason might be that authors of Stockfish don't often tune their engine and optimise it with STS, they just make changes and do few tests.

Richard Vida certainly does both. He constantly reviews performance in both STS and actual tests.

This is perhaps why Critter may be optimised to do better. But it's very small difference though.
Logo made by Ulysses P (Vytron)
Co-Authored with Dann Corbit: Strategic Test Suite
ernest
Posts: 247
Joined: Thu Sep 02, 2010 10:33 am

Re: [STS 1-13] Critter 0.90

Post by ernest »

Swaminathan wrote:Frank Quisinsky recommended me to test Stockfish 1.91 (which is reportedly much much better than 1.9)
This is stupid : in infinite analysis 1.9 and 1.91 give exactly the same PVs
(which is also what the Stockfish authors said, when giving out the 1.91)

In 64-bit, the 1.91 is even 2-3% faster than 1.9
kingliveson
Posts: 1388
Joined: Thu Jun 10, 2010 1:22 am
Real Name: Franklin Titus
Location: 28°32'1"N 81°22'33"W

Re: [STS 1-13] Critter 0.90

Post by kingliveson »

Knew something was missing -- here it is vs Rybka:
PAWN : Knight >> Bishop >> Rook >>Queen
User avatar
Swaminathan
Posts: 375
Joined: Wed Jun 09, 2010 12:14 pm

Re: [STS 1-13] Critter 0.90

Post by Swaminathan »

ernest wrote:
Swaminathan wrote:Frank Quisinsky recommended me to test Stockfish 1.91 (which is reportedly much much better than 1.9)
This is stupid : in infinite analysis 1.9 and 1.91 give exactly the same PVs
(which is also what the Stockfish authors said, when giving out the 1.91)

In 64-bit, the 1.91 is even 2-3% faster than 1.9
In 32 bit, it's even faster,

http://talkchess.com/forum/viewtopic.ph ... 32&t=36565
Logo made by Ulysses P (Vytron)
Co-Authored with Dann Corbit: Strategic Test Suite
Post Reply