Houdini 2.0 Pro WTNP testing

As in chess tournaments and matches...
User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 2.0 Pro WTNP testing

Post by robbolito » Mon Sep 05, 2011 4:18 pm

Intel(R) Core(TM) i7 Q- 960 3.20 GHz8x @ 4.00 GHz 18.00 MB Memory
Windows 7 Professional Professional (Build 7600)
Fritz Benchmarks:
Speed: 24.89
KNS: 11946
GUI: CB Rybka 3
Hash: 256
Book: Perfect 2011 -10 moves
GTB: ON
Ponder: OFF
Blitz:10' 0

Code: Select all

1   Houdini 2.0 Pro x64      3195  +17/-10/=33 55.83%   33.5/60
2   Critter 1.2 64-bit SSE4  3190  +10/-17/=33 44.17%   26.5/60


User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 2.0 Pro WTNP testing

Post by robbolito » Mon Sep 05, 2011 5:54 pm

Intel(R) Core(TM)2 Quad Q9550 2.83GHz4x @3.5 GHz 4,096 MB Memory
Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 20.90
KNS: 10032
GUI: CB Rybka 3
Book: Perfect 2011-10 moves
Hash: 256
GTB and TB: ON
Ponder: OFF
Blitz:10' 0

Code: Select all

1   Houdini 2.0 Pro x64  3195  +54/-17/=49 65.42%   78.5/120
2   Deep Rybka 4.1 x64   3190  +17/-54/=49 34.58%   41.5/120



User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 2.0 Pro WTNP testing

Post by robbolito » Sat Sep 17, 2011 10:56 am

AMD Phenom(tm) II X6 1090T Processor x6 @3.80 GHz 8.00 MB Memory
Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 28.33
KNS: 13599
GUI: CB Rybka 3
Book: Perfect 2011-10 moves
Hash: 256
GTB and TB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0 Pro x64L      3195  +144/-73/=201 58.49%  244.5/418
2   Deep Rybka 4.1 SSE42 x64  3190  +73/-144/=201 41.51%  173.5/418

User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 2.0 Pro WTNP testing

Post by robbolito » Sat Sep 17, 2011 2:18 pm

Intel(R) Core(TM) i5 Q- 750 @2.67 GHz 6.00 GB Memory
Windows 7.x64 Professional (Build 7600)
Fritz Benchmarks:
Speed:16.84
KNS: 8082
GUI: CB Rybka 3
Hash: 256
Book: Perfect 2011-10 moves
TB and GTB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0 Pro x64L      3195  +298/-112/=340 62.40%  468.0/750
2   Deep Rybka 4.1 SSE42 x64  3190  +112/-298/=340 37.60%  282.0/750

User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 2.0 Pro WTNP testing

Post by robbolito » Sat Sep 17, 2011 2:52 pm

Intel(R) Core(TM)2 Quad Q9550 2.83GHz4x @3.5 GHz 4,096 MB Memory
Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 20.90
KNS: 10032
GUI: CB Rybka 3
Book: Perfect 2011-10 moves
Hash: 256
TB and GTB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0 Pro x64L  3195  +352/-83/=301 68.27%  502.5/736
2   Deep Rybka 4.1 x64    3190  +83/-352/=301 31.73%  233.5/736

User avatar
kingliveson
Posts: 1388
Joined: Thu Jun 10, 2010 1:22 am
Real Name: Franklin Titus
Location: 28°32'1"N 81°22'33"W

Re: Houdini 2.0 Pro WTNP testing

Post by kingliveson » Sat Sep 17, 2011 6:48 pm

Thanks robbolito for the tests; you have always been kind to providing games whenever requested so personally, I dont need to see them -- just want to make some observations.

Elo difference amongst the different systems between Rybka 4.1 and Houdini 2.0:

AMD Phenom(tm) II X6 1090T: 60
Intel(R) Core(TM) i5 Q- 750: 88
Intel(R) Core(TM)2 Quad Q9550: 133

It is normal for one program to do better on certain architectures, but difference for the Q9550 is a bit high even given error margin, and considering it is being speculated the true Elo difference is ~64.

For 736 games, error bar is +/- 18, so 100 difference is normal.

Edit:
Looking at http://www.clemens-keck.de/base.htm, Houdini 2.0 is ranked 3023 (+/- 11), and Rybka 4.1, 2949 (+/- 9). If we factor in the errors, including the one for 736 games, you get 130 Elo difference. Now, I guess it doesn't look so abnormal after-all. :)
PAWN : Knight >> Bishop >> Rook >>Queen

User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 2.0 Pro WTNP testing

Post by robbolito » Sat Sep 17, 2011 10:20 pm

Hi King,
thanks for your review of the scores.You made some sense out of it.
All the games played are posted with the scores on the Immortal chess for those who want to review them or use them for some other purposes.
It is interesting how the scores can vary from one computer to another.Rybka has usually done better on the faster computers.Q 9550 I use is my oldest MP computer so I don't know if that has to do something the way engines are playing .
Has been some time since I was in touch with you.Hope that things are OK and that you are doing fine.
Regards,
robbolito.

User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 2.0 Pro WTNP testing

Post by robbolito » Thu Nov 03, 2011 11:54 pm

AMD Phenom(tm) II X6 1090T Processor x6 @3.80 GHz 8.00 MB Memory
Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 28.33
KNS: 13599
GUI: CB Rybka 3
Book: Various book openings
Hash: 256
GTB and TB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0b Pro x64      3195  +103/-38/=99 63.54%  152.5/240
2   Deep Rybka 4.1 SSE42 x64  3190  +38/-103/=99 36.46%   87.5/240

Attachments
AMD.x6 Testing.rar
(380.63 KiB) Downloaded 290 times

User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 2.0 Pro WTNP testing

Post by robbolito » Wed Nov 23, 2011 1:25 am

Intel(R) Core(TM) i7 4CPU 960 3.20 GHz x8 @ 4.00 GHz with 17.9 MB Memory
Microsoft Windows XP 64 Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 24.98
KNS: 11988
GUI: CB Rybka 3
Hash: 256
GTB and RB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0c Pro x64      3195  +18/-4/=18 67.50%   27.0/40
2   Deep Rybka 4.1 SSE42 x64  3190  +4/-18/=18 32.50%   13.0/40
First 20 games played with Attacker 4 Ctg.
Last 20 games played with Perfect 2009 Ctg
Attachments
i7 XP.x64 Games.rar
(65.08 KiB) Downloaded 274 times

User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 2.0 Pro WTNP testing

Post by robbolito » Wed Nov 23, 2011 8:52 pm

Intel(R) Core(TM) i7 4CPU 960 3.20 GHz x8 @ 4.00 GHz with 17.9 MB Memory
Microsoft Windows XP 64 Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 24.98
KNS: 11988
GUI: CB Rybka 3
Book: Perfect 2009-10 moves
Hash: 256
TB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0c Pro x64      3195  +32/-7/=41 65.63%   52.5/80
2   Deep Rybka 4.1 SSE42 x64  3190  +7/-32/=41 34.38%   27.5/80


Post Reply