IvanHoe T52 testing

As in chess tournaments and matches...
Post Reply
User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: IvanHoe T52 testing

Post by robbolito » Thu Aug 26, 2010 1:39 pm

AMD Phenom(tm) II X6 1090T Processor6x @ 3.2 GHz 4,096 MB Memory
Windows 7 Home Premium Edition (Build 7600)
Fritz Benchmark:
Speed: 23.33
KNS: 11196
GUI: CB Rybka 3
Book: Perfect 2010- 10 moves
Hash: 256
RB and TB: ON
Ponder: OFF

Blitz:10' 0

Code: Select all

1   Ivanhoe 52fUS-beta-x64   3190  +7/-6/=37 51.00%   25.5/50
2   Houdini 1.03a x64 8_CPU  3190  +6/-7/=37 49.00%   24.5/50


User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: IvanHoe T52 testing

Post by robbolito » Fri Aug 27, 2010 1:37 pm

Intel(R) Core(TM) i7 4CPU 960 3.20GHz8x @ 4.005 GHz with 4,096 MB Memory
Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 24.98
KNS: 11988
GUI: CB Rybka 3
Book: Perfect 2009-10 moves
Hash: 256
RB and TB: ON
Ponder: OFF


Blitz:10' 0

Code: Select all

1   IvanHoe 9.52b x64 KLO    3190  +8/-7/=35 51.00%   25.5/50
2   Houdini 1.03a x64 4_CPU  3190  +7/-8/=35 49.00%   24.5/50


User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: IvanHoe T52 testing

Post by robbolito » Sat Aug 28, 2010 2:43 am

Intel(R) Core(TM)2 Quad Q9550 2.83GHz4x @3.5 GHz 4,096 MB Memory
Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 20.90
KNS: 10032
GUI: CB Rybka 3
Book: Perfect 2009-10 moves
Hash: 256
RB and TB: ON
Ponder: OFF

Blitz:10' 0

Code: Select all

1   IvanHoe T0.2.x64  3190  +6/-5/=19 51.67%   15.5/30
2   Deep Rybka 4 x64  3190  +5/-6/=19 48.33%   14.5/30


JackStraw
Posts: 60
Joined: Thu Jun 10, 2010 12:14 pm
Real Name: Tom Glenn

Re: IvanHoe T52 testing

Post by JackStraw » Sat Aug 28, 2010 4:06 pm

Testing various styles of IH 52eU vs Rybka 4 :

4'2" / i7-940 @ 3.75 / 3 cores ea / ponder off / Vista x64 / F12 / 512 mg / Nunn2 openings /

Rybka 4 default settings + 3-4-5 egtb

Ivanhoe - default except 64 mg pawn hash + Robbobases


1.IH 52eU ( IvanHoe style )............52...........+22,-18,=60
Rybka 4..................................48

2.IH 52eU ( Custom style )............49.5.........+23,-24,=53
Rybka 4..................................50.5

3.IH 52eU ( Firebird style )............45.5.........+20,-29,=51
Rybka 4..................................54.5

4.IH 52eU ( B12c style )................45.5.........+17,-26,=57
Rybka 4..................................54.5

----------------------------------------------

Also , ( same settings )

Ivanhoe T0.1.........................50...............+19,-19.=62
Rybka 4...............................50

Ivanhoe T0.2.........................46.5............+18,-25.=57
Rybka 4...............................53.5

Tom Glenn

User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: IvanHoe T52 testing

Post by robbolito » Mon Aug 30, 2010 3:09 am

Intel(R) Core(TM) i7 CPU 960 3.2 GHz8x @ 4.005 GHz 4,096 MB Memory
Windows 7 Professional Professional (Build 7600)
Fritz Benchmarks:
Speed: 24.89
KNS: 11946
GUI: CB Rybka 3
Hash: 256
Book: Perfect 2010-10 moves
RB and TB: ON
Ponder: OFF


Blitz:10' 0

Code: Select all

1   Ivanhoe 52gU-x64  3190  +8/-3/=9 62.50%   12.5/20
2   Deep Rybka 4 x64  3190  +3/-8/=9 37.50%    7.5/20
Hi Tom,
it is nice to have a testing companion.
This is new version from Vlad0 and on Qi7 this is very nice score against Rybka 4.
Since the score could indicate very strong engine I will continue testing this version.

User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: IvanHoe T52 testing

Post by robbolito » Mon Aug 30, 2010 11:06 pm

Intel(R) Core(TM) i7 4CPU 960 3.20GHz8x @ 4.005 GHz with 4,096 MB Memory
Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 24.98
KNS: 11988
GUI: CB Rybka 3
Book: Perfect 2009-10 moves
Hash: 256
RB and TB: ON
Ponder: OFF

Blitz:10' 0

Code: Select all

1   Houdini 1.03a x64 4_CPU  3190  +2/-2/=16 50.00%   10.0/20  100.00
2   Ivanhoe 52gU-x64         3190  +2/-2/=16 50.00%   10.0/20  100.00


User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: IvanHoe T52 testing

Post by robbolito » Tue Aug 31, 2010 1:38 pm

Intel(R) Core(TM)2 Quad Q9550 2.83GHz4x @3.5 GHz 4,096 MB Memory
Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 20.90
KNS: 10032
GUI: CB Rybka 3
Book: Perfect 2009-10 moves
Hash: 256
RB and TB: ON
Ponder: OFF
Attachments
2010-08-31_073529.png
2010-08-31_073529.png (3.85 KiB) Viewed 1654 times

JackStraw
Posts: 60
Joined: Thu Jun 10, 2010 12:14 pm
Real Name: Tom Glenn

Re: IvanHoe T52 testing

Post by JackStraw » Tue Aug 31, 2010 4:34 pm

4'2" / i7-940 @ 3.75 / 3 cores ea / ponder off / Vista x64 / F12 / 512 mg / Nunn2 openings /

Rybka 4 default settings + 3-4-5 egtb

Ivanhoe - default except 64 mg pawn hash + Robbobases

Testing : IvanHoe 52gU + High Priority Search on , diff styles

IvanHoe(custom style).............50.5.............+19,-18,=63
Rybka4...............................49.5

IvanHoe(ivanhoe style)............49................+20,-22,=58
Rybka4...............................51

Tom Glenn

hyatt
Posts: 1242
Joined: Thu Jun 10, 2010 2:13 am
Real Name: Bob Hyatt (Robert M. Hyatt)
Location: University of Alabama at Birmingham
Contact:

Re: IvanHoe T52 testing

Post by hyatt » Tue Aug 31, 2010 9:54 pm

JackStraw wrote:4'2" / i7-940 @ 3.75 / 3 cores ea / ponder off / Vista x64 / F12 / 512 mg / Nunn2 openings /

Rybka 4 default settings + 3-4-5 egtb

Ivanhoe - default except 64 mg pawn hash + Robbobases

Testing : IvanHoe 52gU + High Priority Search on , diff styles

IvanHoe(custom style).............50.5.............+19,-18,=63
Rybka4...............................49.5

IvanHoe(ivanhoe style)............49................+20,-22,=58
Rybka4...............................51

Tom Glenn

I am seriously hoping nobody is drawing conclusions from these kinds of results??? The error bar is huge. There's not enough information to prove which is better, much less by how much.

User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: IvanHoe T52 testing

Post by robbolito » Tue Aug 31, 2010 10:33 pm

hyatt wrote:
JackStraw wrote:4'2" / i7-940 @ 3.75 / 3 cores ea / ponder off / Vista x64 / F12 / 512 mg / Nunn2 openings /

Rybka 4 default settings + 3-4-5 egtb

Ivanhoe - default except 64 mg pawn hash + Robbobases

Testing : IvanHoe 52gU + High Priority Search on , diff styles

IvanHoe(custom style).............50.5.............+19,-18,=63
Rybka4...............................49.5

IvanHoe(ivanhoe style)............49................+20,-22,=58
Rybka4...............................51

Tom Glenn

I am seriously hoping nobody is drawing conclusions from these kinds of results??? The error bar is huge. There's not enough information to prove which is better, much less by how much.
Dr.Hyatt,
these are just scores from the games played.No conclusions are drawn due to small number of games.Also takes time to collect enough games for some meaningful conclusion.At 10 min. per engine just for 30 games it takes more than 9 hours to finish .But if more people would participate in the testing decent number of games could be collected for reasonable conclusion.
These games are also for fun of testing new versions that are released in attempt to make the engines better.Some are successful and some are not but IH engines are group project that is still going in full swing.

Post Reply