Re: when a daily tester should review his tests

General discussion about computer chess...
User avatar
deeds
Posts: 1498
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester lies to people...

Post by deeds »

When a TD tried to test which engine has the best learning feature :

Image
source

But there are tons of problems :
- engines came with different nets
- engine's releases weren't up to date on the same date
- engines came with different experience files
- experience files had different experience rate for each of the 60 openings
- each engine didn't play min. 500 games/opening
- etc.


So it is unclear whether the engine won because of its newer net/release or its better learning feature or its more accurate experience data. :lol:

ps : same problems here too.
User avatar
deeds
Posts: 1498
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester lies to people...

Post by deeds »

When a TD tried to measure dictionaries/databases :

Image
source

But there are tons of problems :
- evaluations by a different engine than the one that evaluated the experience data => merged EXP file
- disrespect for pawn-based and wdl-based engine's evaluations
- disrespect for pawn-based and wdl-based experience data
- disrespect for nnue and non-nnue experience data
- experience files had different experience rate for each of main openings of books
- EXP files added to a tourney but set to training mode
- etc.


So it is unclear whether the player won because of its file or its engine or its mode :lol:

ps : same problems here too.
User avatar
deeds
Posts: 1498
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester lies to people...

Post by deeds »

Image
source

Image
-
Image
-
Image
User avatar
deeds
Posts: 1498
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester lies to people...

Post by deeds »

Image
-
Image
-
Image
-
Image
-
Image
User avatar
deeds
Posts: 1498
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester lies to people...

Post by deeds »

Image
-
Image
-
Image
Anton101
Posts: 793
Joined: Sat Jun 10, 2023 6:46 pm
Real Name: A. Ces
Location: México

Re: when a daily tester lies to people...

Post by Anton101 »

Some books (like this one) are sent to me through the "private", actually I haven't even tried it, I don't have that much free time, Hurnavich's books are good books.

I have more books and I'll release in the next days.

On the other hand, I have a good relationship with Sedat and many others.

Merry Xmas Deeds.
Anton101
Posts: 793
Joined: Sat Jun 10, 2023 6:46 pm
Real Name: A. Ces
Location: México

Re: when a daily tester should review his tests

Post by Anton101 »

You were doing fine, until you mentioned that I merge experience files. I don't do it, I don't have the time or interest in doing it. By the way, I have not shared my experience files from 2024. That Telegram is over-surveilled, is there something that is not under surveillance on the network?

My relationship with other users is zero, sometimes with Sedat, I think not for 6 months either.

Regards;
Martin_1969
Posts: 28
Joined: Mon Jul 03, 2023 6:53 am

Re: when a daily tester lies to people...

Post by Martin_1969 »

Another year ends and you're still bringing stories from 2022. Move on, boy. Life is way too short to get upset about this stuff. I wish you and everyone here a happy new year.
Post Reply