Not logged inRybka Chess Community Forum
Up Topic The Rybka Lounge / Computer Chess / Test suites ?
- - By cc2150dx (**) Date 2020-08-25 00:02
When it comes to tactical test suites, what's recommended for cores and time for each position ? tablebases yes/no ?

Parent - - By user923005 (****) Date 2020-08-25 04:54 Upvotes 1
Often, a test suite comes with recommendations.
But you can always ignore them.
If you want to try to solve them all, start with all your threads available -1.
For time, look at how many problems there are and how long you want to let it run.
If it is a new test suite, I sometimes let them run all night.
So take the time you want to allow, and divide by the problem count.
That gives you seconds.

The best solver is Bluefish XI-LP FD with tactical=2 and defensive=off. Nobody else is very close.
The new Stockfish versions with nnue are a hoot too.  Here is my special compile:
I have pre-built files for the new AMD, for modern 64 bit, and old 64 bit.
You will want to get another verson or build your own for PEXT type CPUs.
You will probably want to turn off the special logging command in the UCI settings.
I assume you know where to find the good NNUE "brain" files.

Always enable tablebase files.  I have mine on ludicrous fast PCIE 4.0 gumstick SSDs that are much faster than normal SSDs.
I see tablebase hits on the root position of chess in about a minute on an AMD 3970x.  Much sooner on most test problems.
Think of your engine quering the Syzygy tablebase files as "talking to God" because the information is perfect.

Parent - By user923005 (****) Date 2020-08-25 05:05 Edited 2020-08-25 05:10 Upvotes 1
Practical example:
AMD 3970x has 32 cores and 64 threads in my configuration.
So allocate 63 threads.
Suppose you want to let the test run 8 hours, while you sleep.
8 hrs * 3600 sec/hr = 28800 seconds allowed.
Suppose that there are 250 problems.
Then 28800/250=115 seconds per problem
If you want to let it run for one hour, it would be 3600/250=14.4 seconds per problem.
If you run from the command line, you can get resolution to 1/1000 of a second.

If you get a problem wrong with a strong engine, do not assume that your program did not get the correct answer.
Look at the analysis created.  If the score is mate, you at least found an alternate solution.  Maybe even an improvement.
If the score is big and not repeating (e.g. 14 scores of 299 in a row is probably a draw) then you might have found an alternate solution.
It is like spelunking in caves and you might find a new creature that nobody ever saw before.
Parent - - By cc2150dx (**) Date 2020-08-25 05:38
Thanks for all the info :grin:

Where can I get Bluefish XI-LP FD ?

Parent - - By user923005 (****) Date 2020-08-25 05:52
Here is the version that I built:

It automatically sets tactical=2 and defensive=off.
You will probably want to turn of the UCI setting for logging, which I wrote for my own purposes.
It writes human readable analysis to disk, which I can parse and insert directly into my database.
Parent - - By witchesbutt (***) Date 2020-08-25 06:35

Many thanks !
Parent - - By user923005 (****) Date 2020-08-25 06:55
c'est du rien.
Parent - By witchesbutt (***) Date 2020-08-25 08:29

c'est une p├ępite pour moi
merci !

Parent - By witchesbutt (***) Date 2020-08-25 06:34

Many thanks !
Up Topic The Rybka Lounge / Computer Chess / Test suites ?

Powered by mwForum 2.27.4 © 1999-2012 Markus Wichitill