Not logged inRybka Chess Community Forum
Up Topic The Rybka Lounge / Test Positions / Tough Tactical Test 2
- - By dorszcz (**) Date 2021-02-20 18:19 Upvotes 2
The second edition of Tough Tactical Test with 100 various positions for testing engines. Thanks to Dann Corbit for all help.

Conditions:
Time limit: 15 seconds per position
CPU: i5-3570 (MP engines: 4x3600 MHz, SP engines: 1x3800MHz)
Tablebases: 6-pieces Syzygy, 5-pieces Gaviota, 5-pieces (and ~80 GB of most popular 6-pieces) Nalimov, all on SSD
Strongest version of engine is used: 64 bit, POPCNT, SSE4.2 etc.
256 MB hash, no books, no learning, 50 move rule is enabled

Results:
80 out of 100 = 80%  -  Black Diamond XI-NN (nn-62ef826d1a6d; Tactical=2)
68 out of 100 = 68%  -  Black Diamond XI-NN (nn-62ef826d1a6d)
64 out of 100 = 64%  -  Crystal 190121
64 out of 100 = 64%  -  Bluefish XI-LP FD (Tactical=2; defensive=off)
52 out of 100 = 52%  -  SF NNUE halfkp-256 090720 (1403)
51 out of 100 = 51%  -  Bluefish XI-LP FD
44 out of 100 = 44%  -  Stockfish 110221
23 out of 100 = 23%  -  Eman 4.00
23 out of 100 = 23%  -  Black Diamond XR7
21 out of 100 = 21%  -  CorChess 3.1 260819
20 out of 100 = 20%  -  MateFinder 260819
18 out of 100 = 18%  -  Crystal 260819
15 out of 100 = 15%  -  Crystal-Honey X5i
14 out of 100 = 14%  -  Honey X5i
13 out of 100 = 13%  -  Bluefish FD 100919
13 out of 100 = 13%  -  AsmFishWCP_2019-07-23
12 out of 100 = 12%  -  SugaR-NN 130819
11 out of 100 = 11%  -  Cfish 240719
10 out of 100 = 10%  -  Komodo 11.01
8 out of 100 = 8%  -  Sting 18
8 out of 100 = 8%  -  Stockfish 10
7 out of 100 = 7%  -  Sting 14
5 out of 100 = 5%  -  Andscacs 0.95
4 out of 100 = 4%  -  Spark-1.0
4 out of 100 = 4%  -  Deep Rybka 4
3 out of 100 = 3%  -  IvanHoe 9.46b
2 out of 100 = 2%  -  Stockfish 5
2 out of 100 = 2%  -  Critter 1.6a
2 out of 100 = 2%  -  Equinox 3.30
2 out of 100 = 2%  -  Sting SF 3 VE
2 out of 100 = 2%  -  Xiphos 0.5.6 SSE
2 out of 100 = 2%  -  Houdini 1.5a
2 out of 100 = 2%  -  Rybka WinFinder 2.2
1 out of 100 = 1%  -  Rybka 3 Dynamic
1 out of 100 = 1%  -  Naum 4.6
1 out of 100 = 1%  -  Xiphos 0.5.3
1 out of 100 = 1%  -  Nirvanachess 2.4
1 out of 100 = 1%  -  Xiphos 0.6
1 out of 100 = 1%  -  RubiChess 1.6
1 out of 100 = 1%  -  Wasp 3.75
1 out of 100 = 1%  -  Fire 2.2+ xTreme GH
1 out of 100 = 1%  -  Spike 1.4
1 out of 100 = 1%  -  Arasan 21.3
1 out of 100 = 1%  -  Texel 1.08a11
1 out of 100 = 1%  -  Marvin 3.4.0
1 out of 100 = 1%  -  Booot 6.3.1
0 out of 100 = 0%  -  SmarThink 1.98 (1CPU)
0 out of 100 = 0%  -  Alfil 13.1
0 out of 100 = 0%  -  Gull 3
0 out of 100 = 0%  -  Nemorino_5.00
0 out of 100 = 0%  -  RubiChess 1.5
0 out of 100 = 0%  -  Fire 7.1
0 out of 100 = 0%  -  Wasp 3.60
0 out of 100 = 0%  -  rofChade 2.2
0 out of 100 = 0%  -  Topple 0.7.3
0 out of 100 = 0%  -  Pedone 1.9
0 out of 100 = 0%  -  Rodent III 0.273
0 out of 100 = 0%  -  Protector 1.9.0
0 out of 100 = 0%  -  Fritz 11 SE (1CPU)
0 out of 100 = 0%  -  Laser 1.7
0 out of 100 = 0%  -  Senpai 2.0
0 out of 100 = 0%  -  ICE 3.0 (1CPU)
0 out of 100 = 0%  -  Amoeba 3.0
0 out of 100 = 0%  -  Bobcat 3.25
0 out of 100 = 0%  -  RofChade 2.1
0 out of 100 = 0%  -  Deep iCE 4.0.853

Download: https://www.mediafire.com/file/ehjqnb6jbnwtpin/Tough_Tactical_Test_2_20.02.2021.zip/file
Parent - - By Ray (****) Date 2021-02-21 03:57
Hi, apologies for being a noob at this, despite being in computer chess for well over 10 years I have never run test suites like this. How is it done ?  Through a GUI ?  I have Shredder GUI (SMK) plus a selection of the freely available ones.
Parent - - By user923005 (****) Date 2021-02-21 06:03
It is possible to perform analysis without a GUI, but it is much more commonly done using a GUI.
Pretty much every modern chess GUI has ability to process and EPD test suite.
That includes free GUIs like Arena and professional GUIs like ChessAssistant.

From the Shredder Manual:
"Analyse  Positions Shredder  can  automatically  analyze  all  positions  in  an  EPD,  PGN  or  CBF  file.  For  every  position  one or  more  solutions  can  be  defined.  When  the  analysis  is  completed  Shredder  displays  a  statistics  with the  solution  times  for  all  positions. Also  two  files  with  the  statistics  will  be  generated  in  the  Shredder directory.  One  is  in  EPD  format  and  one  in  CSV  format  which  can  be  directly  imported  in  many  spread sheet  programs  for  further  examination."
Parent - By Ray (****) Date 2021-02-21 06:20
Thanks, I'll try it.
Parent - - By Carl Bicknell (*****) Date 2021-02-21 14:13
Thanks.

This isn't quite what you intended but I wanted to test this suite at longer TC and faster hardware.

Ryzen 3950X
30 Threads used for engines.
2 minutes per position.

Stockfish 13
88/100 solved
Average solve time = 12.83s

Black Diamond 13 (Tactical = 2)
90/100 solved
Average solve time = 9.90s

I'll now try Houdini 6 Tactical
Parent - - By dorszcz (**) Date 2021-02-21 14:58
You should try the same version of Black Diamond I used. It will solve about 95-96 positions with your conditions.
Parent - - By Carl Bicknell (*****) Date 2021-02-21 18:22
Do you have a download link for that engine? I found it but it gets 10% so something is wrong, just wondering if you have a better link please.

Also, do you set tactical = 2 ?
Parent - - By dorszcz (**) Date 2021-02-21 18:44
https://github.com/MichaelB7/Stockfish/releases/download/NN/Windows-AVX2-NN.zip
When you unzip, create folder eval in engines directory and put this net inside https://tests.stockfishchess.org/api/nn/nn-62ef826d1a6d.nnue
When you create UCI engine replace nn.bin with nn-62ef826d1a6d.nnue in engine settings and set tactical=2 for the best results in test suites.
Parent - By Carl Bicknell (*****) Date 2021-02-21 19:22
Thanks.

Something is very wrong because it's coming up with non-sensical moves and very weak play. I'm wondering if this version has become corrupted somehow.
Parent - - By Carl Bicknell (*****) Date 2021-02-23 19:24
Under the conditions quoted above by me, Black Diamond XI with your net gets:

93 / 100
average solve time = 5.82s

This is incredibly fast and I'm wondering what's so special about that net..

This test suite is fascinating and very well made. However, I wouldn't call it a "tactical" test suite in the traditional sense since usually those test suites were focussing on sacrifices leading to mate, or some other obvious advantage. A lot of the positions in this testsuite seem to be about fortresses or advanced understanding of blocked positions that the older engines don't have.
Parent - - By Carl Bicknell (*****) Date 2021-02-24 11:01
And the same test again, same engine, everything the same, except 16 threads on my 3950X

97/100
6.79s av solve time.

I just don't get this.
Parent - - By dorszcz (**) Date 2021-02-24 14:54
Black Diamond XI-NN seems to prefer only physical cores.
By the way nice result. I estimated 95-96.
Parent - By Carl Bicknell (*****) Date 2021-02-24 15:19

> Black Diamond XI-NN seems to prefer only physical cores.


That does seem strange though because even with Intel's inferior hyper threading, modern engines show a slight improvement. With AMD's latest Ryzen it should be clear-cut, especially as Black Diamond is based so much on Stockfish.
Parent - - By Vinvin (***) Date 2021-02-21 19:19 Upvotes 1
Thanks for this new set, dorszcz  !!!:twisted::twisted::twisted:
Parent - By dorszcz (**) Date 2021-02-21 21:00 Upvotes 1
Have fun!
Parent - - By Vinvin (***) Date 2021-03-02 02:24 Edited 2021-03-02 14:15 Upvotes 1
The big 5 solvers + SF 13 vs the Tough Tactical Test 2

Results are in seconds.
10 minutes (600 seconds) per position. CPU old i7-6*4GHz, 1 thread used.

On the 100 problems :
Crystal 3.1 solved 87
Bluefish-v13 solved 86
Black-Diamond-v13 solved 76
SugaR.AI.ICCF.1.00 solved 89 <- best
ShashChess15.1 solved 81
Stockfish-13 solved 77

Data sheet here : https://www.dropbox.com/s/qjfdsy56wl1314x/results-Tough%20Tactical%20Test%202.ods?dl=0

Table of results :
Solution             Cry3.1 BF13 BD13 SuIC1 Shash151 SF-13 
  1) .. Rh3xa3          5                36                 
  2) .. Rc2xc1         38    12    11    51     6    27     
  3) .. g6-g5           5     7    19     3     1     1     
  4) .. Bc8-a6         13     1    12     1    54   133     
  5) Bg5-f6           297    33   150    43    14     6     
  6) Rg1-g3            27    13    54    97   122   267     
  7) Ng5xh7             1     2     2     1     9    46     
  8) Rc4-c7           455    22   141   413   330   193     
  9) Qg2xg6             2          51    10    20    18     
 10) Kf8-e7, Kf8-e8     0    19     4    11    10     1     
 11) .. Qf7-g6, Nc3     1     2    50    10    85     8     
 12) .. Bg3xh2         24    16          30    67   114     
 13) Rh4xh6             0     2    20     1    10   129     
 14) g5-g6             11               251                 
 15) c2-c3                  174          97   304   272     
 16) Bh4-f6             3     0     3     0     3     3     
 17) .. c7-c5          17     2    34     3     0    18     
 18) .. Kg8-f7          1    18     1     0    59    56     
 19) .. Nf6-g4          1     4    10     2     4    12     
 20) .. Be7-c5, Be7     1    14    12     4   120    85     
 21) .. h3-h2           1     0     6     2    77    29     
 22) .. Rf8-f5        133    29   208     7    66    23     
 23) .. b5xc4          17                 4                 
 24) Rg3-g5           161     8    46   251    37     9     
 25) .. Nc3xb1         25    23   113    32    97    95     
 26) .. Bb6-e3        111    45   154   139    27   152     
 27) Be3xh6             0    47           0   143           
 28) .. Kd8xd7         76    42    25    41    33    20     
 29) Nc4-e5             1    86    18    40    81    50     
 30) Bf1xc4            98   112   453   174         180     
 31) .. Rc5-c2        349         317   469   504           
 32) .. e4-e3         306   216         246    72    63     
 33) Kg1-h1             0     1     1     0     2     0     
 34) Kg1-g2             1   293    18     3    75           
 35) .. Be6-c8, Rd8         571               195   128     
 36) .. Bd8xf6          3     0    23     3     3     5     
 37) Bf2-d4                 394                             
 38) .. Bg7-f6                          171                 
 39) Re7xf7                 242   250   225         130     
 40) Bc1-b2                        75                       
 41) .. e6-e5         133                     427   313     
 42) .. Bc7-e5          0    12    23     3    51   101     
 43) Re1xe8             0    43   104    14    20    90     
 44) .. Ke8-d7        107   138         156   491           
 45) Be1xh4           541          44                       
 46) .. Rg7xa7        581   255   195   385   523   450     
 47) Bc4-b3             3    14    24     2   118    28     
 48) .. Kf7-g6         23    36    14     6   139    23     
 49) .. Nf4-d3          4     8   106     4    77    27     
 50) Rf1-f6             0     1     2     0     0    23     
 51) Kh2-h3             4    37     9     1     4    32     
 52) .. h7-h5           0     0    49     0     5     0     
 53) Nh4-g6            53         334   102   168           
 54) Nd5-e7            23    21    31    61     5     1     
 55) Rf1xf7                       226                       
 56) Rd1-g1                 499         377         126     
 57) .. f4-f3                62     6           7   236     
 58) Ng3-h5             0     0           0         212     
 59) f3-f4             16   103     7    21    45   306     
 60) .. Be2-h5         26     4          21   142           
 61) Qa5xd5             3     0     0     3     1     7     
 62) .. Rc1-d1        413   272    45   170   100   142     
 63) .. Ne5xf3        525   206   114   327   594           
 64) Rg3xg7            12   130    27   119    51    41     
 65) .. Bf4-e5                                              
 66) Bf4-e3             0     2     3     1    57    52     
 67) f6xe7             37   452    35   115    38    13     
 68) .. Qb3-g8         38    25   116    35    16   175     
 69) e4xd5                   91               465           
 70) .. Bd7xh3          0    16    11     0   147    66     
 71) .. Bb6xd4          1     4     5     0     1    29     
 72) Kg1-h1             7    23    25     0    19    16     
 73) Qc5xf8           248   257   141   301   330   239     
 74) Qc1xa3                                                 
 75) .. Rg8-h8        132   111   243    20    68    88     
 76) Rd1-d3            25     3    38     7     7     8     
 77) Ne2-g3             3    20    21     6    33     5     
 78) Qa2-e2             0     0     0     1     4     3     
 79) .. Rb4-b3          0     2    21     0    18     0     
 80) Rf1-f5            69    80    42    89    35   190     
 81) Qf1xf2            64    12   173   160          20     
 82) Ng3-h5             6   300           8                 
 83) Qd4-h4, Qd4-e3     2    21    24     1    73    72     
 84) Bg2-f3             0     0     0     2     4     2     
 85) Ne3-f1           233   149    73    59   183   565     
 86) .. Nc5-d7          3    11   221    32     2    12     
 87) O-O-O              0     2    89     1   305           
 88) Nf3-g5             0     9    53     0    16    85     
 89) .. Qe6-e8          0    10           0   124    17     
 90) c3-c4            563   565         141                 
 91) .. Nh2-f3        180   162         374                 
 92) Kc3-d4             0     2   134    11    62    76     
 93) .. Bd1-a4          3    13           6    18     8     
 94) Rc2xc5             0   154    10     7    49    93     
 95) .. h5xg4           1     1     8     0     3     3     
 96) .. O-O-O           3     2    22    15     0     3     
 97) .. Nh5-g3          1     0     2     1     0     1     
 98) .. Nb5xd4                                              
 99) Nf3-h4            19    27    19     3   230    79     
100) .. Nd7-e5          3     0    23     1    11    57     
Parent - By Vinvin (***) Date 2021-03-02 02:27 Upvotes 1
Based on these results, I selected the 25 hardest positions from this set :
rbb1k2r/1p3p2/p3pP1p/1N2n3/Pq1N4/6Q1/2P1BRpP/3R2K1 w kq - bm c3; id "TTT2.015";
3r4/p7/P1pB2kP/2P2p2/1pnKNP2/4P3/1P6/5B1b w - - bm Bxc4; id "TTT2.030";
1K6/RP3pk1/4p3/2rbP1P1/8/8/P7/8 b - - bm Rc2; id "TTT2.031";
8/2pb1kpK/6p1/3P1pP1/3PpB2/PP6/8/8 b - - bm e3; id "TTT2.032";
r2r4/Pq6/BPp1bb1k/2Pp1p2/3PpPp1/4P1Pp/R1K4P/1R3Q2 b - - bm Bc8 Rd7; id "TTT2.035";
8/2p1rpk1/pp2Brp1/3p3p/1P6/3p3P/1P1P1BP1/5R1K w - - bm Bd4; id "TTT2.037";
r1q3r1/4n1bk/7p/1P1pp3/P3Ppbn/3P1NP1/B1PBQP1K/R3R1N1 b - - bm Bf6; id "TTT2.038";
8/1p2Rrpp/2p3k1/p2p4/3P1P2/P5PP/1P4K1/8 w - - bm Rxf7; id "TTT2.039";
5k2/p7/3p4/1p1B1p1p/1P3P2/P1rP3P/6P1/n1BK4 w - - bm Bb2; id "TTT2.040";
3k4/6p1/p1p1pnBp/1pP2P1P/1P2PK2/P7/8/8 b - - bm e5+; id "TTT2.041";
r3kr2/4ppQN/q1pp2p1/3nP3/2nPN3/Pp3PP1/1P5P/1K1R3R b q - bm Kd7; id "TTT2.044";
r1r5/1p3p1k/1b3Ppp/2ppP3/p2Pq2n/P4R2/3Q2PN/3RB1K1 w - - bm Bxh4; id "TTT2.045";
8/R5r1/1PbkP3/5p1p/1P1K4/5P2/1P4P1/8 b - - bm Rxa7; id "TTT2.046";
rnbq3r/1p2b1k1/2pp1p1p/pP3pp1/2BP3N/P3P3/2P2PPP/RN1Q1RK1 w - - bm Ng6; id "TTT2.053";
8/p4r2/1pPB2k1/8/6P1/7p/b6P/5RK1 w - - bm Rxf7; id "TTT2.055";
8/4k3/6P1/pr1pPp2/2p4P/1p4K1/1P6/3R4 w - - bm Rg1; id "TTT2.056";
8/5kp1/p1P2p2/4nP2/PP1p3p/5N1b/5K2/6B1 b - - bm Nxf3; id "TTT2.063";
8/8/2P5/p4P2/4Pb2/PP1r1k1P/8/1R3K2 b - - bm Be5; id "TTT2.065";
8/8/1p1k4/pp1p1P2/1P2PKp1/1n4P1/1P4Bp/8 w - - bm exd5; id "TTT2.069";
5qk1/pp4p1/4ppp1/2Q3P1/7P/P1P5/1P4P1/6K1 w - - bm Qxf8+; id "TTT2.073";
8/1b5p/1bk1p1p1/p1p1P3/2P3P1/q2rB3/P1RNK2P/2Q5 w - - bm Qxa3; id "TTT2.074";
6rk/2p1np2/1r1pb3/1p2p3/p1PPP1p1/1P2N1Pq/P1BQRP2/3R2K1 w - - bm Nf1; id "TTT2.085";
4r3/1ppk2p1/3pr2p/5B2/p3RP2/2P5/P2P2PP/7K w - - bm c4; id "TTT2.090";
8/p4k2/3pp3/2p1p1Q1/6PK/1pP1P1n1/1P2P2n/3r4 b - - bm Nf3+; id "TTT2.091";
6k1/ppp2pp1/8/1n1P4/3N2P1/2P5/P4P1P/6K1 b - - bm Nxd4; id "TTT2.098";
Parent - - By Vinvin (***) Date 2021-03-02 14:13 Edited 2021-03-02 15:09
I ran Houdidit with tactical=1 under the same conditions.
Only 67 solutions found.
  1) .. Rh3xa3          Ra6-a8   
  2) .. Rc2xc1          Rc2xc1  * 13 Seconds
  3) .. g6-g5           g6-g5   * 139 Seconds
  4) .. Bc8-a6          Bc8-a6  * 86 Seconds
  5) Bg5-f6             Bg5-f6  * 21 Seconds
  6) Rg1-g3             Rg1-g3  * 506 Seconds
  7) Ng5xh7             Ng5xh7  * 134 Seconds
  8) Rc4-c7             Rc4-c7  * 15 Seconds
  9) Qg2xg6             Qg2-g5   
 10) Kf8-e7, Kf8-e8     Kf8-e7  * 115 Seconds
 11) .. Qf7-g6, Nc3-d5  Qf7-g6  * 245 Seconds
 12) .. Bg3xh2          Nf7-g5   
 13) Rh4xh6             Rh4xh6  * 43 Seconds
 14) g5-g6              Kb1-b2   
 15) c2-c3              Qg3xg2   
 16) Bh4-f6             Bh4-f6  * 6 Seconds
 17) .. c7-c5           c7-c5   * 143 Seconds
 18) .. Kg8-f7          Kg8-f7  * 24 Seconds
 19) .. Nf6-g4          Nf6-g4  * 16 Seconds
 20) .. Be7-c5, Be7-a3  Be7-c5  * 37 Seconds
 21) .. h3-h2           h3-h2   * 215 Seconds
 22) .. Rf8-f5          Rf8-f5  * 41 Seconds
 23) .. b5xc4           b5xc4   * 127 Seconds
 24) Rg3-g5             Qd3-c4   
 25) .. Nc3xb1          Nc3xb1  * 22 Seconds
 26) .. Bb6-e3          Bb6-e3  * 110 Seconds
 27) Be3xh6             Be3xh6  * 416 Seconds
 28) .. Kd8xd7          Kd8xd7  * 230 Seconds
 29) Nc4-e5             Nc4-e5  * 25 Seconds
 30) Bf1xc4             Kd4xc4   
 31) .. Rc5-c2          Bd5xb7   
 32) .. e4-e3           e4-e3   * 98 Seconds
 33) Kg1-h1             Kg1-h1  * 10 Seconds
 34) Kg1-g2             Kg1-g2  * 262 Seconds
 35) .. Be6-c8, Rd8-d7  Qb7-g7   
 36) .. Bd8xf6          Bd8xf6  * 14 Seconds
 37) Bf2-d4             Bf2-d4  * 41 Seconds
 38) .. Bg7-f6          Nh4xf3   
 39) Re7xf7             Re7xf7  * 266 Seconds
 40) Bc1-b2             Bc1-b2  * 432 Seconds
 41) .. e6-e5           e6xf5    
 42) .. Bc7-e5          Bc7-e5  * 8 Seconds
 43) Re1xe8             Re1xe8  * 164 Seconds
 44) .. Ke8-d7          Ke8-d8   
 45) Be1xh4             Rf3-f4   
 46) .. Rg7xa7          Bc6-b7   
 47) Bc4-b3             Bc4-b3  * 51 Seconds
 48) .. Kf7-g6          Kf7-g6  * 162 Seconds
 49) .. Nf4-d3          Nf4-d3  * 14 Seconds
 50) Rf1-f6             Rf1-f6  * 4 Seconds
 51) Kh2-h3             Kh2-h3  * 221 Seconds
 52) .. h7-h5           Re4xe3   
 53) Nh4-g6             b5xc6    
 54) Nd5-e7             Nd5-e7  * 26 Seconds
 55) Rf1xf7             Rf1-e1   
 56) Rd1-g1             Kg3-f4   
 57) .. f4-f3           f4-f3   * 261 Seconds
 58) Ng3-h5             Ng3-h5  * 127 Seconds
 59) f3-f4              f3-f4   * 53 Seconds
 60) .. Be2-h5          Be2-g4   
 61) Qa5xd5             Qa5xd5  * 27 Seconds
 62) .. Rc1-d1          Rc1-d1  * 189 Seconds
 63) .. Ne5xf3          Ne5-d3   
 64) Rg3xg7             Rg3xg7  * 2 Seconds
 65) .. Bf4-e5          Rd3-c3   
 66) Bf4-e3             Bf4-e3  * 5 Seconds
 67) f6xe7              f6xe7   * 7 Seconds
 68) .. Qb3-g8          Qb3xb5   
 69) e4xd5              e4-e5    
 70) .. Bd7xh3          Bd7xh3  * 176 Seconds
 71) .. Bb6xd4          Bb6xd4  * 2 Seconds
 72) Kg1-h1             Kg1-h1  * 353 Seconds
 73) Qc5xf8             Qc5xa7   
 74) Qc1xa3             Nd2-b3   
 75) .. Rg8-h8          Rg8-h8  * 153 Seconds
 76) Rd1-d3             Rd1-d3  * 21 Seconds
 77) Ne2-g3             Ne2-g3  * 19 Seconds
 78) Qa2-e2             Qa2-e2  * 47 Seconds
 79) .. Rb4-b3          Rb4-b3  * 26 Seconds
 80) Rf1-f5             Rf1-f5  * 0 Seconds
 81) Qf1xf2             Nd8-b7   
 82) Ng3-h5             Nc3-e4   
 83) Qd4-h4, Qd4-e3     Qd4-a4   
 84) Bg2-f3             Bg2-f3  * 87 Seconds
 85) Ne3-f1             d4xe5    
 86) .. Nc5-d7          Nc5-d7  * 93 Seconds
 87) O-O-O              Ne2-g3   
 88) Nf3-g5             Nf3-g5  * 52 Seconds
 89) .. Qe6-e8          Qe6-e8  * 81 Seconds
 90) c3-c4              Kh1-g1   
 91) .. Nh2-f3          Nh2-f3  * 50 Seconds
 92) Kc3-d4             Kc3-d4  * 9 Seconds
 93) .. Bd1-a4          Ke7-d8   
 94) Rc2xc5             Rc2xc5  * 347 Seconds
 95) .. h5xg4           h5xg4   * 10 Seconds
 96) .. O-O-O           O-O-O   * 80 Seconds
 97) .. Nh5-g3          Nh5-g3  * 6 Seconds
 98) .. Nb5xd4          Nb5xc3   
 99) Nf3-h4             Nf3-h4  * 17 Seconds
100) .. Nd7-e5          Nd7-e5  * 38 Seconds
Parent - - By Vinvin (***) Date 2021-03-03 15:48
Results for Houdini 1.5 under the same conditions.
22 solutions found.
   1) .. Rh3xa3          Rh3xh4   
  2) .. Rc2xc1          Rc2-g2   
  3) .. g6-g5           Qd8-g5   
  4) .. Bc8-a6          Bc8-a6  * 352 Seconds
  5) Bg5-f6             Bg5xh6   
  6) Rg1-g3             Qe2-h5   
  7) Ng5xh7             e5xf6    
  8) Rc4-c7             Rc4-b4   
  9) Qg2xg6             Qg2-g5   
 10) Kf8-e7, Kf8-e8     Kf8-g8   
 11) .. Qf7-g6, Nc3-d5  b5-b4    
 12) .. Bg3xh2          Nf7-g5   
 13) Rh4xh6             g5xh6    
 14) g5-g6              Kb1-b2   
 15) c2-c3              Qg3xg2   
 16) Bh4-f6             Nf3xd4   
 17) .. c7-c5           Rf8-e8   
 18) .. Kg8-f7          Kg8-f7  * 226 Seconds
 19) .. Nf6-g4          Nf6-g4  * 275 Seconds
 20) .. Be7-c5, Be7-a3  d5xc4    
 21) .. h3-h2           Nf4xg2   
 22) .. Rf8-f5          Bc8-h3   
 23) .. b5xc4           Na5xc4   
 24) Rg3-g5             a2-a3    
 25) .. Nc3xb1          Nc3-e4   
 26) .. Bb6-e3          Bb6xa5   
 27) Be3xh6             Nc3xe4   
 28) .. Kd8xd7          Nc2-d4   
 29) Nc4-e5             Nc4-e5  * 513 Seconds
 30) Bf1xc4             Kd4xc4   
 31) .. Rc5-c2          Bd5xb7   
 32) .. e4-e3           Bd7-b5   
 33) Kg1-h1             e4-e5    
 34) Kg1-g2             Kg1-g2  * 281 Seconds
 35) .. Be6-c8, Rd8-d7  Qb7-h7   
 36) .. Bd8xf6          e4xf3    
 37) Bf2-d4             Bf2-d4  * 25 Seconds
 38) .. Bg7-f6          f4xg3    
 39) Re7xf7             Re7xf7  * 126 Seconds
 40) Bc1-b2             Kd1-d2   
 41) .. e6-e5           e6xf5    
 42) .. Bc7-e5          Bc7-e5  * 139 Seconds
 43) Re1xe8             Re1xe8  * 43 Seconds
 44) .. Ke8-d7          Ke8-d8   
 45) Be1xh4             Rf3-f4   
 46) .. Rg7xa7          Bc6-b7   
 47) Bc4-b3             Bc4-b3  * 183 Seconds
 48) .. Kf7-g6          Kf7-e6   
 49) .. Nf4-d3          Nf4-d3  * 394 Seconds
 50) Rf1-f6             Rf1-f6  * 280 Seconds
 51) Kh2-h3             Kh2-g1   
 52) .. h7-h5           Bf6-d4   
 53) Nh4-g6             Nh4-f3   
 54) Nd5-e7             Nd5-e7  * 67 Seconds
 55) Rf1xf7             Rf1-a1   
 56) Rd1-g1             Kg3-f4   
 57) .. f4-f3           g4-g3    
 58) Ng3-h5             d5xe6    
 59) f3-f4              f3-f4   * 73 Seconds
 60) .. Be2-h5          Be2-g4   
 61) Qa5xd5             Qa5xd5  * 200 Seconds
 62) .. Rc1-d1          f7-f5    
 63) .. Ne5xf3          Ne5-d3   
 64) Rg3xg7             Rg3xg7  * 168 Seconds
 65) .. Bf4-e5          Bf4-e3   
 66) Bf4-e3             Qd1-d4   
 67) f6xe7              Qa5-b6   
 68) .. Qb3-g8          Qb3xb5   
 69) e4xd5              e4-e5    
 70) .. Bd7xh3          Bd7xh3  * 186 Seconds
 71) .. Bb6xd4          Bb6xd4  * 68 Seconds
 72) Kg1-h1             f5xe6    
 73) Qc5xf8             Qc5xa7   
 74) Qc1xa3             Nd2-b3   
 75) .. Rg8-h8          d6xc5    
 76) Rd1-d3             Rd1-d3  * 579 Seconds
 77) Ne2-g3             Qd6xc6   
 78) Qa2-e2             b4xc5    
 79) .. Rb4-b3          Bb7-a6   
 80) Rf1-f5             Rf1-f5  * 156 Seconds
 81) Qf1xf2             Nd8-b7   
 82) Ng3-h5             Bg4-h5   
 83) Qd4-h4, Qd4-e3     Qd4-h4  * 34 Seconds
 84) Bg2-f3             Qg7-f7   
 85) Ne3-f1             d4xe5    
 86) .. Nc5-d7          Nc5-d3   
 87) O-O-O              Ne2-g3   
 88) Nf3-g5             Rc1xe1   
 89) .. Qe6-e8          Qe6xd6   
 90) c3-c4              Re4xa4   
 91) .. Nh2-f3          Ng3-f5   
 92) Kc3-d4             Kc3xc2   
 93) .. Bd1-a4          Bd1xh5   
 94) Rc2xc5             Kh1-g2   
 95) .. h5xg4           b5xa4    
 96) .. O-O-O           d4xc3    
 97) .. Nh5-g3          Kg8-g7   
 98) .. Nb5xd4          Nb5xc3   
 99) Nf3-h4             Nf3-h4  * 86 Seconds
100) .. Nd7-e5          Bd4-e5   
Parent - - By dorszcz (**) Date 2021-03-04 16:35
Could you try Critter 1.6 with the same conditions?
Parent - - By Vinvin (***) Date 2021-03-05 01:16
OK it's running.
Parent - By dorszcz (**) Date 2021-03-06 17:55
Thanks.
Parent - - By Vinvin (***) Date 2021-03-05 15:24
Results for Critter 1.6a under the same conditions.
20 solutions found.
  1) .. Rh3xa3          Rh3xh4   
  2) .. Rc2xc1          Rc2-g2   
  3) .. g6-g5           Qd8-g5   
  4) .. Bc8-a6          Bc8-a6  * 243 Seconds
  5) Bg5-f6             Bg5xh6   
  6) Rg1-g3             Qe2-h5   
  7) Ng5xh7             e5xf6    
  8) Rc4-c7             Rc4-b4   
  9) Qg2xg6             Qg2-g5   
 10) Kf8-e7, Kf8-e8     Kf8-g7   
 11) .. Qf7-g6, Nc3-d5  Qf7-g6  * 56 Seconds
 12) .. Bg3xh2          Bg3xh2  * 298 Seconds
 13) Rh4xh6             Rh4-h5   
 14) g5-g6              Kb1-b2   
 15) c2-c3              Nd4-f3   
 16) Bh4-f6             Nf3xd4   
 17) .. c7-c5           c7-c5   * 314 Seconds
 18) .. Kg8-f7          Qf5-f6   
 19) .. Nf6-g4          Nf6-g4  * 154 Seconds
 20) .. Be7-c5, Be7-a3  d5xc4    
 21) .. h3-h2           Nf4xg2   
 22) .. Rf8-f5          Bc8-h3   
 23) .. b5xc4           b5xc4   * 473 Seconds
 24) Rg3-g5             a2-a3    
 25) .. Nc3xb1          Nc3-e4   
 26) .. Bb6-e3          Bb6xa5   
 27) Be3xh6             Nc3xe4   
 28) .. Kd8xd7          Nc2xa3   
 29) Nc4-e5             Nc4-e5  * 270 Seconds
 30) Bf1xc4             Kd4xc4   
 31) .. Rc5-c2          Bd5xb7   
 32) .. e4-e3           Bd7-b5   
 33) Kg1-h1             e4-e5    
 34) Kg1-g2             d3xc4    
 35) .. Be6-c8, Rd8-d7  Qb7-g7   
 36) .. Bd8xf6          e4xf3    
 37) Bf2-d4             Bf2-d4  * 152 Seconds
 38) .. Bg7-f6          f4xg3    
 39) Re7xf7             Re7-e6   
 40) Bc1-b2             Kd1-d2   
 41) .. e6-e5           e6xf5    
 42) .. Bc7-e5          Bc7-e5  * 141 Seconds
 43) Re1xe8             Re1xe8  * 15 Seconds
 44) .. Ke8-d7          Ke8-d8   
 45) Be1xh4             Rf3-f4   
 46) .. Rg7xa7          Bc6-b7   
 47) Bc4-b3             Nf3xd2   
 48) .. Kf7-g6          Kf7-e6   
 49) .. Nf4-d3          Rd5xa5   
 50) Rf1-f6             Qc3xc5   
 51) Kh2-h3             Kh2-g1   
 52) .. h7-h5           Bf6-d4   
 53) Nh4-g6             Nh4-f3   
 54) Nd5-e7             Nd5-e7  * 31 Seconds
 55) Rf1xf7             Rf1-a1   
 56) Rd1-g1             h4-h5    
 57) .. f4-f3           g4-g3    
 58) Ng3-h5             Ng3-h5  * 147 Seconds
 59) f3-f4              f3-f4   * 196 Seconds
 60) .. Be2-h5          Be2-g4   
 61) Qa5xd5             Bb4-d6   
 62) .. Rc1-d1          f7-f5    
 63) .. Ne5xf3          Ne5-d3   
 64) Rg3xg7             Rg3xg7  * 28 Seconds
 65) .. Bf4-e5          Bf4-e3   
 66) Bf4-e3             Qd1-d4   
 67) f6xe7              Qa5-d2   
 68) .. Qb3-g8          Qb3xb5   
 69) e4xd5              e4-e5    
 70) .. Bd7xh3          Bd7xh3  * 186 Seconds
 71) .. Bb6xd4          Bb6xd4  * 225 Seconds
 72) Kg1-h1             f5xe6    
 73) Qc5xf8             Qc5xa7   
 74) Qc1xa3             Nd2-b3   
 75) .. Rg8-h8          g5-g4    
 76) Rd1-d3             Rd1-d3  * 488 Seconds
 77) Ne2-g3             Qd6xc6   
 78) Qa2-e2             b4xc5    
 79) .. Rb4-b3          Qb6-a6   
 80) Rf1-f5             Rf1-f5  * 23 Seconds
 81) Qf1xf2             Nd8xf7   
 82) Ng3-h5             Qd1xa1   
 83) Qd4-h4, Qd4-e3     Qd4-h4  * 375 Seconds
 84) Bg2-f3             Qg7-f7   
 85) Ne3-f1             Ne3-f5   
 86) .. Nc5-d7          Nc5-d3   
 87) O-O-O              Ne2-g3   
 88) Nf3-g5             Rc1xe1   
 89) .. Qe6-e8          Qe6xd6   
 90) c3-c4              Re4xa4   
 91) .. Nh2-f3          Ng3-f5   
 92) Kc3-d4             Kc3xc2   
 93) .. Bd1-a4          Bd1xh5   
 94) Rc2xc5             Kh1-g1   
 95) .. h5xg4           b5xa4    
 96) .. O-O-O           d4xc3    
 97) .. Nh5-g3          Kg8-g7   
 98) .. Nb5xd4          Nb5xc3   
 99) Nf3-h4             Nf3-h4  * 174 Seconds
100) .. Nd7-e5          Bd4-e5   
Parent - By user923005 (****) Date 2021-03-08 00:28
I am surprised at how Critter struggled.
Even the problems solved took a long time.
Whatever it is that Critter does brilliantly, this set exposes some major problems.\
Parent - By Vinvin (***) Date 2021-03-10 09:40
Results for Sting-sf-27 under the same conditions.
23 solutions found.
  1) .. Rh3xa3          Rh3xh4   
  2) .. Rc2xc1          Rc2-g2   
  3) .. g6-g5           Qd8-g5   
  4) .. Bc8-a6          Rf8-d8   
  5) Bg5-f6             Bg5xh6   
  6) Rg1-g3             Qe2-h5   
  7) Ng5xh7             e5xf6    
  8) Rc4-c7             Rc4-c5   
  9) Qg2xg6             Qg2xg6  * 6 Seconds
 10) Kf8-e7, Kf8-e8     Kf8-e7  * 186 Seconds
 11) .. Qf7-g6, Nc3-d5  b5-b4    
 12) .. Bg3xh2          Nf7-g5   
 13) Rh4xh6             g5xh6    
 14) g5-g6              g5-g6   * 1 Second
 15) c2-c3              Qg3xg2   
 16) Bh4-f6             Nf3xd4   
 17) .. c7-c5           Rf8-e8   
 18) .. Kg8-f7          Qf5-f6   
 19) .. Nf6-g4          Nf6-g4  * 358 Seconds
 20) .. Be7-c5, Be7-a3  d5xc4    
 21) .. h3-h2           Nf4xg2   
 22) .. Rf8-f5          Bc8-h3   
 23) .. b5xc4           b5xc4   * 266 Seconds
 24) Rg3-g5             a2-a3    
 25) .. Nc3xb1          Nc3-e4   
 26) .. Bb6-e3          Bb6xa5   
 27) Be3xh6             Nc3xe4   
 28) .. Kd8xd7          Nc2xa3   
 29) Nc4-e5             Nc4-e5  * 590 Seconds
 30) Bf1xc4             Kd4xc4   
 31) .. Rc5-c2          Rc5-c2  * 24 Seconds
 32) .. e4-e3           Bd7-b5   
 33) Kg1-h1             Ra1-c1   
 34) Kg1-g2             d3xc4    
 35) .. Be6-c8, Rd8-d7  Qb7-d7   
 36) .. Bd8xf6          e4xf3    
 37) Bf2-d4             Bf2-d4  * 2 Seconds
 38) .. Bg7-f6          f4xg3    
 39) Re7xf7             Re7-e8   
 40) Bc1-b2             Bc1-b2  * 0 Seconds
 41) .. e6-e5           e6xf5    
 42) .. Bc7-e5          Bc7-e5  * 298 Seconds
 43) Re1xe8             b2xc3    
 44) .. Ke8-d7          Ke8-d8   
 45) Be1xh4             Rf3-f4   
 46) .. Rg7xa7          Bc6-b7   
 47) Bc4-b3             Nf3xd2   
 48) .. Kf7-g6          Kf7-e6   
 49) .. Nf4-d3          Nf4-d3  * 451 Seconds
 50) Rf1-f6             Rf1-f6  * 509 Seconds
 51) Kh2-h3             Kh2-g1   
 52) .. h7-h5           Re4xb4   
 53) Nh4-g6             Nh4-f3   
 54) Nd5-e7             Nd5-e7  * 221 Seconds
 55) Rf1xf7             Rf1-a1   
 56) Rd1-g1             Rd1-g1  * 304 Seconds
 57) .. f4-f3           g4-g3    
 58) Ng3-h5             Ng3-h5  * 573 Seconds
 59) f3-f4              f3-f4   * 428 Seconds
 60) .. Be2-h5          f4-f3    
 61) Qa5xd5             Qa5xd5  * 449 Seconds
 62) .. Rc1-d1          f7-f5    
 63) .. Ne5xf3          Ne5-d3   
 64) Rg3xg7             Bc2-a4   
 65) .. Bf4-e5          Rd3-c3   
 66) Bf4-e3             Qd1-d4   
 67) f6xe7              Qa5-b6   
 68) .. Qb3-g8          Qb3xb5   
 69) e4xd5              e4-e5    
 70) .. Bd7xh3          Nf6xe4   
 71) .. Bb6xd4          Qf6xh4   
 72) Kg1-h1             f5xe6    
 73) Qc5xf8             Qc5xa7   
 74) Qc1xa3             Qc1xa3  * 76 Seconds
 75) .. Rg8-h8          g5-g4    
 76) Rd1-d3             Be3-b6   
 77) Ne2-g3             Qd6xc6   
 78) Qa2-e2             b4xc5    
 79) .. Rb4-b3          Qb6-d6   
 80) Rf1-f5             Rf1-f5  * 206 Seconds
 81) Qf1xf2             Nd8xf7   
 82) Ng3-h5             Bg4-h5   
 83) Qd4-h4, Qd4-e3     Qd4-h4  * 105 Seconds
 84) Bg2-f3             Qg7-f7   
 85) Ne3-f1             d4xe5    
 86) .. Nc5-d7          Nc5-d7  * 103 Seconds
 87) O-O-O              Ne2-g3   
 88) Nf3-g5             Rc1xe1   
 89) .. Qe6-e8          Qe6xd6   
 90) c3-c4              Re4xa4   
 91) .. Nh2-f3          Ng3-f5   
 92) Kc3-d4             Kc3-d4  * 0 Seconds
 93) .. Bd1-a4          Bd1xh5   
 94) Rc2xc5             Rc2xc5  * 19 Seconds
 95) .. h5xg4           b5xa4    
 96) .. O-O-O           b7xa6    
 97) .. Nh5-g3          Kg8-g7   
 98) .. Nb5xd4          Nb5xc3   
 99) Nf3-h4             Bc4xa6   
100) .. Nd7-e5          Bd4-e5   
Parent - By dorszcz (**) Date 2021-03-02 14:50 Edited 2021-03-02 14:55 Upvotes 1
Why are there some of wrong alternate solutions in the table with Stockfish engines? In the second table with your Houdidit-modern results there is no problem.

Nevermind, I realized that part of solutions were just accidentally cut.

New Black Diamond is disappointing in terms of the tactics it was designed for.
- - By Lukas Cimiotti (Bronze) Date 2021-04-03 10:52 Upvotes 1
I tried that test using lc0 27.0. GPU: RTX 3090 CPU: Ryzen 9 X3900 3 threads
Time limit: 15 seconds per position. Selection of 6 man syzygy

I tried some different networks:

72 out of 100: Net 68372 (384x30-2021_0403_1402_31_663)
66 out of 100: Net PhoenixStein
61 out of 100: Net LeelenStein 15
38 out of 100: Net 715877 (256x20)
36 out of 100: Net 742086 (128x10-2021_0403_0613_47_267)
35 out of 100: Net 750357 (192x15-2021_0403_0630_09_799)
Parent - - By user923005 (****) Date 2021-04-03 12:11
That is really interesting how dramatic the differences are.
More than twice as many solutions for the first net in the list verses the last.
Going by the numbers for the nets, I would guess that the newer nets have bigger numbers.
If so, that would mean that LC0's tactical ability is going right down the toilet.

Edit: Or it could just be the node counts of the nets that is determining the strength
Parent - - By Lukas Cimiotti (Bronze) Date 2021-04-03 12:49 Upvotes 1

>Going by the numbers for the nets, I would guess that the newer nets have bigger numbers.


No - 68372, 742086 and 750357 have been released today. It looks to me like larger nets give better results:
68372: 162 MB
PhoenixStein: 110 MB
Leelenstein 15: 110 MB
715887: 47 MB
742086: 7.4 MB
750357: 22 MB
Parent - - By user923005 (****) Date 2021-04-04 03:44
OK, that makes sense.
I have found empirically that the largest nets are best on my system (3970x with two 2080 TI cards)
Parent - By MrKris (***) Date 2021-04-06 08:02
2700X 16threads | RTX 2060
http://rybkaforum.net/cgi-bin/rybkaforum/topic_show.pl?tid=33879
300 games each: 30x384 best, LS15 2nd, 10x128 lost to Sf 1 thread (100 games).
- - By MrKris (***) Date 2021-04-09 07:21
Thanks dorszcz for the test!!
Thanks for the interesting comparisons this thread!

Tough Tactical Test 2 : 100 positions
  R7 2700X 16th | RTX 2060
                             15sec  2min  Only 
          Lc0-0.27--J94-100   59     80     8 <L 
    Stockfish_21032717_avx2   59     85     9
S>
                    Neither       4

 
     Lc0-0.27--J94-100       Stockfish_21032717_avx2
Pos.       15"     2'           15"     2'

    1)      1      2   lL-S            97
    2)     11     23             3      1
    3)      0      0             0      0
    4)            44             1      7
    5)                   S>     13     22
    6)      9     51            11     11
    7)      0      0             1      1
    8)                   S>     14     15
    9)      0   (Qg5)            3      2
   10)      9      8                   12
   11)     12     12             0      2
   12)            43             7      7
   13)      3      2            11     39
   14)                  none       
   15)      0      0             1      1
   16)      0      0             0      1
   17)      0      0             0      4
   18)            20             7      5
   19)      0      0             4      3
   20)      2      2                   70
   21)      0      0             4      4
   22)            42             5     24
   23)            14     <L      
   24)      7      6             8     11
   25)            87             8     13
   26)            28             8     51
   27)      0      0                   69
   28)      0      0             1      1
   29)      1      1            11      7
   30)      1      1             5      6
   31)                  none       
   32)            21            13      9
   33)      0      0             0      0
   34)      0      0                    6
   35)      0      0                   12
   36)      5      6             0      0
   37)      4      3     <L      
   38)      3      3     <L     
   39)      0      0                   32
   40)      1      0     <L      
   41)                   S>            58
   42)                   S>             9
   43)            25            14     15
   44)      4      4    <!?            79
   45)                  none       
   46)      1      1    <!?           105
   47)      5      5             5      3
   48)     13     16             5    (Bc1)
   49)            24             3      1
   50)      1      1             2      3
   51)      9     10             3      1
   52)     12     29             0      1
   53)                  none       
   54)      1      1             0      0
   55)      4      4     <L      
   56)                   S>            71
   57)                   S>     10      4
   58)      0      0             8      8
   59)     14     10                   65
   60)                   S>           115
   61)            31             1      1
   62)      0     12             3      9
   63)            35                  100
   64)                   S>             8
   65)      2      2     <L      
   66)      4      5            13      6
   67)                           7     13
   68)     10     16            14      5
   69)     14     16                   16
   70)      1      1    <!?            55
   71)            64             8     16
   72)            34             1      1
   73)      0      0             9     22
   74)      0  !!  0     <L      
   75)                   S>     11     21
   76)            40             3      4
   77)            68             4     16
   78)      5                    0      0
   79)            85             1      1
   80)                    >            21
   81)                    >      2      8
   82)      1      2      <      
   83)      0      0                   22
   84)      2      3             0      0
   85)                    >            20
   86)            24             6      3
   87)      0  !!  0     <L      
   88)      0      0                    6
   89)      0      0             4      6
   90)           113                   34
   91)            70                   50
   92)      0      0                   17
   93)      0      0             1      0
   94)      0      0    <!?            83
   95)            14             0      0
   96)      1      1             0      0
   97)            32             1      0
   98)                           
   99)            42     <>            31
  100)      0      0             3      2


Eight positions Lc0 solved and Stockfish did not, Lc0 was all under 4 seconds or less, except 23) at 14.
Three solved by Lc0 instantly, in 0 or 1 seconds, and not by Stockfish; time in seconds @ 15" , 2':
[White "TTT2.040"]
[Black "quickly by Lc0, not by Sf"]
[Result ""]
[SetUp "1"]
[PlyCount "1"]
[FEN "5k2/p7/3p4/1p1B1p1p/1P3P2/P1rP3P/6P1/n1BK4 w - - 0 1"]

1.Bb2 {1 , 0 !!} *

[Event "TTT2"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "TTT2.074"]
[Black "quickly by Lc0, not by Sf"]
[Result "*"]
[SetUp "1"]
[PlyCount "1"]
[FEN "8/1b5p/1bk1p1p1/p1p1P3/2P3P1/q2rB3/P1RNK2P/2Q5 w - - 0 1"]

1.Qxa3 {0 , 0 !!} *

[Event "TTT2"]
[Site "?"]
[Date "????.??.??"]
[Round "?"]
[White "TTT2.087"]
[Black "quickly by Lc0, not by Sf"]
[Result "*"]
[SetUp "1"]
[PlyCount "1"]
[FEN "r4rk1/4p1np/1np2ppQ/p2qPb2/Pp1PN3/3B4/1PP1N2P/R3K1R1 w Q - 0 1"]

1.O-O-O {0 , 0 !!} *

Nine positions Stockfish solved and Lc0 did not, Stockfish times were mostly average or long.
Three solved by Stockfish only (not Lc0); tine in seconds @ 15", 2':
[White "TTT2.005"]
[Black "only by Stockfish"]
[Result ""]
[SetUp "1"]
[PlyCount "1"]
[FEN "r6k/p2b2pp/q1n1p2n/3pPpB1/2pP4/2P2NQ1/2P1BPP1/1R4K1 w - - 0 1"]

1.Bf6 {13 , 22} *

[White "TTT2.008"]
[Black "only by Stockfish"]
[Result ""]
[SetUp "1"]
[PlyCount "1"]
[FEN "1r6/1b6/1P2k3/4Np2/2R2PpP/2K1p1P1/8/8 w - - 0 1"]

1.Rc7 {14 , 15} *

[White "TTT2.041"]
[Black "only by Stockfish"]
[Result ""]
[SetUp "1"]
[PlyCount "1"]
[FEN "3k4/6p1/p1p1pnBp/1pP2P1P/1P2PK2/P7/8/8 b - - 0 1"]

1...e5+ { - , 58} *
Parent - By The Wizard (***) Date 2021-04-16 22:53 Upvotes 1
40: TTT2.040 Line 0.0, TTT2
5k2/p7/3p4/1p1B1p1p/1P3P2/P1rP3P/6P1/n1BK4 w - - 0 1


Analysis by Eman 6.95 64-bit AVX2:

1.Bb2 Rxd3+ 2.Ke2 Rxd5 3.Bxa1 Ke7 4.Bb2 h4 5.Bc3 a5 6.Bb2 Ke8 7.Bf6 Kf7 8.Bc3 a4 9.Bh8 Ke7 10.Bc3 Ke8 11.Bf6 Kd7 12.Bc3
  The position is equal: = (0.00)  Depth: 74/25   00:00:35  5034MN, tb=5297905
(,  16.04.2021)
- - By MrKris (***) Date 2021-04-11 00:46
From my last post this thread:
I corrected by one engine only and neither counts (the per engine/time totals 59,59,80 & 85 are from Arena and okay).

When Stockfish solved and Lc0 did not Stockfish took an ave. of 9.2 times longer than Lc0's times when it solved and Stockfish did not!

Tough Tactical Test 2 : 100 positions
  R7 2700X 16th | RTX 2060
                         15sec  2min  Only
      Lc0-0.27--J94-100   59     80    9 @ Ave. 2.53 secs. !!
Stockfish_21032717_avx2   59     85   13 @ Ave. 23.26 secs.
                Neither       6

     Lc0-0.27--J94-100       Stockfish_21032717_avx2
Pos.       15"     2'           15"     2'

        Sovled by Lc0 ONLY = 9 positons
   23)            14     <L  
   37)      4      3     <L      
   38)      3      3     <L
   40)      1      0     <L
   55)      4      4     <L
   65)      2      2     <L
   74)      0  !!  0     <L      
   82)      1      2     <L
   87)      0  !!  0     <L
        17 total, ave. = 2.53 seconds

       
        Solved by Sf ONLY = 13 postions
    5)                   S>     13     22
    8)                   S>     14     15
   41)                   S>            58
   42)                   S>             9
   56)                   S>            71
   57)                   S>     10      4
   60)                   S>           115
   64)                   S>             8
   67)                   S>      7     13
   75)                   S>     11     21
   80)                   S>            21
   81)                   S>      2      8
   85)                   S>            20
        19 total, ave. = 23.26 seconds
       
Solved by neither = 6 postions:
14)    31)    45)    53)    67)    98)
Parent - - By user923005 (****) Date 2021-04-11 03:31 Upvotes 1
Those all have fairly long solution times in my database (unfortunately, I do not record the solving engine):
1K6/RP3pk1/4p3/2rbP1P1/8/8/P7/8 b - - acd 70; acs 472; bm Rc2; ce 4506; c3 "Rc2"; pm Rc2; pv Rc2; id "TTT2.031";

1B2b2k/7q/4n2p/3Np1PQ/8/1p6/5N1P/1K1B4 w - - acd 82; acs 1294; bm g6; ce 0; c3 "g6"; c5 "2018.12.11;
Arves;"; pm g6; pv g6 Bxg6+ Bc2 bxc2+ Kc1 Bxh5 Bxe5+ Ng7 Ne7 Bf3 h4 h5 Bf4 Bg4 Bd2 Be2 Bf4 Bb5 Bd2; id "TTT2.014";
r1q3k1/4bppp/5P2/Q1n1p1P1/4P2P/1p3R2/4B3/1KR5 w - - acd 58; acs 1559; bm fxe7; ce 638; c3 "fxe7"; pm fxe7; pv fxe7; id "TTT2.067";

6k1/ppp2pp1/8/1n1P4/3N2P1/2P5/P4P1P/6K1 b - - acd 46; acs 3598; bm Nxd4; ce 1043; c3 "Nxd4"; pm Nxd4;
pv Nxd4 cxd4 f5 gxf5 Kf7 Kf1 Kf6 Kg2 Kxf5 Kg3 b5 Kf3 a5 Ke3 g6 h3 Kf6 Ke4 Ke7 Ke5 Kd7 h4 Ke7 f3 a4 Ke4 Kd6 Kd3 Kxd5 Kc3 c6 a3 Ke6 Kb4 Kd6 Kc3 Kd5 Kd3 Ke6 Kd2 Kf6 Kc3 Kf5 Kb4 Kf4 Kc5 Kxf3 Kxc6 b4 d5 bxa3 d6 a2 d7 a1=Q d8=Q Qe5 Qd3+ Qe3 Qd6 Qe4+ Kb6 a3 Qd1+ Qe2 Qd5+ Kf2 Qf7+ Kg2 Qd5+ Qf3 Qe6 a2 Qe5 Qb3+ Kc5 Kf3 Qg7 Qc2+ Kd6 Qc4; id "TTT2.098";
rnbq3r/1p2b1k1/2pp1p1p/pP3pp1/2BP3N/P3P3/2P2PPP/RN1Q1RK1 w - - acd 57; acs 5936; bm Ng6; ce 276; c3 "Ng6"; pm Ng6;
pv Ng6 d5 Nxe7 Qxe7 Bd3 h5 Nc3 Qd6 Qf3 Nd7 Qxf5 Nf8 Qf3 h4 h3 Ng6 bxc6 bxc6 Na4 Ra7 c4 f5 cxd5 g4 Qe2 cxd5 Rab1 Rc7 f4 g3 Rb6 Rc6 Rb3 Re8 Nc5 Rb6 Bb5 Re7 a4 Ra7 Rc1 Kh6 Qc2 Kg7 Rc3 Ne7 Qe2 Qf6 Qh5 Be6 Qd1 Bc8 R3c2 Kh6 Qd2 Kg7 Qe1 Kh6 Kf1 Qd6 Rc3 Qf6 Qd1 Kg7 Qd2 Kh6 Nd3 Bd7 Bxd7 Rxd7; id "TTT2.053";
r1r5/1p3p1k/1b3Ppp/2ppP3/p2Pq2n/P4R2/3Q2PN/3RB1K1 w - - acd 66; acs 6497; bm Bxh4; ce 408; c3 "Bxh4"; pm Bxh4;
pv Bxh4 Qxh4 Rf4 Qh5 g4 Qh3 Rf3 Qh4 Kg2 Ba5 Qf4 cxd4 Rf2 Rc3 Nf3 Rxf3 Rxf3 Rc8 Rf2 Kg8 Rh1 Qg5 Qxg5 hxg5 Rb2 b6 Rd1 Rc5 Kf1 d3 Rxd3 b5 Re2 Bc7 e6 fxe6 Rxe6 Bf4 Ra6 Rc1+ Ke2 Rc2+ Kf3 Rc5 Ra7 Be5 Rg7+ Kf8 Rxg6 Kf7 Rxg5 Kxf6 Rh5 Ke6 Rh6+ Kf7 Rb6 Bc7 Ra6 Be5 Rd2 Bf6 Kf4 Kg7 g5 Bc3 Rh2 d4 Ra7+ Kg8 Rhh7 Rc8 Rag7+ Kf8 Rd7 Kg8 Rhg7+ Kh8 g6 d3 Rh7+ Kg8 Rxd3 b4 axb4 a3 Ra7 Bxb4 Rdd7 Bc5 Rg7+ Kh8 Rh7+ Kg8 Ra6 Rf8+ Kg5 Rc8 Rf7 Re8 Kf4 Rc8 Kf5 Bf8 Ra5 Rb8 Kg5 Bb4 Ra6 Bf8 Kg4 Bc5 Kf3; id "TTT2.045";
Parent - By MrKris (***) Date 2021-04-13 05:27
TTT2 14
After 10 mins. Sf and Lc0 had 1.Kb2?? Bxh5 2.Bxe5+ Ng7 3.Ne7 hxg5 and black's Q is unleased.
Given 1.g6 Bxg6+:
after 10 mins. Lc0 had 2.Qxg6+?? -10.69 knowing it would be totally lost;
Stockfish began with that but @ 3 1/2 mins. switched to 2.Bc2!! -2.06 declining to -0.21= by 10 mins.

Then given 1.g6!! and 2.Bc2!!:
[Event "G/10'+6''"]
[Site "R7 2700X 16th | RTX 2060"]
[White "Lc0-0.27--J94-100"]
[Black "Stockfish_21032717_avx2"]
[Result "0-1"]
[BlackElo "2000"]
[Time "20:38:26"]
[WhiteElo "2000"]
[TimeControl "600+6"]
[SetUp "1"]
[FEN "1B2b2k/7q/4n2p/3Np1PQ/8/1p6/5N1P/1K1B4 w - - 0 1"]
[Termination "normal"]
[PlyCount "13"]

1. g6 Bxg6+ 2. Bc2 bxc2+ {+2.82/36 16 +for mover, black; Stockfish gives white some compensation right away.} 3. Kc1 {-22.77/12 27} Bxh5 {+1.12/36
23} 4. Bxe5+ {-27.12/10 5} Ng7 {+0.61/40 23 <<Stockfish realizes already its not winning} 5. Nf6 {?? -39.56/8 10 <<Lc0 does not understand 5.Ne7!=} Qf5
{+68.28/32 8} 6. Nxh5 {-65.52/5 23} Qxe5 {+M16/81 14} 7. Nd3 {-53.59/2 28
White resigns} 0-1

[Event "G/10'+6''"]
[Site "R7 2700X 16th | RTX 2060"]
[White "Stockfish_21032717_avx2"]
[Black "Lc0-0.27--J94-100"]
[Result "1/2-1/2"]
[BlackElo "2000"]
[Time "20:43:29"]
[WhiteElo "2000"]
[TimeControl "600+6"]
[SetUp "1"]
[FEN "1B2b2k/7q/4n2p/3Np1PQ/8/1p6/5N1P/1K1B4 w - - 0 1"]
[Termination "User Adjudication"]
[PlyCount "89"]

1. g6 Bxg6+ 2. Bc2 bxc2+ {+22.88/13 26 +for mover, black} 3. Kc1 {-4.10/40 49} Bxh5
{+27.94/11 5} 4. Bxe5+ {-3.71/37 6} Ng7 {+39.52/9 9} 5. Ne7 {-2.86/35 13}
Bf7 {+14.93/8 77} 6. h4 {-2.87/32 9} h5 {+13.51/8 8} 7. Bf4 {-0.53/32 8 <<Stockfish finally realizes its not lost and it that it has drawing chances, although it played the right moves.}
Be6 {+12.28/8 43 <<Lc0 stills shows a definite win; its eval. declines very, very slowly.} 8. Bd2 {-0.22/38 8} Bc4 {+11.69/8 21} 9. Bf4 {-0.07/47
13 <<Stockfish is essentially saying 'draw?'.} Ba6 {+10.29/8 20} 10. Bd2 {-0.07/55 8} Bd3 {+10.18/8 24} 11. Bf4
{-0.07/60 10} Bb5 {+9.53/8 19} 12. Bd2 {-0.07/55 10} Ba6 {+9.90/8 18} 13.
Bf4 {-0.07/52 9} Bd3 {+8.33/9 23} 14. Bd2 {-0.07/61 10} Bf5 {+9.01/8 15}
15. Bf4 {-0.07/52 11} Bc8 {+9.04/9 16} 16. Bd2 {-0.07/55 12} Bb7 {+9.14/9
23} 17. Bf4 {-0.07/64 11} Bg2 {+7.32/9 18} 18. Bd2 {-0.07/53 12} Bf3
{+8.31/8 17} 19. Bf4 {-0.06/55 11} Bb7 {+7.25/9 18} 20. Bd2 {-0.06/59 11}
Bd5 {+9.25/8 15} 21. Bf4 {-0.06/61 12} Bg8 {+6.29/9 18} 22. Bd2 {-0.06/65
11} Be6 {+5.84/10 18} 23. Bf4 {-0.06/64 17} Bg4 {+6.15/9 10} 24. Bd2
{-0.06/61 15} Bf3 {+4.32/10 19} 25. Bf4 {-0.07/63 12} Bg2 {+4.46/10 17} 26.
Bd2 {-0.06/60 12} Bd5 {+4.34/10 13} 27. Bf4 {-0.06/65 14} Bg8 {+4.01/10 13}
28. Bd2 {-0.07/58 15} Bf7 {+3.89/11 12} 29. Bf4 {-0.07/64 11} Be6 {+3.73/11
12} 30. Bd2 {-0.07/57 15} Bd7 {+3.11/11 27} 31. Bf4 {-0.07/58 204} Bg4
{+2.95/11 12} 32. Bd2 {-0.06/56 31} Bc8 {+2.86/11 12} 33. Bf4 {-0.06/39 8}
Ba6 {+2.71/12 17} 34. Bd2 {-0.06/55 14} Bb5 {+2.58/12 15} 35. Bf4 {-0.06/52
31} Bc6 {+2.32/12 14} 36. Bd2 {-0.06/61 8} Ba4 {+2.01/12 16} 37. Bf4
{-0.06/56 10} Bb3 {+2.05/13 12} 38. Bd2 {-0.06/54 7} Bg8 {+2.11/13 8} 39.
Bf4 {-0.06/57 51} Bc4 {+1.95/13 19} 40. Bd2 {-0.06/61 7} Ba6 {+1.84/13 10}
41. Bf4 {-0.06/60 6} Bb7 {+1.65/13 15} 42. Bd2 {-0.06/62 7} Bc6 {+1.44/13
10} 43. Bf4 {-0.06/63 9} Bd5 {+1.26/13 11} 44. Bd2 {-0.06/63 12} Be6
{+1.03/13 20 ½-½ User Adjudication} 45. Bf4 {-0.06/61 1} 1/2-1/2
Up Topic The Rybka Lounge / Test Positions / Tough Tactical Test 2

Powered by mwForum 2.27.4 © 1999-2012 Markus Wichitill