Not logged inRybka Chess Community Forum
Up Topic The Rybka Lounge / Test Positions / Tough Tactical Test 1
- - By dorszcz (**) Date 2020-05-06 15:44
TTT1 is a collection of 100 various hard positions for testing engines. Thanks to Dann Corbit who significantly contributed to the creation of this test.

Conditions:
Time limit: 15 seconds per position
CPU: i5-3570 (MP engines: 4x3600 MHz, SP engines: 1x3800MHz)
Tablebases: 6-pieces Syzygy, 5-pieces Gaviota, 5-pieces (and ~80 GB of most popular 6-pieces) Nalimov, all on SSD
Strongest version of engine is used: 64 bit, POPCNT, SSE4.2 etc.
256 MB hash, no books, no learning, 50 move rule is enabled

Results:
76 out of 100 = 76%  -  Bluefish XI-LP FD (Tactical=2; defensive=off)
54 out of 100 = 54%  -  Bluefish XI-LP FD
35 out of 100 = 35%  -  Black Diamond XR7
30 out of 100 = 30%  -  Crystal 260819 64
29 out of 100 = 29%  -  Eman 4.00
28 out of 100 = 28%  -  CorChess 3.1 260819
28 out of 100 = 28%  -  Bluefish FD 100919
25 out of 100 = 25%  -  MateFinder 260819
22 out of 100 = 22%  -  SugaR-NN 130819
21 out of 100 = 21%  -  AsmFishWCP_2019-07-23
20 out of 100 = 20%  -  Cfish 240719
19 out of 100 = 19%  -  Honey X5i
18 out of 100 = 18%  -  Crystal-Honey X5i
15 out of 100 = 15%  -  Stockfish 10
9 out of 100 = 9%  -  Spark-1.0
7 out of 100 = 7%  -  Xiphos 0.5.6
5 out of 100 = 5%  -  Andscacs 0.95
5 out of 100 = 5%  -  Critter 1.6a
5 out of 100 = 5%  -  Xiphos 0.6
5 out of 100 = 5%  -  Xiphos 0.5.3
4 out of 100 = 4%  -  Sting 18
4 out of 100 = 4%  -  Sting 14
4 out of 100 = 4%  -  Naum 4.6
4 out of 100 = 4%  -  Komodo 10
3 out of 100 = 3%  -  Nirvanachess 2.4
3 out of 100 = 3%  -  Wasp 3.60
2 out of 100 = 2%  -  Rybka 3 Dynamic
2 out of 100 = 2%  -  Houdini 1.5a
2 out of 100 = 2%  -  Booot 6.3.1
2 out of 100 = 2%  -  Stockfish 5
2 out of 100 = 2%  -  Arasan 21.3
2 out of 100 = 2%  -  Deep Rybka 4
2 out of 100 = 2%  -  IvanHoe 9.46b
1 out of 100 = 1%  -  SmarThink 1.98 (1CPU)
1 out of 100 = 1%  -  Alfil 13.1
1 out of 100 = 1%  -  Equinox 3.30
1 out of 100 = 1%  -  Gull 3
1 out of 100 = 1%  -  Senpai 2.0
1 out of 100 = 1%  -  rofChade 2.2
1 out of 100 = 1%  -  Rybka WinFinder 2.2
1 out of 100 = 1%  -  Nemorino_5.00
1 out of 100 = 1%  -  Wasp 3.75
1 out of 100 = 1%  -  Sting SF 3 VE
1 out of 100 = 1%  -  Fire 2.2+ xTreme GH
0 out of 100 = 0%  -  Spike 1.4
0 out of 100 = 0%  -  RubiChess 1.5
0 out of 100 = 0%  -  Fire 7.1
0 out of 100 = 0%  -  Texel 1.08a11
0 out of 100 = 0%  -  Topple 0.7.3
0 out of 100 = 0%  -  Pedone 1.9
0 out of 100 = 0%  -  Rodent III 0.273
0 out of 100 = 0%  -  Protector 1.9.0
0 out of 100 = 0%  -  Fritz 11 SE (1CPU)
0 out of 100 = 0%  -  Laser 1.7
0 out of 100 = 0%  -  Marvin 3.4.0
0 out of 100 = 0%  -  ICE 3.0 (1CPU)
0 out of 100 = 0%  -  Amoeba 3.0
0 out of 100 = 0%  -  Bobcat 3.25
0 out of 100 = 0%  -  RofChade 2.1
0 out of 100 = 0%  -  Deep iCE 4.0
0 out of 100 = 0%  -  RubiChess 1.6

Download here: http://www.mediafire.com/file/gwkqps6ihwro14g/Tough_Tactical_Test_1_06.05.2020.zip/file
Parent - - By Clementin (*) Date 2020-05-07 07:49
Thank you for building the test, it is really appreciated.

I ran Allie 0.6 + LS 14.2 at 15sec per move on my gtx 1660 ti and it got 58/100. Fat Fritz got 48/100. Lc0 25.1 was inbetween with LS 14.0. Maybe larger nets on better card will do better.
Parent - - By user923005 (****) Date 2020-05-07 08:23
I am curious if the NN programs solved the same problems or different problems
Parent - By MrKris (***) Date 2020-05-08 04:40
From my post below.

15" , R7 2700X 16ths | RTX 2060
Syzygy 6 50mrOn, 2 GBh
49) 1..  10) 1. secs. if found
f3+ 3 ;  Rd7     Black-Diamond-043020  68  (DeepDef,noCnoPro,Tac2)
f3+ 0 ;  Rd7     Lc0.24.1-SVt40-1541   61
f3+ 0 ;  Rd7     Lc0.24.1-Ls14         61
f3+ 0 ;  Rd7  ** Lc0.24.1-SVlgt60-3010 57
f3+ 0 ;  Rd7     Lc0-.23.2K-lg2036     55
f3+ 1 ;  Bxe4 11 Crystal-200420        50
Qxd5  ;  Bxe4  2 Houdini-6.03-Std-tac1 49  (8ths, 8thsTac @ 30")
Qxd5~ ;  Bxe4 11 Honey-043020          47
Qxd5  ;  Rd7   * Stockfish_20050217    43
Qxd5  ;  Bxe4  9 Houdini-6-Std-tac2    39  (8ths, 4thsTac @ 30")
Qxd5  ;  Bxe4  0 Komodo-13.3           38
Qxd5  ;  Bxe4  4 Houdini-6.03-Std      21  (8ths @ 30")
      ;  solved after: * 16", ** 34"
solved after ~ 02:10


All of my NN's and Stockfish (though about by 1 sec.) missed this.
One of the nets solved it in a maybe respectable 34 secs. afterwards.
[Event "#10"]
[Site "Tough Tactical Test 1"]
[Date ""]
[Round ""]
[White "often solved by CPU's"]
[Black ""]
[Result "1-0"]
[BlackElo "2400"]
[WhiteElo "2400"]
[TimeControl "0+15"]
[SetUp "1"]
[FEN "1r1q1rk1/1bR2pp1/1p5p/p2pNP2/Pb1Pn3/1P1B1R1P/1B2Q1P1/6K1 w - - 0 1"]
[Termination "unterminated"]
[PlyCount "33"]
[WhiteType "human"]
[BlackType "human"]

1. Bxe4 (1. Rd7 {??} Qg5 {= or +=} 2. f6 {quickly, Honey 0.00} Nxf6 3. Nxf7
Rxf7 4. Qe6 Nxd7 5. Qxf7+ Kh8 6. Qxd7) 1. .. dxe4 (1. .. Qxc7 2. f6 dxe4 3.
Rg3 {transposes}) 2. Rg3 Qxc7 3. f6 g6 4. Qe3 Kh7 5. Bc1 Qxc1+ 6. Qxc1 Rbc8
7. Qf4 Rc2 8. Ng4 Bd2 9. Re3 Bxe3+ 10. Nxe3 Rc1+ 11. Kh2 Bc8 12. Ng4 Bxg4
13. Qxc1 Be6 14. Qc6 e3 15. Qe4 Bxb3 16. Qxe3 Be6 (16. .. Bxa4 {??} 17.
Qa3) 17. Qa3 {Black's rook can not leave the 8th rank.} 1-0

Only my NN's, Crystal and Black Diamond found the win, the others did not have time to realize the loss.
The NN's all took under 1 sec., about how long a GM (maybe much less?) would take I think
[Event "#49"]
[Site "Tough Tactical Test 1"]
[Date "2020.05.07"]
[Round ""]
[White ""]
[Black "often solved by NN's"]
[Result "0-1"]
[BlackElo "2400"]
[Time "20:12:47"]
[WhiteElo "2400"]
[TimeControl "0+15"]
[SetUp "1"]
[FEN "k4r1r/Pp6/bP1bq1p1/3N2p1/R1pPppB1/4P1PP/5PK1/3QBR2 b - - 0 1"]
[Termination "normal"]
[PlyCount "21"]
[WhiteType "human"]
[BlackType "human"]
[Comment "bm f3+; id \"TTT1.049\";"]

1. ... f3+

( 1. ... Qxd5 {??} 2. Rxa6 {Lc0 t60-3010 1 min. +1.42, Honey 1 min. +2.42}
bxa6 3. Qa4 {etc.} )

2. Kg1 Qxg4 {Lc0 t60-3010 1 min. -5.05 does not say mate but its PV is:} 3. hxg4 Rh3 4. Rxc4 Rfh8 5. Rc8+ Rxc8 6. Nc7+ Bxc7 7. bxc7 Rch8 8.
c8=Q+ Rxc8 9. Qxf3 exf3 10. Bc3 Rch8 11. d5 Rh1# 0-1
Parent - - By Clementin (*) Date 2020-05-09 06:56
It is the same problems for sure. I reran the test after recreating the database in Fritz GUI, but the results are quite high (say for Allie, 58/100) and I find them surprising. I also reran the test in Arena and with ArasanEpdTEster, and Allie got only 46/100 (with the same settings, network etc.). I absolutely don't get it. I checked the test going in Fritz GUI... Alllie just solves the problems in due time. Say position 100. In Fritz GUI, Allie solves the problem:

63: TTT1.100 Line, TTT1
8/5pkp/1p6/p4p2/3P4/B5rP/1R6/7K w - - 0 1


Analysis by Allie v0.6 (6cd06b9):

1.Bd6
  White is clearly better: +- (2.21)   00:00:04  22N
1.Rg2 Rxg2
  White is better: +/- (1.02)  Depth: 1/2   00:00:04  30N
1.Rg2 Rxg2 2.Kxg2
  White is clearly better: +/- (1.38)  Depth: 1/3   00:00:04  48N
1.Rg2 Rxg2 2.Kxg2 Kf6
  White is better: +/- (1.07)  Depth: 2/4   00:00:04  79N
1.Be7 Rxh3+ 2.Kg2 Re3 3.Bd8
  White is better: +/- (1.18)  Depth: 2/5   00:00:04  120N
1.Be7 Rxh3+ 2.Kg2 Re3 3.Bd8 a4
  White is better: +/- (1.14)  Depth: 2/6   00:00:04  131N
1.Be7 Rxh3+ 2.Kg2 Re3 3.Bd8 a4
  White is clearly better: +/- (1.31)  Depth: 3/7   00:00:04  194N
1.Be7 Rxh3+ 2.Kg2 Re3 3.Bd8 a4 4.Rxb6
  White is better: +/- (1.29)  Depth: 3/8   00:00:04  224N
1.Be7 Rxh3+ 2.Kg2 Re3 3.Bd8 a4 4.Rxb6
  White is better: +/- (1.28)  Depth: 4/8   00:00:04  305N
1.Be7 Rxh3+ 2.Kg2 Re3 3.Bd8 a4 4.Rxb6 Re6
  White is clearly better: +/- (1.32)  Depth: 4/9   00:00:04  351N
1.Be7 Rxh3+ 2.Kg1 Re3 3.Rg2+ Kh6 4.Bf8+
  White is clearly better: +/- (1.39)  Depth: 5/10   00:00:04  542N
1.Be7 Rxh3+ 2.Kg1 f4
  White is clearly better: +/- (1.32)  Depth: 5/11   00:00:04  814N
1.Be7 Rxh3+ 2.Kg1 f4 3.Rxb6
  White is clearly better: +/- (1.31)  Depth: 6/11   00:00:04  1024N
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Ra6 h5
  White is better: +/- (1.29)  Depth: 6/12   00:00:04  1126N
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Ra6 h5 5.Kf2 h4
  White is better: +/- (1.30)  Depth: 6/13   00:00:04  1809N
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Ra6 f6 5.Bxf6+
  White is better: +/- (1.30)  Depth: 7/13   00:00:04  1974N
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Kf1 a4
  White is better: +/- (1.17)  Depth: 7/14   00:00:04  3359N
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Ra6 f6 5.Bxf6+ Kg6 6.Be5+
  White is better: +/- (1.14)  Depth: 7/15   00:00:04  3946N
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Kf1 h5 5.Ra6
  White is better: +/- (1.11)  Depth: 8/15   00:00:04  4410N
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Kf1 h5 5.Ra6 Kh7
  White is better: +/- (1.07)  Depth: 8/16   00:00:04  4983N
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Kf1 Rf3+ 5.Kg2
  White is better: +/- (1.05)  Depth: 8/17   00:00:04  9025N
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Kf1 h5 5.Ra6 a4 6.Bf6+
  White is better: +/- (1.03)  Depth: 9/17   00:00:05  10kN
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Kf1 h5 5.Ra6 a4 6.Bf6+
  White is better: +/- (1.02)  Depth: 9/18   00:00:05  11kN
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Bd8
  White is better: +/- (1.00)  Depth: 9/19   00:00:05  12kN
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Bd8
  White is better: +/- (1.00)  Depth: 9/20   00:00:05  13kN
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Bd8
  White is better: +/- (1.00)  Depth: 9/21   00:00:05  14kN
1.Be7 Rxh3+ 2.Kg1 Rd3 3.Rxb6 f4 4.Kf1 h5 5.Ra6 a4 6.Bf6+
  White is better: +/- (0.96)  Depth: 10/21   00:00:05  21kN
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 f6 4.Be7 Kg6 5.Rxf6+ Kg5 6.Kf2 f4
  White is better: +/- (0.95)  Depth: 10/21   00:00:05  22kN
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 Kh6 4.Kf1 Kg5 5.Bc5 f4 6.Ke2
  White is better: +/- (1.01)  Depth: 10/22   00:00:05  28kN
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 Kh6 4.Bc5+ Kg5 5.Kf2 Kf4 6.Rb7
  White is better: +/- (1.03)  Depth: 10/23   00:00:06  29kN
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 Kg6 4.Bc5+ f6 5.Kf1 f4 6.Ke2 Re3+ 7.Kd2 h5 8.Rb8
  White is better: +/- (1.05)  Depth: 10/24   00:00:06  32kN
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 f6 4.Be7 Kg6 5.Rxf6+ Kg5 6.Kf2 f4 7.Rf7+ Kg4 8.Bc5 h5 9.Ke2 Re3+ 10.Kd2 h4
  White is better: +/- (1.03)  Depth: 11/24   00:00:06  33kN
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 f6 4.Be7 Kg6 5.Rxf6+ Kg5 6.Kf2 f4 7.d5 Kg4 8.d6 a4 9.Ke2 Rd5 10.Rf8 a3
  White is better: +/- (1.03)  Depth: 11/25   00:00:06  37kN
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 Kg6 4.Bc5+ f6 5.Kf1 f4 6.Ke2 Re3+ 7.Kd2 h5 8.Rb8
  White is better: +/- (1.05)  Depth: 11/26   00:00:06  39kN, tb=1
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 Kg6 4.Kf2 f4 5.Bxf4+ Kf5 6.Be3 Ke4 7.Rf6 Rb3
  White is better: +/- (1.08)  Depth: 12/27   00:00:07  51kN, tb=2
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 f6 4.Be7 a4 5.Ra6 f4 6.Bxf6+ Kf7 7.Be5 a3 8.Kf2 f3 9.Rf6+ Ke7 10.Rh6
  White is better: +/- (1.10)  Depth: 13/27   00:00:08  76kN, tb=3
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 f6 4.Be7 a4 5.Bxf6+ Kg6 6.Ra6 f4 7.Be5+ Kf5 8.Rxa4 Ke4 9.Ra1 h5 10.Re1+ Re3 11.Rf1 Re2+ 12.Rf2 Rxf2+
  White is better: +/- (1.06)  Depth: 13/28   00:00:09  102kN, tb=6
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 f6 4.Be7 a4 5.Ra6 f4 6.Bxf6+ Kg6 7.Be5+ Kf5 8.Rxa4 Ke4 9.Ra1 h5 10.Re1+ Re3 11.Rf1 Re2+ 12.Rf2 Rxf2+ 13.Kxf2 h4
  White is better: +/- (1.03)  Depth: 14/28   00:00:10  134kN, tb=9
1.Rg2 Rxg2 2.Kxg2 Kf6 3.Bd6 Ke6 4.Bc7 Kd5 5.Bxb6 a4 6.Bc5 Ke4 7.h4 f4 8.Kf2 h5
  White is better: +/- (1.01)  Depth: 14/28   00:00:11  163kN, tb=9
1.Bd6 Rxh3+ 2.Kg2 Rd3 3.Rxb6 f6 4.Be7 a4 5.Ra6 f4 6.Bxf6+ Kg6 7.Be5+ Kf5 8.Rxa4 Ke4 9.Ra1 h5 10.Re1+ Re3 11.Rg1 Rg3+ 12.Kh2
  White is better: +/- (1.00)  Depth: 14/28   00:00:11  163kN, tb=9
1.Rg2 f4 2.Be7 f5 3.Bh4 Rxg2 4.Kxg2 b5 5.d5 Kf7 6.Bd8 a4 7.Ba5 a3 8.Kf3 a2 9.Bc3 Ke7
  White is better: +/- (1.03)  Depth: 14/28   00:00:11  172kN, tb=9
1.Rg2 f4 2.Be7 Kg6 3.Rd2 Rxh3+ 4.Kg1 f6 5.d5 Kf7 6.d6 Rg3+ 7.Kf2 Rg8 8.Re2 Ke8 9.Bxf6+ Kd7 10.Be5 a4 11.Kf3 a3 12.Rh2 h5 13.Rxh5 a2 14.Rh7+ Ke6
  White is better: +/- (1.22)  Depth: 14/29   00:00:14  215kN, tb=9
1.Rg2 f4 2.Rxg3+ fxg3 3.d5 Kf6 4.Kg2 b5 5.Bc5 Ke5 6.d6 Ke6 7.Kxg3 f5 8.Bb6 b4 9.Bxa5 b3 10.Bc3 Kxd6 11.Kf4
  White is clearly better: +- (1.70)  Depth: 14/29   00:00:16  302kN, tb=9


While in ArasanEpdTester I get from the logfile:
Pos 100
8/5pkp/1p6/p4p2/3P4/B5rP/1R6/7K w - - bm Rg2; id "TTT1.100";


2020-05-09T01:29:17.102000 >> isready
2020-05-09T01:29:17.114000 << readyok
2020-05-09T01:29:17.114000 >> ucinewgame
2020-05-09T01:29:17.114000 >> position fen
8/5pkp/1p6/p4p2/3P4/B5rP/1R6/7K w - - 0 1

2020-05-09T01:29:17.114000 >> go movetime 15000
2020-05-09T01:29:18.100000 << info depth 0 seldepth 1 nodes 22 nps 880 score cp 554 time 25 hashfull 0 tbhits 0 pv a3d6
2020-05-09T01:29:18.108000 << info depth 1 seldepth 2 nodes 31 nps 939 score cp 432 time 33 hashfull 0 tbhits 0 pv b2g2
2020-05-09T01:29:18.122000 << info depth 1 seldepth 3 nodes 51 nps 1085 score cp 155 time 47 hashfull 0 tbhits 0 pv b2g2 g3g2 h1g2
2020-05-09T01:29:18.130000 << info depth 1 seldepth 4 nodes 70 nps 1273 score cp 127 time 55 hashfull 0 tbhits 0 pv b2g2 g3g2 h1g2 g7f6
2020-05-09T01:29:18.138000 << info depth 2 seldepth 5 nodes 98 nps 1556 score cp 125 time 63 hashfull 0 tbhits 0 pv b2g2 g3g2 h1g2 g7f6 d4d5
2020-05-09T01:29:18.147000 << info depth 2 seldepth 6 nodes 132 nps 1833 score cp 101 time 72 hashfull 0 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6
2020-05-09T01:29:18.155000 << info depth 3 seldepth 7 nodes 161 nps 2013 score cp 95 time 80 hashfull 0 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 h7h5
2020-05-09T01:29:18.167000 << info depth 3 seldepth 8 nodes 213 nps 2315 score cp 123 time 92 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g2 h3e3 e7d8
2020-05-09T01:29:18.201000 << info depth 4 seldepth 8 nodes 323 nps 2563 score cp 151 time 126 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g2 h3e3 e7d6 e3d3 b2b6 f7f6
2020-05-09T01:29:18.211000 << info depth 4 seldepth 9 nodes 366 nps 2691 score cp 146 time 136 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g2 h3e3 e7d8 a5a4 b2b6 e3e6
2020-05-09T01:29:18.222000 << info depth 4 seldepth 10 nodes 441 nps 3000 score cp 140 time 147 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g1 h3e3 b2g2 g7h6
2020-05-09T01:29:18.249000 << info depth 5 seldepth 11 nodes 654 nps 3759 score cp 134 time 174 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g1 a5a4
2020-05-09T01:29:18.280000 << info depth 5 seldepth 12 nodes 892 nps 4351 score cp 129 time 205 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g1 f5f4 b2b6
2020-05-09T01:29:18.304000 << info depth 6 seldepth 12 nodes 1092 nps 4769 score cp 136 time 229 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g1 h3d3 b2b6 f5f4 b6a6 a5a4
2020-05-09T01:29:18.384000 << info depth 6 seldepth 13 nodes 1775 nps 5744 score cp 138 time 309 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g1 h3d3 b2b6 f5f4 b6a6 h7h5 g1f2 g7h7
2020-05-09T01:29:18.447000 << info depth 7 seldepth 13 nodes 2405 nps 6465 score cp 128 time 372 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g1 h3d3 b2b6 f5f4 b6a6 h7h5 g1f2 h5h4
2020-05-09T01:29:18.496000 << info depth 7 seldepth 14 nodes 3066 nps 7283 score cp 117 time 421 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g1 h3d3 b2b6 f5f4 b6a6 f7f6 e7f6 g7g6
2020-05-09T01:29:18.564000 << info depth 8 seldepth 15 nodes 3933 nps 8043 score cp 109 time 489 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g1 h3d3 b2b6 f5f4 g1f1 a5a4
2020-05-09T01:29:18.618000 << info depth 8 seldepth 16 nodes 4738 nps 8726 score cp 108 time 543 hashfull 0 tbhits 0 pv a3e7 g3h3 h1g1 h3d3 b2b6 f5f4 g1f1 h7h5 e7f6
2020-05-09T01:29:19.039000 << info depth 8 seldepth 16 nodes 11260 nps 11680 score cp 99 time 964 hashfull 1 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 g7g6 d6f4 f7f6
2020-05-09T01:29:19.225000 << info depth 9 seldepth 16 nodes 12913 nps 11229 score cp 105 time 1150 hashfull 1 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 g7h6 g2f2 h6g5 d6c5
2020-05-09T01:29:19.255000 << info depth 9 seldepth 17 nodes 13434 nps 11385 score cp 101 time 1180 hashfull 1 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 g7h6 g2f1
2020-05-09T01:29:19.296000 << info depth 9 seldepth 18 nodes 14032 nps 11492 score cp 99 time 1221 hashfull 1 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 g7h6 d6e5 h6g5 g2f2 a5a4
2020-05-09T01:29:19.418000 << info depth 9 seldepth 19 nodes 15783 nps 11752 score cp 101 time 1343 hashfull 1 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 g7h6 g2f1 h6g5 d6c5 g5f4
2020-05-09T01:29:19.501000 << info depth 9 seldepth 20 nodes 17291 nps 12126 score cp 103 time 1426 hashfull 1 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 g7g6 d6e5 g6g5 b6f6 a5a4 f6f7 f5f4 g2f2
2020-05-09T01:29:19.596000 << info depth 9 seldepth 21 nodes 18790 nps 12354 score cp 103 time 1521 hashfull 1 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 g7g6 g2f1 g6g5 d6c5 g5f4
2020-05-09T01:29:19.631000 << info depth 9 seldepth 22 nodes 19528 nps 12550 score cp 102 time 1556 hashfull 1 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 g7g6 g2f1 g6g5 d6c5 g5f4
2020-05-09T01:29:19.809000 << info depth 10 seldepth 22 nodes 22745 nps 13117 score cp 95 time 1734 hashfull 2 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 g7g6 e7f6 a5a4 b6a6 a4a3 f6e7 g6h5 e7c5 h5g4 a6a3
2020-05-09T01:29:19.954000 << info depth 10 seldepth 23 nodes 25482 nps 13561 score cp 94 time 1879 hashfull 2 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 g7g6 e7f6 a5a4 b6a6 a4a3 f6e7 g6h5 e7c5 h5g4 a6a3 d3d2 g2f1
2020-05-09T01:29:20.006000 << info depth 10 seldepth 24 nodes 26440 nps 13685 score cp 95 time 1932 hashfull 2 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 g7g6 e7f6 a5a4 b6a6 a4a3 f6e7 g6h5 e7c5 a3a2 a6a2
2020-05-09T01:29:20.074000 << info depth 10 seldepth 25 nodes 27469 nps 13741 score cp 97 time 1999 hashfull 2 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 g7g6 e7f6 a5a4 b6a6 a4a3 f6e7 g6h5 e7c5 h5g4 a6a3 d3d2 g2f1 f5f4 f1e1 d2c2
2020-05-09T01:29:20.135000 << info depth 10 seldepth 26 nodes 28686 nps 13925 score cp 99 time 2060 hashfull 2 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 g7g6 e7f6 a5a4 b6a6 f5f4 f6e5 g6f5 a6a4 d3d2 g2h3
2020-05-09T01:29:20.332000 << info depth 11 seldepth 26 nodes 33090 nps 14655 score cp 102 time 2258 hashfull 2 tbhits 0 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 g7g6 e7f6 a5a4 b6a6 f5f4 f6e5 g6f5 a6a4 d3d2 g2h3
2020-05-09T01:29:20.744000 << info depth 11 seldepth 27 nodes 43487 nps 16293 score cp 105 time 2669 hashfull 3 tbhits 1 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 f5f4 e7f6 g7g6 f6e5 g6g5 b6f6 a5a4 f6f4 a4a3 f4f8 h7h5 g2f2 h5h4 f2e2 d3b3
2020-05-09T01:29:20.883000 << info depth 12 seldepth 28 nodes 46837 nps 16680 score cp 106 time 2808 hashfull 3 tbhits 2 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 f5f4 e7f6 g7g6 f6e5 g6g5 b6a6 h7h5 a6a5 g5g4 a5a7 d3d2 g2g1 h5h4
2020-05-09T01:29:22.505000 << info depth 13 seldepth 28 nodes 76033 nps 17159 score cp 111 time 4431 hashfull 5 tbhits 3 pv a3d6 g3h3 h1g2 h3d3 b2b6 g7g6 g2f2 g6g5 d6c5 g5f4 b6b7 f4e4 b7e7 e4d5
2020-05-09T01:29:24.104000 << info depth 14 seldepth 28 nodes 124693 nps 20682 score cp 108 time 6029 hashfull 8 tbhits 5 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 b6a6 g7g6 e7f6 f5f4 f6e5 g6f5 a6a4 f5e4 a4a1 h7h5 a1e1 d3e3 e1f1 f4f3 g2g3 e3e2 f1f3
2020-05-09T01:29:24.761000 << info depth 14 seldepth 29 nodes 146886 nps 21969 score cp 104 time 6686 hashfull 9 tbhits 6 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 b6a6 g7g6 e7f6 f5f4 f6e5 g6f5 a6a4 f5e4 a4a1 h7h5 a1e1 d3e3 e1d1 e3c3
2020-05-09T01:29:24.826000 << info depth 14 seldepth 30 nodes 148639 nps 22014 score cp 104 time 6752 hashfull 9 tbhits 6 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 b6a6 g7g6 e7f6 f5f4 f6e5 g6f5 a6a4 f5e4 a4a1 h7h5 a1e1 d3e3 e1d1 e3c3
2020-05-09T01:29:24.927000 << info depth 14 seldepth 31 nodes 151060 nps 22046 score cp 105 time 6852 hashfull 9 tbhits 7 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 b6a6 g7g6 e7f6 f5f4 f6e5 g6f5 a6a4 f5e4 a4a1 h7h5 a1e1 d3e3 e1d1 e3c3
2020-05-09T01:29:25.218000 << info depth 14 seldepth 32 nodes 158976 nps 22253 score cp 106 time 7144 hashfull 9 tbhits 10 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 e7f6 g7g6 b6a6 f5f4 f6e5 g6f5 a6a4 f5e4 a4a1 h7h5 a1e1 d3e3 e1h1 f4f3 g2g3 e3e2 h1h4 e4e3 e5f4 e3d4
2020-05-09T01:29:25.336000 << info depth 14 seldepth 33 nodes 162108 nps 22326 score cp 107 time 7261 hashfull 10 tbhits 16 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 e7f6 g7g6 b6a6 f5f4 f6e5 g6f5 a6a4 f5e4 a4a1 h7h5 a1e1 d3e3 e1h1 f4f3 g2g3 e3e2 h1h4 e4e3 e5f4 e3d4 g3f3 e2e6
2020-05-09T01:29:26.217000 << info depth 15 seldepth 33 nodes 191632 nps 23536 score cp 101 time 8142 hashfull 11 tbhits 21 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 b6a6 g7g6 e7f6 f5f4 f6e5 g6f5 a6a4 f5e4 a4a1 h7h5 a1e1 d3e3 e1h1 e3g3 g2h2 g3d3 h1f1 d3d2
2020-05-09T01:29:28.745000 << info depth 15 seldepth 33 nodes 285464 nps 26754 score cp 97 time 10670 hashfull 16 tbhits 30 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 b6a6 f5f4 e7f6 g7f7 f6e5 a4a3 g2f2 f4f3 a6h6 f7e7 f2g3 e7d7 g3f2 d7e7 h6h7
2020-05-09T01:29:31.268000 << info depth 15 seldepth 33 nodes 368362 nps 27921 score cp 93 time 13193 hashfull 21 tbhits 48 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 b6a6 f5f4 e7f6 g7f7 g2f2 a4a3 f6e5 f4f3 a6h6 f7e7 f2g3 e7d7 g3f2 d7e7 h6f6
2020-05-09T01:29:31.597000 << info depth 15 seldepth 34 nodes 379966 nps 28100 score cp 92 time 13522 hashfull 22 tbhits 50 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 b6a6 f5f4 e7f6 g7f7 f6e5 a4a3 a6h6 f7e7 g2f2 f4f3 f2g3 e7d7 e5h8
2020-05-09T01:29:32.343000 << info depth 15 seldepth 35 nodes 408802 nps 28652 score cp 92 time 14268 hashfull 23 tbhits 57 pv a3d6 g3h3 h1g2 h3d3 b2b6 f7f6 d6e7 a5a4 b6a6 f5f4 e7f6 g7f7 f6e5 a4a3 a6f6 f7e8 f6h6 d3d1 h6a6 d1d3 a6h6 e8d7 g2f2 f4f3 f2g3 a3a2 h6a6
2020-05-09T01:29:32.775000 << bestmove a3d6 ponder g3h3
epd bm: Rg2
Engine bestmove in san: Bd6
Engine bestmove does not match the epd bm??
Total position to be evaluated: 100
Correct: 46, Evaluated: 100, CorrectRate: 46.0%

Done!! TotalPos: 100, Correct: 46 (46.0%)


Maybe i'm doing something stupid, or there might be some kind of communication problems between Allie and some utilities or GUI. In any case, for once, the real problem seems to be the low results in Arena and ArasanEpdTester rather than the high one in Fritz GUI (i'm used to see the opposite).
Parent - By dorszcz (**) Date 2020-05-09 10:09
There is some random factor in searching. You can test several times the same engine with the same settings in the same GUI and get different results.
It might be a coincidence. When big difference in results repeats in several runs it might be a problem somewhere.
- - By MrKris (***) Date 2020-05-07 17:35
Thanks again ... great !!
Also there: http://talkchess.com/forum3/viewtopic.php?f=2&t=73852

15" , R7 2700X 16ths | RTX 2060
Syzygy 6 50mrOn, 2 GBh

Black-Diamond-043020  68  (DeepDef,noCnoPro,Tac2)
Lc0.24.1-SVt40-1541   61
Lc0.24.1-Ls14         61
Lc0.24.1-SVlgt60-3010 57
Lc0-.23.2K-lg2036     55
Crystal-200420        50
Houdini-6.03-Std-tac1 49  (8ths, 8thsTac @ 30")
Honey-043020          47
Stockfish_20050217    43
Houdini-6-Std-tac2    39  (8ths, 4thsTac @ 30")
Komodo-13.3           38
Houdini-6.03-Std      21  (8ths @ 30")


By Clementin:

> I ran Allie 0.6 + LS 14.2 at 15sec per move on my gtx 1660 ti and it got 58/100. Fat Fritz got 48/100. Lc0 25.1 was inbetween with LS 14.0. Maybe larger nets on better card will do better.


Excellent GTX 1660 Ti results! The only excuse for mine is the many 0's or few seconds, below - here it looks like the nets generally solved quite quickly or not at all.

By user923005:

> I am curious if the NN programs solved the same problems or different problems


Below 27 of Ls14 61 solved where not solved by Honey,
and 34 of Honey 47 where solved by Ls14,
Sorry, I don't have time to collate more.
Honey-043020 = Y  
  Analyzing engine: Lc0.24.1-Ls14
  1) .. Qe7-e4          Kd7-c8   
  2) .. Ra8-g8          Ra8-g8  * 7 Seconds
  3) .. Rb2-b3          Rb2-b3  * 0 Seconds
  4) Bd3xh7             Qd1-h5   
Y  5) .. Nf6-h5          Nf6-h5  * 0 Seconds
Y  6) Qd2-f4             Qd2-e3   
Y  7) .. Nd6xe4          Ra8-g8   
Y  8) .. h5xg4           h5xg4   * 0 Seconds
  9) .. a4-a3           Bd8-a5   
Y 10) Bd3xe4             Rc7-d7   
 11) .. Bf8-e7          g7xf6    
Y 12) f2-f4              f2-f4   * 0 Seconds
 13) .. Ng3-f1          Nf4xe2   
 14) Ne1-d3, Ne1-f3     Ne1-d3  * 3 Seconds
Y 15) .. Bc8xh3          Ne7-g6   
 16) Bb2-c1             Bb2-c1  * 0 Seconds
Y 17) Nf3-h2             Nf3-h2  * 0 Seconds
Y 18) .. h7-h5           Rc8-f8   
 19) Qa7xd7             Qa7xd7  * 0 Seconds
Y 20) .. Qc7-c8          Qc7-c8  * 0 Seconds
Y 21) .. Rd8-d4          Rd8-d4  * 0 Seconds
 22) .. Bc8xh3          Bc8xa6   
 23) Ne5-g6             Qd4-b2   
 24) Rf1-f3             f5xg6    
Y 25) Rh3-h5             Rh3-h5  * 0 Seconds
 26) Rd1-b1             Rd1-d3   
Y 27) .. Ra4xe4          Ra4xe4  * 0 Seconds
Y 28) Bf3xh5             Bf3xh5  * 0 Seconds
 29) .. Qf6-g5          Qf6-g5  * 0 Seconds
 30) Rb1-e1             Ne6xf8   
 31) .. Be5xd4          Ke7-d6   
 32) Qb2xb5             Qb2xb5  * 0 Seconds
Y 33) Rd2-d3             Ne5xf7   
Y 34) Nb3-c5             Nb3-c5  * 12 Seconds
 35) .. Ng6-h4          Rh3xe3   
 36) Nd4-f5             Qe2-h5   
Y 37) Rf1-f5             Rf1-f5  * 0 Seconds
Y 38) .. Ra2xe2          Ra2xe2  * 7 Seconds
Y 39) .. Ng3-e2          Ng3-e2  * 5 Seconds
Y 40) Qe2-h5             Qe2-h5  * 0 Seconds
 41) Rf5xf7             h2xg3    
 42) .. Be7-d6          g5-g4    
Y 43) .. Rc3xc7          Rc3xc7  * 13 Seconds
 44) Bg2-h3             Bg2-h3  * 0 Seconds
Y 45) Ra8-a7             Ra8-a7  * 10 Seconds
 46) Nf3xd4             Bh6-e3   
Y 47) .. Qc5-d4          Qc5-d4  * 14 Seconds
 48) Bc2xh7             Bc2xh7  * 0 Seconds
 49) .. f4-f3           f4-f3   * 0 Seconds
 50) Re1-e4             Re1-e4  * 0 Seconds
 51) Bh6-g7             Ra3xa4   
Y 52) Qf1-g1             Rg7-g1   
 53) .. Ba8xe4          Ng7xh5   
 54) .. Ng5xf3, Bg4xf3  Qh6xh2   
 55) Bf4xh6             Bf4xh6  * 0 Seconds
 56) Bf7xg6             Bf7xg6  * 4 Seconds
 57) .. Bg6-e4          Bg6-e4  * 0 Seconds
Y 58) .. Bd6xh2          Bd6xh2  * 0 Seconds
Y 59) Rc6-d6             Rc6-d6  * 0 Seconds
 60) Rg1-g4             Rg1-g4  * 9 Seconds
Y 61) e5xf6              e5xf6   * 0 Seconds
 62) Qf3xf8             Qf3xc6   
Y 63) .. c7-c6           c7-c6   * 0 Seconds
 64) Qe4-e5, Qe4-c6, Qe4-b7, Kg2-g1  f6-f7    
 65) .. Nc6xd4          Nc6xd4  * 0 Seconds
 66) .. Ra7-g7          Ra7xa1   
 67) Bc3xe5             Bc3xe5  * 0 Seconds
Y 68) .. Qh6-h3          Qh6-h3  * 1 Second
Y 69) Bg6-h7             Bg6-h7  * 0 Seconds
Y 70) Rh1xh7             Rh1xh7  * 0 Seconds
Y 71) .. Rg7-h7          Bb6xf2   
Y 72) Bd3xh7             Bd3xh7  * 0 Seconds
Y 73) .. Bb5-c6          Bb5xa4   
 74) Rb6xc6             Rb6xc6  * 4 Seconds
Y 75) d5-d6              d5-d6   * 0 Seconds
Y 76) .. Rh8xh2          Rh8xh2  * 0 Seconds
Y 77) f4-f5              Be7-b4   
Y 78) c4xd5              c4-c5    
 79) .. e4-e3           Re7xe6   
 80) Rf1-f3             Rf1-f3  * 2 Seconds
 81) Kc4xd4             Nc8-b6   
 82) .. Rd7xd6          Rd7xd6  * 8 Seconds
Y 83) Nh4-f3             Nh4-f3  * 14 Seconds
Y 84) .. Kf6xg6          Kf6xg6  * 1 Second
Y 85) Bc2xg6             Bc2xg6  * 2 Seconds
 86) Kg1-h2             Kg1-h2  * 1 Second
 87) f5-f6              f5-f6   * 0 Seconds
 88) Bg7-e5             Rg1xh1   
 89) .. Nc1xe2          Nc1xb3   
 90) Qf2xd2             Qf2xd2  * 3 Seconds
Y 91) Rc4xc5             Rc4xc5  * 5 Seconds
Y 92) Be2-c4             Be2-c4  * 0 Seconds
Y 93) Ng5-e6             Rg1-f1   
Y 94) .. g4-g3           g4-g3   * 0 Seconds
Y 95) .. g5-g4           g5-g4   * 7 Seconds
 96) e5-e6              e5-e6   * 9 Seconds
Y 97) g5-g6              g5-g6   * 3 Seconds
 98) .. Nh4xg2          Nh4xg2  * 0 Seconds
 99) Ng3-f5             Nd5xb4   
100) Rb2-g2             Rb2-g2  * 8 Seconds
   Lc0: 61 of 100 matching moves
   7-5-20 03:21:35, Total time: 01:45:49 Rated time: 12:17 = 737 Seconds
Honey: 47 of 100 matching moves
7-5-20 05:33:53, Total time: 03:58:07 Rated time: 17:54 = 1074 Seconds

== 34 by both 
Parent - - By user923005 (****) Date 2020-05-07 18:50
You have really good tactical results with NN.
The LC0 run I did had the biggest net of all, which is probably not good for one minute tactical analysis.
Parent - - By user923005 (****) Date 2020-05-07 18:52
Specifically, I used:
384x30-t60-3350-lr0.002.pb.gz
Parent - By MrKris (***) Date 2020-05-07 20:58
https://www.comp.nus.edu.sg/~sergio-v/t60/384x30/
3350 has LR0.002, evidentally the others are "Ongoing, LR: 0.001", the smaller the better I think -but not sure.

The much older (2 months!, also must be from old official t60 nets) 384x30-t60-3010 is supposed to be the strongest of this type:
http://lczero.org/play/bestnets/
(It says the older t40 1705 is better than the 2036 I used, also.)

And it was used in the just completed TCEC 17 Superfinal and CCC 13 Final (instead of newer ones at the SV link at top).

And, I have this so far in my net elimination matches: http://rybkaforum.net/cgi-bin/rybkaforum/topic_show.pl?pid=586344
Lc0 v0.24.1:
#1  SV384x30-t60-3200  126.5-98.0   128x10-591219
#2  SV384x30-t60-3200  150.5-127.5  256x20-42850
#3  SV384x30-t60-3200  154.0-126.0  320x24J13B.2-178
#4  256x20-t40-1541SV  178.0-170.0  SV384x30-t60-3200  {8 Elo}
#5  256x20-t40-1541SV   36.5-5.5    test-512x40-320SV
#6  Leelenstein 13.1   175.0-173.0  256x20-t40-1541SV  {2 Elo}
#7  Leelenstein 13.1   148.5-113.5  384x30-t40-2036SV
#8  Leelenstein 13.2   142.0-120.0  320x24-net-63222
#9  Leelenstein 13.2    39.5-20.5   128x10-net-701473
#10 Leelenstein 13.2   118.5-87.5   SV384x30-t60-3350 - stopped early at Ls13.2 +39 -8 =159
#11 SV384x30-t60-3010  175.0/173.0  Leelenstein 13.2  {2 Elo}

3010 was slightly ahead of Ls13.2, but Ls13.2 had crushed 3350.

Strange situation.
Parent - - By dorszcz (**) Date 2020-05-08 11:49 Edited 2020-05-08 19:28
Good results. Unfortunately I don't have a decent graphics card to test GPU engines.
Parent - - By MrKris (***) Date 2020-05-14 04:50
Next time I compile a Lc0 for my Ubuntu I'll try to make a Lc0-CPU also just to see if it can solve any.

Thanks for your easy to use web site and you analysis and pgn files!
Parent - By dorszcz (**) Date 2020-05-16 13:56
When you have please share the results.
Up Topic The Rybka Lounge / Test Positions / Tough Tactical Test 1

Powered by mwForum 2.27.4 © 1999-2012 Markus Wichitill