Not logged inRybka Chess Community Forum
Up Topic The Rybka Lounge / Computer Chess / New strongest net for Stockfish
- - By dorszcz (**) Date 2021-01-31 11:36 Edited 2021-01-31 11:43 Upvotes 1
Inspired by topic:
I decided to run a couple of my tests to find if there is any net that can be better than default Stockfish net. I tested all nets from NN stats that had positive result against default net and obiously default net for comparison. I was especially interested in net nn-ae5925b37cc9.nnue that was suggested in the topic. Later I found out it was the worst net in my test.

The nets used for my tests are (sorted after tests from the best to the worst):
1. nn-499db28e2ae3.nnue (Stockfish 251220 e2ae3)
2. nn-0ee45c570fd5.nnue (Stockfish 251220 70fd5)
3. nn-5f9577aef6ad.nnue (Stockfish 251220 ef6ad) - I forgot to use it in Test1.
4. nn-62ef826d1a6d.nnue (Stockfish 251220) - default net
5. nn-6554800d4b0c.nnue (Stockfish 251220 d460c) - typo, but it does not matter
6. nn-70a1e7e27c2e.nnue (Stockfish 251220 27c2e)
7. nn-5455c6d70a06.nnue (Stockfish 251220 70a06)
8. nn-245fd96bcf64.nnue (Stockfish 251220 bcf64)
9. nn-ae5925b37cc9.nnue (Stockfish 251220 cc9)

Test1, 1m+1s:

I took 3 the best nets from Test1 and nn-5f9577aef6ad.nnue which I forgot to Test2 with more games between engines and longer time.

Test2, 3m+1s:

nn-499db28e2ae3.nnue had very good result in fast first test and it was confirmed in the second test. I suggest this net should be considered to replace the default one.
You can download nn-499db28e2ae3.nnue by Fisherman here:
Parent - - By Hamster (**) Date 2021-02-03 13:02
Interesting test.
What hardware, settings and opening books did you use?
Parent - By dorszcz (**) Date 2021-02-04 14:55 Upvotes 1
Hardware is only 2 core i5 2.1 GHz with Syzygy 5 pieces tablebases placed on SSD. I used opening book DOTS1 with alternate colours. I know this number of games on slow CPU can be not enough proof so I will run another tournament soon on better computer with the best nets from these tests and maybe some others net.
Parent - By dorszcz (**) Date 2021-02-15 15:30 Upvotes 1
Previous tests were not very reliable because of too small amount of games. That's why I ran big tournament with 3600 games.
The results are here:

Participants (sorted from the best to the worst):
1. nn-478d27f8b594.nnue
2. nn-a76fbf2d8937.nnue
3. nn-f4838ada61cc.nnue
4. nn-6554800d4b0c.nnue
5. nn-70a1e7e27c2e.nnue
6. nn-499db28e2ae3.nnue
7. nn-62ef826d1a6d.nnue (default)
8. nn-5f9577aef6ad.nnue
9. nn-0ee45c570fd5.nnue

The winner is with nice advantage over the second net. Previous leading net nn-499db28e2ae3.nnue after more games seems very close to default net. You can find more results of these and others nets on Stefan Pohl website:
Up Topic The Rybka Lounge / Computer Chess / New strongest net for Stockfish

Powered by mwForum 2.27.4 © 1999-2012 Markus Wichitill