Not logged inRybka Chess Community Forum
Up Topic The Rybka Lounge / Computer Chess / Scaling: Stockfish thread count and Lc0 net size
- By MrKris (***) Date 2021-04-05 23:11 Upvotes 1
 
G/90 secs. + 1 sec. , no Syzygy
R7 2700X  |  RTX 2060

Nooman 3-move openings: the same 50 colors reversed for each Sf/Lc

Stockfish: avx2 from http://www.abrok.eu/stockfish
1 thread 64 MBh, 4 threads 256 GBh, 16 threads 1GBh

Lc0 0.27.0 : + new settings MultiGather=true MaxOutOfOrderEvals=2.4 https://github.com/LeelaChessZero/lc0/commits/master

10x128 net                     Elo  +-  Games Points Score   Draws  4x +Elo
   0 Lc0-0.27+_J104.1-30       -56  17   300  126.0  42.0%   78.7%  
   1 Stockfish_21032717_16th    89  32   100   62.5  62.5%   75.0%    40
   2 Stockfish_21032717_4ths    49  28   100   57.0  57.0%   82.0%    18
   3 Stockfish_21032717_1thd    31  31   100   54.5  54.5%   79.0%
                                                                    Ave. 29
300 games                                               Sf 1 to 16 +Elo  58
White won 38 : Stockfish 33 - 5 Lc0_J104
Black won 26 : Stockfish 23 - 3 Lc0_J104
 
 
20x256 net                     Elo  +-  Games Points Score   Draws  4x +Elo
   0 Lc0-0.27--LS15            -35  16   300  135.0  45.0%   82.0%
   1 Stockfish_21032717_4ths *  70  32   100   60.0  60.0%   76.0%    67
   2 Stockfish_21032717_16th    31  24   100   54.5  54.5%   87.0%   -39
   3 Stockfish_21032717_1thd     3  28   100   50.5  50.5%   83.0%
                                                                    Ave. 28
300 games                                               Sf 1 to 16 +Elo  67
White won 41 : Stockfish 34 - 7 Lc0--LS15
Black won 13 : Stockfish   8 - 5 Lc0--LS15
 
 
30x384 net                    Elo  +-  Games Points Score   Draws  4x +Elo
   0 Lc0-0.27--J94-100          2  14   300  151.0  50.3%   88.0%   
   1 Stockfish_21032717_16th   24  22   100   53.5  53.5%   89.0%    17
   2 Stockfish_21032717_4ths    7  21   100   51.0  51.0%   90.0%    45
   3 Stockfish_21032717_1thd  -38  26   100   44.5  44.5%   85.0%
                                                                   Ave. 31 
300 games                                              Sf 1 to 16 +Elo  62
White won 28 : Lc0 16 - 12 Stockfish
Black won  8 : Stockfish 5 - 3 Lc0

 
   Average Stockfish 4x thread count performance gain  =  +29.3 Elo
Two data points per net: increase from 1 to 4 and 4 to 16 Sf threads.
* LS15 anomoly okay: 1 to 4 +67, 4 to 16 -39 but ave. 28 consistant with others. 

   Average Stockfish 16x thread count performance gain  =  +62.3 Elo
One data point per net, but all in a narrow range: 1 to 16 Sf threads.

   Overall 4x, 1-4 & 4-16 vs. 1-16, performance gain  =  +33.7 Elo
     
   Lc0 0.27 performance consistantly increased with net size
   even though its nps decreases substantially with larger nets.

 



Attachment: SfCscale-J94Lg.pgn - Games (701k)
Attachment: SfCscale-Lc0sm.pgn - Games (731k)
Attachment: SfCscale-LSmed.pgn - Games (728k)
  
-56 Elo vs Sf 1,4,16 ths     -35 Elo vs Sf 1,4,16 ths   +2 Elo vs Sf 1,4,16 ths
J104.1-30=10x128==benchmark  LS15===20x256===benchmark  J94-100=30x384==benchmark
Total time (ms) : 340428     Total time (ms) : 340755   Total time (ms) : 341717
Nodes searched  : 38519815   Nodes searched  : 7966967  Nodes searched  : 3064986
Nodes/second    : 113151     Nodes/second    : 23380    Nodes/second    : 8969

Stockfish_21032717_axv26 bench <hash> <threads> <plies> default depth NNUE
==== 64 1 24 =============  ==== 256 4 24 ==============  ===== 1024 16 24 ============
Total time (ms) : 140420    Total time (ms) : 70091       Total time (ms) : 52476
Nodes searched  : 257262695 Nodes searched  : 491835158   Nodes searched  : 1023787058
Nodes/second    : 1832094   Nodes/second    : 7017094     Nodes/second    : 19509624
- - By MrKris (***) Date 2021-04-05 23:43
Here is a graphical representation of my above post.
 
Parent - By user923005 (****) Date 2021-04-08 04:23 Upvotes 1
Thank you for this analysis.
It is incredibly interesting.
Up Topic The Rybka Lounge / Computer Chess / Scaling: Stockfish thread count and Lc0 net size

Powered by mwForum 2.27.4 © 1999-2012 Markus Wichitill