Stockfish 2023091120 NNUE for Windows and Linux, compiled by Linmiao Xu (Elo +1.30)
Rating CEDR=3725
Timestamp: 1695403576
Update NNUE architecture to SFNNv8: L1-2560 nn-ac1dbea57aa3.nnue
Creating this net involved:
- a 6-stage training process from scratch. The datasets used in stages 1-5 were fully minimized.
- permuting L1 weights with https://github.com/official-stockfish/nnue-pytorch/pull/254
A strong epoch after each training stage was chosen for the next. The 6 stages were:
```
1. 400 epochs, lambda 1.0, default LR and gamma
UHOx2-wIsRight-multinet-dfrc-n5000 (135G)
nodes5000pv2_UHO.binpack
data_pv-2_diff-100_nodes-5000.binpack
wrongIsRight_nodes5000pv2.binpack
multinet_pv-2_diff-100_nodes-5000.binpack
dfrc_n5000.binpack
2. 800 epochs, end-lambda 0.75, LR 4.375e-4, gamma 0.995, skip 12
LeelaFarseer-T78juntoaugT79marT80dec.binpack (141G)
T60T70wIsRightFarseerT60T74T75T76.binpack
test78-junjulaug2022-16tb7p.no-db.min.binpack
test79-mar2022-16tb7p.no-db.min.binpack
test80-dec2022-16tb7p.no-db.min.binpack
3. 800 epochs, end-lambda 0.725, LR 4.375e-4, gamma 0.995, skip 20
leela93-v1-dfrc99-v2-T78juntosepT80jan-v6dd-T78janfebT79aprT80aprmay.min.binpack
leela93-filt-v1.min.binpack
dfrc99-16tb7p-filt-v2.min.binpack
test78-juntosep2022-16tb7p-filter-v6-dd.min-mar2023.binpack
test80-jan2023-3of3-16tb7p-filter-v6-dd.min-mar2023.binpack
test78-janfeb2022-16tb7p.min.binpack
test79-apr2022-16tb7p.min.binpack
test80-apr2022-16tb7p.min.binpack
test80-may2022-16tb7p.min.binpack
4. 800 epochs, end-lambda 0.7, LR 4.375e-4, gamma 0.995, skip 24
leela96-dfrc99-v2-T78juntosepT79mayT80junsepnovjan-v6dd-T80mar23-v6-T60novdecT77decT78aprmayT79aprT80may23.min.binpack
leela96-filt-v2.min.binpack
dfrc99-16tb7p-filt-v2.min.binpack
test78-juntosep2022-16tb7p-filter-v6-dd.min-mar2023.binpack
test79-may2022-16tb7p.filter-v6-dd.min.binpack
test80-jun2022-16tb7p.filter-v6-dd.min.binpack
test80-sep2022-16tb7p.filter-v6-dd.min.binpack
test80-nov2022-16tb7p.filter-v6-dd.min.binpack
test80-jan2023-3of3-16tb7p-filter-v6-dd.min-mar2023.binpack
test80-mar2023-2tb7p.v6-sk16.min.binpack
test60-novdec2021-16tb7p.min.binpack
test77-dec2021-16tb7p.min.binpack
test78-aprmay2022-16tb7p.min.binpack
test79-apr2022-16tb7p.min.binpack
test80-may2023-2tb7p.min.binpack
5. 960 epochs, end-lambda 0.7, LR 4.375e-4, gamma 0.995, skip 28
Increased max-epoch to 960 near the end of the first 800 epochs
5af11540bbfe dataset: https://github.com/official-stockfish/Stockfish/pull/4635
6. 1000 epochs, end-lambda 0.7, LR 4.375e-4, gamma 0.995, skip 28
Increased max-epoch to 1000 near the end of the first 800 epochs
1ee1aba5ed dataset: https://github.com/official-stockfish/Stockfish/pull/4782
```
L1 weights permuted with:
```bash
python3 serialize.py $nnue $nnue_permuted \
--features=HalfKAv2_hm \
--ft_optimize \
--ft_optimize_data=/data/fishpack32.binpack \
--ft_optimize_count=10000
```
Speed measurements from 100 bench runs at depth 13 with profile-build x86-64-avx2:
```
sf_base = 1329051 +/- 2224 (95%)
sf_test = 1163344 +/- 2992 (95%)
diff = -165706 +/- 4913 (95%)
speedup = -12.46807% +/- 0.370% (95%)
```
Training data can be found at:
https://robotmoon.com/nnue-training-data/
Local elo at 25k nodes per move (vs. L1-2048 nn-1ee1aba5ed4c.nnue)
ep959 : 16.2 +/- 2.3
Failed 10+0.1 STC:
https://tests.stockfishchess.org/tests/view/6501beee2cd016da89abab21
LLR: -2.92 (-2.94,2.94) <0.00,2.00>
Total: 13184 W: 3285 L: 3535 D: 6364 Elo -6.59
Ptnml(0-2): 85, 1662, 3334, 1440, 71
Failed 180+1.8 VLTC:
https://tests.stockfishchess.org/tests/view/6505cf9a72620bc881ea908e
LLR: -2.94 (-2.94,2.94) <0.00,2.00>
Total: 64248 W: 16224 L: 16374 D: 31650 Elo -0.81
Ptnml(0-2): 26, 6788, 18640, 6650, 20
Passed 60+0.6 th 8 VLTC SMP (STC bounds):
https://tests.stockfishchess.org/tests/view/65084a4618698b74c2e541dc
LLR: 2.95 (-2.94,2.94) <0.00,2.00>
Total: 90630 W: 23372 L: 23033 D: 44225 Elo +1.30
Ptnml(0-2): 13, 8490, 27968, 8833, 11
Passed 60+0.6 th 8 VLTC SMP:
https://tests.stockfishchess.org/tests/view/6501d45d2cd016da89abacdb
LLR: 2.95 (-2.94,2.94) <0.50,2.50>
Total: 137804 W: 35764 L: 35276 D: 66764 Elo +1.23
Ptnml(0-2): 31, 13006, 42326, 13522, 17
closes https://github.com/official-stockfish/Stockfish/pull/4795
bench 1246812
Stockfish rating progress:
Engine | Rating | Score | Games | (%) |
Stockfish 20230227 | 3732.4 | 92.00 | 134 | 68.66 |
Stockfish 241022 | 3724.2 | 64.00 | 112 | 57.14 |
Stockfish 031022 | 3720.9 | 110.50 | 158 | 69.94 |
Stockfish 070922 | 3718.9 | 123.00 | 164 | 75.00 |
Stockfish 20230325 | 3718.5 | 109.00 | 169 | 64.50 |
Stockfish 20221107 | 3717.8 | 106.50 | 186 | 57.26 |
Stockfish 20230308 Ivec | 3717.6 | 79.00 | 120 | 65.83 |
Stockfish 301022 | 3717.6 | 112.00 | 175 | 64.00 |
Stockfish 20230218 | 3715.1 | 110.50 | 164 | 67.38 |
Stockfish 20230128 | 3713.1 | 69.00 | 106 | 65.09 |
Stockfish 290522 Ivec | 3711.0 | 113.00 | 144 | 78.47 |
Stockfish 080622 Ivec | 3709.7 | 94.50 | 133 | 71.05 |
Stockfish 161022 | 3709.5 | 147.00 | 240 | 61.25 |
Stockfish 20221123 | 3709.5 | 247.50 | 356 | 69.52 |
Stockfish dev-20230520 | 3708.9 | 106.50 | 174 | 61.21 |
Stockfish 20221224 | 3707.4 | 65.50 | 104 | 62.98 |
Stockfish dev-20230503 Ivec | 3706.8 | 168.50 | 234 | 72.01 |
Stockfish 101022 Ivec | 3705.6 | 82.50 | 138 | 59.78 |
Stockfish 20230308 | 3705.2 | 167.00 | 259 | 64.48 |
Stockfish 040722 | 3705.0 | 308.50 | 433 | 71.25 |
Stockfish 20230114 | 3704.6 | 295.00 | 410 | 71.95 |
Stockfish 20230314 | 3704.6 | 119.50 | 200 | 59.75 |
Stockfish 20221221 | 3703.6 | 165.00 | 267 | 61.80 |
Stockfish 061122 Ivec | 3703.2 | 130.00 | 201 | 64.68 |
Stockfish 20230314 Ivec | 3701.2 | 94.00 | 137 | 68.61 |
Stockfish dev-20230505 | 3700.7 | 97.50 | 172 | 56.69 |
Stockfish 20230104 | 3700.7 | 95.50 | 151 | 63.25 |
Stockfish 170922 Ivec | 3700.2 | 107.50 | 155 | 69.35 |
Stockfish 130722 | 3698.9 | 102.50 | 166 | 61.75 |
Stockfish 20221120 | 3698.6 | 134.50 | 203 | 66.26 |
Stockfish 20230125 | 3698.5 | 136.50 | 201 | 67.91 |
Stockfish 110722 Ivec | 3698.3 | 105.50 | 134 | 78.73 |
StockfishMZ 170522 | 3697.7 | 345.00 | 482 | 71.58 |
Stockfish 20230101 | 3697.5 | 74.00 | 119 | 62.18 |
Stockfish 070622 | 3697.1 | 279.00 | 462 | 60.39 |
Stockfish 060822 Ivec | 3696.4 | 96.50 | 153 | 63.07 |
Stockfish 081022 | 3696.1 | 89.50 | 176 | 50.85 |
Stockfish dev-20230503 | 3692.7 | 78.50 | 110 | 71.36 |
Stockfish 15 | 3691.1 | 1038.00 | 1623 | 63.96 |
Stockfish 20221209 | 3690.4 | 122.50 | 192 | 63.80 |
Stockfish 030522 | 3689.6 | 101.50 | 150 | 67.67 |
Stockfish 20230329 | 3688.5 | 75.00 | 132 | 56.82 |
Stockfish 20230202 | 3687.0 | 86.00 | 128 | 67.19 |
Stockfish 20221220 | 3684.4 | 61.00 | 107 | 57.01 |
Stockfish 20230313 | 3683.6 | 82.50 | 104 | 79.33 |
Stockfish 170922 | 3678.1 | 150.00 | 226 | 66.37 |
StockfishMZ Iccf 240522 | 3637.8 | 100.50 | 150 | 67.00 |
Download:
Comments
Post a Comment