Stockfish 2023091120 NNUE for Windows and Linux, compiled by Linmiao Xu (Elo +1.30)

Stockfish 2023091120 - UCI chess engine, compiled by Michael Chaly
Rating CEDR=3725

Timestamp: 1695403576

Update NNUE architecture to SFNNv8: L1-2560 nn-ac1dbea57aa3.nnue

Creating this net involved:

- a 6-stage training process from scratch. The datasets used in stages 1-5 were fully minimized.

- permuting L1 weights with https://github.com/official-stockfish/nnue-pytorch/pull/254

A strong epoch after each training stage was chosen for the next. The 6 stages were:

```

1. 400 epochs, lambda 1.0, default LR and gamma

UHOx2-wIsRight-multinet-dfrc-n5000 (135G)

nodes5000pv2_UHO.binpack

data_pv-2_diff-100_nodes-5000.binpack

wrongIsRight_nodes5000pv2.binpack

multinet_pv-2_diff-100_nodes-5000.binpack

dfrc_n5000.binpack

2. 800 epochs, end-lambda 0.75, LR 4.375e-4, gamma 0.995, skip 12

LeelaFarseer-T78juntoaugT79marT80dec.binpack (141G)

T60T70wIsRightFarseerT60T74T75T76.binpack

test78-junjulaug2022-16tb7p.no-db.min.binpack

test79-mar2022-16tb7p.no-db.min.binpack

test80-dec2022-16tb7p.no-db.min.binpack

3. 800 epochs, end-lambda 0.725, LR 4.375e-4, gamma 0.995, skip 20

leela93-v1-dfrc99-v2-T78juntosepT80jan-v6dd-T78janfebT79aprT80aprmay.min.binpack

leela93-filt-v1.min.binpack

dfrc99-16tb7p-filt-v2.min.binpack

test78-juntosep2022-16tb7p-filter-v6-dd.min-mar2023.binpack

test80-jan2023-3of3-16tb7p-filter-v6-dd.min-mar2023.binpack

test78-janfeb2022-16tb7p.min.binpack

test79-apr2022-16tb7p.min.binpack

test80-apr2022-16tb7p.min.binpack

test80-may2022-16tb7p.min.binpack

4. 800 epochs, end-lambda 0.7, LR 4.375e-4, gamma 0.995, skip 24

leela96-dfrc99-v2-T78juntosepT79mayT80junsepnovjan-v6dd-T80mar23-v6-T60novdecT77decT78aprmayT79aprT80may23.min.binpack

leela96-filt-v2.min.binpack

dfrc99-16tb7p-filt-v2.min.binpack

test78-juntosep2022-16tb7p-filter-v6-dd.min-mar2023.binpack

test79-may2022-16tb7p.filter-v6-dd.min.binpack

test80-jun2022-16tb7p.filter-v6-dd.min.binpack

test80-sep2022-16tb7p.filter-v6-dd.min.binpack

test80-nov2022-16tb7p.filter-v6-dd.min.binpack

test80-jan2023-3of3-16tb7p-filter-v6-dd.min-mar2023.binpack

test80-mar2023-2tb7p.v6-sk16.min.binpack

test60-novdec2021-16tb7p.min.binpack

test77-dec2021-16tb7p.min.binpack

test78-aprmay2022-16tb7p.min.binpack

test79-apr2022-16tb7p.min.binpack

test80-may2023-2tb7p.min.binpack

5. 960 epochs, end-lambda 0.7, LR 4.375e-4, gamma 0.995, skip 28

Increased max-epoch to 960 near the end of the first 800 epochs

5af11540bbfe dataset: https://github.com/official-stockfish/Stockfish/pull/4635

6. 1000 epochs, end-lambda 0.7, LR 4.375e-4, gamma 0.995, skip 28

Increased max-epoch to 1000 near the end of the first 800 epochs

1ee1aba5ed dataset: https://github.com/official-stockfish/Stockfish/pull/4782

```

L1 weights permuted with:

```bash

python3 serialize.py $nnue $nnue_permuted \

--features=HalfKAv2_hm \

--ft_optimize \

--ft_optimize_data=/data/fishpack32.binpack \

--ft_optimize_count=10000

```

Speed measurements from 100 bench runs at depth 13 with profile-build x86-64-avx2:

```

sf_base = 1329051 +/- 2224 (95%)

sf_test = 1163344 +/- 2992 (95%)

diff = -165706 +/- 4913 (95%)

speedup = -12.46807% +/- 0.370% (95%)

```

Training data can be found at:

https://robotmoon.com/nnue-training-data/

Local elo at 25k nodes per move (vs. L1-2048 nn-1ee1aba5ed4c.nnue)

ep959 : 16.2 +/- 2.3

Failed 10+0.1 STC:

https://tests.stockfishchess.org/tests/view/6501beee2cd016da89abab21

LLR: -2.92 (-2.94,2.94) <0.00,2.00>

Total: 13184 W: 3285 L: 3535 D: 6364 Elo -6.59

Ptnml(0-2): 85, 1662, 3334, 1440, 71

Failed 180+1.8 VLTC:

https://tests.stockfishchess.org/tests/view/6505cf9a72620bc881ea908e

LLR: -2.94 (-2.94,2.94) <0.00,2.00>

Total: 64248 W: 16224 L: 16374 D: 31650 Elo -0.81

Ptnml(0-2): 26, 6788, 18640, 6650, 20

Passed 60+0.6 th 8 VLTC SMP (STC bounds):

https://tests.stockfishchess.org/tests/view/65084a4618698b74c2e541dc

LLR: 2.95 (-2.94,2.94) <0.00,2.00>

Total: 90630 W: 23372 L: 23033 D: 44225 Elo +1.30

Ptnml(0-2): 13, 8490, 27968, 8833, 11

Passed 60+0.6 th 8 VLTC SMP:

https://tests.stockfishchess.org/tests/view/6501d45d2cd016da89abacdb

LLR: 2.95 (-2.94,2.94) <0.50,2.50>

Total: 137804 W: 35764 L: 35276 D: 66764 Elo +1.23

Ptnml(0-2): 31, 13006, 42326, 13522, 17

closes https://github.com/official-stockfish/Stockfish/pull/4795

bench 1246812

Stockfish rating progress:

Engine	Rating	Score	Games	(%)
Stockfish 20230227	3732.4	92.00	134	68.66
Stockfish 241022	3724.2	64.00	112	57.14
Stockfish 031022	3720.9	110.50	158	69.94
Stockfish 070922	3718.9	123.00	164	75.00
Stockfish 20230325	3718.5	109.00	169	64.50
Stockfish 20221107	3717.8	106.50	186	57.26
Stockfish 20230308 Ivec	3717.6	79.00	120	65.83
Stockfish 301022	3717.6	112.00	175	64.00
Stockfish 20230218	3715.1	110.50	164	67.38
Stockfish 20230128	3713.1	69.00	106	65.09
Stockfish 290522 Ivec	3711.0	113.00	144	78.47
Stockfish 080622 Ivec	3709.7	94.50	133	71.05
Stockfish 161022	3709.5	147.00	240	61.25
Stockfish 20221123	3709.5	247.50	356	69.52
Stockfish dev-20230520	3708.9	106.50	174	61.21
Stockfish 20221224	3707.4	65.50	104	62.98
Stockfish dev-20230503 Ivec	3706.8	168.50	234	72.01
Stockfish 101022 Ivec	3705.6	82.50	138	59.78
Stockfish 20230308	3705.2	167.00	259	64.48
Stockfish 040722	3705.0	308.50	433	71.25
Stockfish 20230114	3704.6	295.00	410	71.95
Stockfish 20230314	3704.6	119.50	200	59.75
Stockfish 20221221	3703.6	165.00	267	61.80
Stockfish 061122 Ivec	3703.2	130.00	201	64.68
Stockfish 20230314 Ivec	3701.2	94.00	137	68.61
Stockfish dev-20230505	3700.7	97.50	172	56.69
Stockfish 20230104	3700.7	95.50	151	63.25
Stockfish 170922 Ivec	3700.2	107.50	155	69.35
Stockfish 130722	3698.9	102.50	166	61.75
Stockfish 20221120	3698.6	134.50	203	66.26
Stockfish 20230125	3698.5	136.50	201	67.91
Stockfish 110722 Ivec	3698.3	105.50	134	78.73
StockfishMZ 170522	3697.7	345.00	482	71.58
Stockfish 20230101	3697.5	74.00	119	62.18
Stockfish 070622	3697.1	279.00	462	60.39
Stockfish 060822 Ivec	3696.4	96.50	153	63.07
Stockfish 081022	3696.1	89.50	176	50.85
Stockfish dev-20230503	3692.7	78.50	110	71.36
Stockfish 15	3691.1	1038.00	1623	63.96
Stockfish 20221209	3690.4	122.50	192	63.80
Stockfish 030522	3689.6	101.50	150	67.67
Stockfish 20230329	3688.5	75.00	132	56.82
Stockfish 20230202	3687.0	86.00	128	67.19
Stockfish 20221220	3684.4	61.00	107	57.01
Stockfish 20230313	3683.6	82.50	104	79.33
Stockfish 170922	3678.1	150.00	226	66.37
StockfishMZ Iccf 240522	3637.8	100.50	150	67.00