Since you’re here...

We hope you will consider supporting us today. We need your support to continue to exist, because good entries are more and more work time. Every reader contribution, however big or small, is so valuable. Support "Chess Engines Diary" even a small amount– and it only takes a minute. Thank you.
============================== My email: jotes@go2.pl



Chess engine: Stockfish 22051412 NNUE for Windows and Linux (+3,86 ELO)

-


Stockfish - UCI chess engine, compiled by Tomasz Sobczyk
Rating CEDR=3497 (2 place)

Update NNUE architecture to SFNNv5. Update network to nn-3c0aa92af1da.nnue.

Architecture changes:
Duplicated activation after the 1024->15 layer with squared crelu (so 15->15*2). As proposed by vondele.

Trainer changes:
Added bias to L1 factorization, which was previously missing (no measurable improvement but at least neutral in principle)
For retraining linearly reduce lambda parameter from 1.0 at epoch 0 to 0.75 at epoch 800.
reduce max_skipping_rate from 15 to 10 (compared to vondele's outstanding PR)

Note: This network was trained with a ~0.8% error in quantization regarding the newly added activation function.
This will be fixed in the released trainer version. Expect a trainer PR tomorrow.

Note: The inference implementation cuts a corner to merge results from two activation functions.
This could possibly be resolved nicer in the future. AVX2 implementation likely not necessary, but NEON is missing.

First training session invocation:
python3 train.py \
../nnue-pytorch-training/data/nodes5000pv2_UHO.binpack \
../nnue-pytorch-training/data/nodes5000pv2_UHO.binpack \
--gpus "$3," \
--threads 4 \
--num-workers 8 \
--batch-size 16384 \
--progress_bar_refresh_rate 20 \
--random-fen-skipping 3 \
--features=HalfKAv2_hm^ \
--lambda=1.0 \
--max_epochs=400 \
--default_root_dir ../nnue-pytorch-training/experiment_$1/run_$2

Second training session invocation:
python3 train.py \
../nnue-pytorch-training/data/T60T70wIsRightFarseerT60T74T75T76.binpack \
../nnue-pytorch-training/data/T60T70wIsRightFarseerT60T74T75T76.binpack \
--gpus "$3," \
--threads 4 \
--num-workers 8 \
--batch-size 16384 \
--progress_bar_refresh_rate 20 \
--random-fen-skipping 3 \
--features=HalfKAv2_hm^ \
--start-lambda=1.0 \
--end-lambda=0.75 \
--gamma=0.995 \
--lr=4.375e-4 \
--max_epochs=800 \
--resume-from-model /data/sopel/nnue/nnue-pytorch-training/data/exp367/nn-exp367-run3-epoch399.pt \
--default_root_dir ../nnue-pytorch-training/experiment_$1/run_$2

Passed STC:
LLR: 2.95 (-2.94,2.94) <0.00,2.50>
Total: 27288 W: 7445 L: 7178 D: 12665 Elo +3.40
Ptnml(0-2): 159, 3002, 7054, 3271, 158
https://tests.stockfishchess.org/tests/view/627e8c001919125939623644

Passed LTC:
LLR: 2.95 (-2.94,2.94) <0.50,3.00>
Total: 21792 W: 5969 L: 5727 D: 10096 Elo +3.86
Ptnml(0-2): 25, 2152, 6294, 2406, 19
https://tests.stockfishchess.org/tests/view/627f2a855734b18b2e2ece47

Download:
 
Our social media:
Twitter
 Facebook
 Instagram
 Pinterest
 Reddit
 Tumblr
 VKontakte


Comments

Post a Comment

Popular posts from this blog

New Strong Engines Test, by Chess Engines Diary, 2024.04.12

-
Image
  💾  552 (!) games from the tournament download   👍 @chessenginesdiary  Country - Poland, City -  Malbork 🕓 Time 3'+3" 💻HP Pavilion i5-1035G1 8GB RAM 🖬 GUI-Banksia All  CEDR  317.321 games download  (01.04.2024 - 3'+3")  HypnoS 030424, Yuli GM Pro 16, Stockfish 16.1 and ShashChess 35 . These four engines scored the same number of points and placed at the top of the table in this strong tournament. Tech table: Engine KN/move NPS dep/mov time/mov mov/game time/game fails Alexandria 6.1.0 3218 576429 30.2 5.6 56.7 316.2 Berserk 13 4779 841025 36.7 5.7 56.0 318.1 Brainlearn 28 2275 366977 31.4 6.2 43.5 269.4 Caissa 1.18 5492 923486 30.2 5.9 50.4 299.7 Clover 6.1.19 4803 854377 31.4 5.6 62.2 349.4 Cool Iris 12.10 2201 356730 27.6 6.2 51.2 315.5 CorChess 20240331 2253 372774 27.4 6.0 52.2 315.8 Crystal 8 3582 571994 20.3 6.3 47.7 298.8 Fire 9.3 5225 876565 22.0 6.0 55.5 331.1 Fisherov chess monk 1.2 3487 619728 36.0 5.6 60.4 340.0 Hyp
Read more

New chess opening book: M11.2 (bin and ctg)

-
Image
  We provide two opening books, in two different formats: bin and ctg. This is enough to be used in almost any chess program (GUI). Of course, every book may contain errors, but this one is based on a high rating. Happy testing! Book - CTG format Customers who wish to use the CTG format book will need a GUI capable of reading this format, ie. Chessbase GUIs.  Please save the book in your book folder. We strongly recommend that you "Optimize" the book in the Book options dialog so the tournament moves are chosen. The book is very wide even in tournament mode unlike most other books. A type of book format mainly used by chess programs from Chessbase , such as Fritz, Chess Base, Komodo, FatFritz, Houdini , etc. Book - BIN format (  Used by chess GUIs Arena, Banksia and Droidfish) Binary books have some important advantages, especially for computer chess engines: space-efficient, fast on accessing and searching, more useful information.  At the most simple form, they are just a
Read more

New version chess engine: Lc0 BT4

-
Image
LcZero - CEDR Rating=3683 vBT4: Big transformer 4. New network architecture which builds off of BT3 by adding two types of auxiliary heads, future heads and categorical value heads. The categorical value heads predict a distribution over values of q rather than a WDL outcome distribution, and the future heads predict the moves that will be played over the next two plies. The hope is that these heads will give additional information to the net to improve training speed. We've also fixed half-precision training, so this model will be larger. BT4 training started in mid-October and is expected to take a few months. It has 15 layers with 1024 embedding size, 32 heads per layer, and 1536 emb size, for roughly a doubling in size over BT3.  Individual statistics:  Lc0 0.30.0 Stockfish 16 5/13 -3 13 Games Booot 7.2 6/10 +2 10 Games Critter 1.6a 8/9 +7 9 Games Dragon 3.2 4/8 +0 8 Games Stockfish 20230729 3.5/8 -1 8 Games ShashChess 33.2 3.5/8 -1 8 Games Fisherov chess monk 1.2 3/
Read more

Dragon NNUE by Komodo Chess - it's free!

-
Image
    Dragon by Komodo Chess Larry Kaufman: We have released Dragon at komodochess.com. Dragon uses NNUE (Neural Network Updated Efficiently) technology, originally developed for the game of shogi. Komodo has a great deal of chess knowledge in its evaluation. Training an NNUE network based on this evaluation was both an advantage and a challenge, requiring experimentation with architectures and data generation of billions of positions. The reinforcement learning phase for Dragon is in its infancy, but is already showing great promise. Dragon is a huge strength improvement over 14.1, the last release, about 197 elo in MCTS mode and 189 elo in standard mode, at CCRL blitz time control on one thread based on direct matches. With four threads, the gains were 156 elo in MCTS and 170 in standard mode. The improvement is due to the embedded neural network providing much more accurate evaluation and also in some sense gaining an extra ply or so of search by “seeing” some tactics that a normal ev
Read more