Since you’re here...

We hope you will consider supporting us today. We need your support to continue to exist, because good entries are more and more work time. Every reader contribution, however big or small, is so valuable. Support "Chess Engines Diary" even a small amount– and it only takes a minute. Thank you.
============================== My email: jotes@go2.pl



Chess engine: Stockfish 21051818

-

Stockfish - UCI chess engine, compiled by Tomasz Sobczyk
Rating JCER=3144

Timestamp: 1621353983
New NNUE architecture and net
Introduces a new NNUE network architecture and associated network parameters,
as obtained by a new pytorch trainer.

The network is already very strong at short TC, without regression at longer TC,
and has potential for further improvements.

https://tests.stockfishchess.org/tests/view/60a159c65085663412d0921d
TC: 10s+0.1s, 1 thread
ELO: 21.74 +-3.4 (95%) LOS: 100.0%
Total: 10000 W: 1559 L: 934 D: 7507 Elo +21.74
Ptnml(0-2): 38, 701, 2972, 1176, 113

https://tests.stockfishchess.org/tests/view/60a187005085663412d0925b
TC: 60s+0.6s, 1 thread
ELO: 5.85 +-1.7 (95%) LOS: 100.0%
Total: 20000 W: 1381 L: 1044 D: 17575 Elo +5.85
Ptnml(0-2): 27, 885, 7864, 1172, 52

https://tests.stockfishchess.org/tests/view/60a2beede229097940a03806
TC: 20s+0.2s, 8 threads
LLR: 2.93 (-2.94,2.94) <0.50,3.50>
Total: 34272 W: 1610 L: 1452 D: 31210 Elo +1.60
Ptnml(0-2): 30, 1285, 14350, 1439, 32

https://tests.stockfishchess.org/tests/view/60a2d687e229097940a03c72
TC: 60s+0.6s, 8 threads
LLR: 2.94 (-2.94,2.94) <-2.50,0.50>
Total: 45544 W: 1262 L: 1214 D: 43068 Elo +0.37
Ptnml(0-2): 12, 1129, 20442, 1177, 12

The network has been trained (by vondele) using the https://github.com/glinscott/nnue-pytorch/ trainer (started by glinscott),
specifically the branch https://github.com/Sopel97/nnue-pytorch/tree/experiment_56.
The data used are in 64 billion positions (193GB total) generated and scored with the current master net
d8: https://drive.google.com/file/d/1hOOYSDKgOOp38ZmD0N4DV82TOLHzjUiF/view?usp=sharing
d9: https://drive.google.com/file/d/1VlhnHL8f-20AXhGkILujnNXHwy9T-MQw/view?usp=sharing
d10: https://drive.google.com/file/d/1ZC5upzBYMmMj1gMYCkt6rCxQG0GnO3Kk/view?usp=sharing
fishtest_d9: https://drive.google.com/file/d/1GQHt0oNgKaHazwJFTRbXhlCN3FbUedFq/view?usp=sharing

This network also contains a few architectural changes with respect to the current master:

Size changed from 256x2-32-32-1 to 512x2-16-32-1
~15-20% slower
~2x larger
adds a special path for 16 valued ClippedReLU
fixes affine transform code for 16 inputs/outputs, buy using InputDimensions instead of PaddedInputDimensions
this is safe now because the inputs are processed in groups of 4 in the current affine transform code
The feature set changed from HalfKP to HalfKAv2
Includes information about the kings like HalfKA
Packs king features better, resulting in 8% size reduction compared to HalfKA
The board is flipped for the black's perspective, instead of rotated like in the current master
PSQT values for each feature
the feature transformer now outputs a part that is fowarded directly to the output and allows learning piece values more directly than the previous network architecture. The effect is visible for high imbalance positions, where the current master network outputs evaluations skewed towards zero.
8 PSQT values per feature, chosen based on (popcount(pos.pieces()) - 1) / 4
initialized to classical material values on the start of the training
8 subnetworks (512x2->16->32->1), chosen based on (popcount(pos.pieces()) - 1) / 4
only one subnetwork is evaluated for any position, no or marginal speed loss

A diagram of the network is available: https://user-images.githubusercontent.com/8037982/118656988-553a1700-b7eb-11eb-82ef-56a11cbebbf2.png
A more complete description: https://github.com/glinscott/nnue-pytorch/blob/master/docs/nnue.md
Bench: 3806488

Stockfish 21051818 and NNUE download

 

Comments

Post a Comment

Popular posts from this blog

New Strong Engines Test, by Chess Engines Diary, 2024.04.12

-
Image
  💾  552 (!) games from the tournament download   👍 @chessenginesdiary  Country - Poland, City -  Malbork 🕓 Time 3'+3" 💻HP Pavilion i5-1035G1 8GB RAM 🖬 GUI-Banksia All  CEDR  317.321 games download  (01.04.2024 - 3'+3")  HypnoS 030424, Yuli GM Pro 16, Stockfish 16.1 and ShashChess 35 . These four engines scored the same number of points and placed at the top of the table in this strong tournament. Tech table: Engine KN/move NPS dep/mov time/mov mov/game time/game fails Alexandria 6.1.0 3218 576429 30.2 5.6 56.7 316.2 Berserk 13 4779 841025 36.7 5.7 56.0 318.1 Brainlearn 28 2275 366977 31.4 6.2 43.5 269.4 Caissa 1.18 5492 923486 30.2 5.9 50.4 299.7 Clover 6.1.19 4803 854377 31.4 5.6 62.2 349.4 Cool Iris 12.10 2201 356730 27.6 6.2 51.2 315.5 CorChess 20240331 2253 372774 27.4 6.0 52.2 315.8 Crystal 8 3582 571994 20.3 6.3 47.7 298.8 Fire 9.3 5225 876565 22.0 6.0 55.5 331.1 Fisherov chess monk 1.2 3487 619728 36.0 5.6 60.4 340.0 Hyp
Read more

New chess opening book: M11.2 (bin and ctg)

-
Image
  We provide two opening books, in two different formats: bin and ctg. This is enough to be used in almost any chess program (GUI). Of course, every book may contain errors, but this one is based on a high rating. Happy testing! Book - CTG format Customers who wish to use the CTG format book will need a GUI capable of reading this format, ie. Chessbase GUIs.  Please save the book in your book folder. We strongly recommend that you "Optimize" the book in the Book options dialog so the tournament moves are chosen. The book is very wide even in tournament mode unlike most other books. A type of book format mainly used by chess programs from Chessbase , such as Fritz, Chess Base, Komodo, FatFritz, Houdini , etc. Book - BIN format (  Used by chess GUIs Arena, Banksia and Droidfish) Binary books have some important advantages, especially for computer chess engines: space-efficient, fast on accessing and searching, more useful information.  At the most simple form, they are just a
Read more

New version chess engine: Lc0 BT4

-
Image
LcZero - CEDR Rating=3683 vBT4: Big transformer 4. New network architecture which builds off of BT3 by adding two types of auxiliary heads, future heads and categorical value heads. The categorical value heads predict a distribution over values of q rather than a WDL outcome distribution, and the future heads predict the moves that will be played over the next two plies. The hope is that these heads will give additional information to the net to improve training speed. We've also fixed half-precision training, so this model will be larger. BT4 training started in mid-October and is expected to take a few months. It has 15 layers with 1024 embedding size, 32 heads per layer, and 1536 emb size, for roughly a doubling in size over BT3.  Individual statistics:  Lc0 0.30.0 Stockfish 16 5/13 -3 13 Games Booot 7.2 6/10 +2 10 Games Critter 1.6a 8/9 +7 9 Games Dragon 3.2 4/8 +0 8 Games Stockfish 20230729 3.5/8 -1 8 Games ShashChess 33.2 3.5/8 -1 8 Games Fisherov chess monk 1.2 3/
Read more

Dragon NNUE by Komodo Chess - it's free!

-
Image
    Dragon by Komodo Chess Larry Kaufman: We have released Dragon at komodochess.com. Dragon uses NNUE (Neural Network Updated Efficiently) technology, originally developed for the game of shogi. Komodo has a great deal of chess knowledge in its evaluation. Training an NNUE network based on this evaluation was both an advantage and a challenge, requiring experimentation with architectures and data generation of billions of positions. The reinforcement learning phase for Dragon is in its infancy, but is already showing great promise. Dragon is a huge strength improvement over 14.1, the last release, about 197 elo in MCTS mode and 189 elo in standard mode, at CCRL blitz time control on one thread based on direct matches. With four threads, the gains were 156 elo in MCTS and 170 in standard mode. The improvement is due to the embedded neural network providing much more accurate evaluation and also in some sense gaining an extra ply or so of search by “seeing” some tactics that a normal ev
Read more