Sturddle 2 is a fork of my Sturddle Chess Engine (https://github.com/cristivlas/sturddle-chess-engine) with many bug fixes and a rewritten (and trained from scratch) neural network.
Building the Engine
<code>python3 tools\build.py</code> builds a native executable for the host OS. The executable bundles binary images that support AVX512, AVX2, and generic SSE2.
Clang is recommended, the GNU C++ compiler may work but it is not supported.
If built with the `NATIVE_UCI` flag, invoke `main.py` to run the UCI engine.
Without the `NATIVE_UCI` flag, run `sturddle.py` instead.
## Training the Neural Net
I have trained the neural net on a large dataset that I generated and curated over a couple of years.
To start from scratch:
1) Start with games saved as PGN (downloaded from the Internet, or from engine tournaments).
2) Generate sqlite3 database(s) of positions from PGN games, using: `tools/sqlite/mkposdb.py`.
3) Analyse positions with `tools/sqlite/analyse.py` or `tools/sqlite/analyse_parallel.py`; both
scripts require a UCI engine for analysis (such Sturddle 1.xx, Stockfish, etc.).
Alternatively:
- Download PGNs from https://database.lichess.org/ and extract
evaluations using `tools/sqlite/pgntoevals.py`, or
- Download binpack files, convert them to plain using a development version
of Stockfish, then use `tools/sqlite/plaintodb.py`, or
- Generate datasets with this engine, by compiling it with DATAGEN enabled (please refer to the source code for details).
4) Generate HDF5 file(s) from database(s) produced by any of the methods above: use `tools/nnue/toh5.py`.
5) Train the neural net by running `tools/nnue/train-v4.py` (requires Tensorflow and the CUDA toolkit).
6) Generate `weights.h` by exporting model trained in step 5:
<code>tools/nnue/train.py export -m <path-to-model> -o weights.h</code>
7) Build engine (using `tools/build.py`, or by running <code>python3 setup.py build\_ext --inplace</code>).
Alternatively models can be saved as JSON with tools/nnue/modeltojson.py. The model can then be
loaded into the engine at runtime by using the UCI command:
<code>setoption name NNUEModel value YOUR-JSON-FILE-HERE</code>.
Note that the name NNUE used here only means that the neural net is updated efficiently (i.e. in an
incremental fashion). The model is original and consists of a relatively small number of parameters (485761).
# Neural Net Architecture
Inference runs on the CPU using vectorized instructions.
The Intel, ARM v7 / ARM64 with NEON architectures are supported.
## Tuning the Engine
There are two ways to tune parameters defined in `config.h`:
- Using https://chess-tuning-tools.readthedocs.io/en/latest/
- or using the Lakas optimizer https://github.com/fsmosca/Lakas
1) Install the preferred tool and `cutechess-cli`.
2) Edit the `config.h` file, and replace `DECLARE_VALUE` with `DECLARE_PARAM` for the parameters to be tuned.
3) Build the python module, preferably with `NATIVE_UCI`:
<code>CC=clang++ CFLAGS=-march=native NATIVE_UCI=1 python3 setup.py build_ext --inplace</code>
Run `./main.py`, and enter the `uci` command. The parameters of interest should be listed in the output.
Quit the engine.
4) Run `tuneup/gentune.py` to generate a JSON configuration file for chess-tuning-tools, or
`tuneup/genlakas.py` to generate a wrapper script to invoke the Lakas optimizer.
5) Run the optimizer. Once the optimizer converges, edit the `config.h` file, and change the values
of the parameters; change `DECLARE_PARAM` back to `DECLARE_VALUE`.
Comments
Post a Comment