OpenBench Testing Framework

Active : 32 Machines / 64 Threads / 0.72 MNPS
Priority 0
MenkibLeela-dag-previewtcec-season-30-swissdiff80.0+0.80LLR: -0.14 (-2.94, 2.94) [0.00, 3.00]
Games: 1900 W: 464 L: 468 D: 968
Ptnml(0-2): 2, 203, 543, 201, 1
Calibration Elo test Dev 3320 vs Base 3260
Priority -5
MenkibLeela-dag-previewtcec-tune-with-blocking-cuda *diff40.0+0.40Tuning 12 Parameters
68290/100000 Iterations
273162/400000 Games Played
Finished
MenkibLeela-dag-previewtcec-season-30-swissdiff80.0+0.80LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 36670 W: 9487 L: 9265 D: 17918
Ptnml(0-2): 7, 3479, 11144, 3695, 10
Calibration Elo test Dev 3320 vs Base 3380
MenkibLeela-dag-previewtcec-season-30-swissdiff40.0+0.40LLR: 0.39 (-2.94, 2.94) [0.00, 3.00]
Games: 67962 W: 17730 L: 17577 D: 32655
Ptnml(0-2): 22, 6803, 20170, 6972, 14
Calibration Elo test Dev 3320 vs Base 3290
MenkibLeela-dag-previewtcec-season-30-swissdiff40.0+0.40LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 17374 W: 4594 L: 4407 D: 8373
Ptnml(0-2): 3, 1648, 5199, 1833, 4
Calibration Elo test Dev 3320 vs Base 3350
MenkibLeela-dag-previewno-task-workersdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [-3.00, 0.00]
Games: 29400 W: 7375 L: 7275 D: 14750
Ptnml(0-2): 24, 3018, 8513, 3124, 21
Optimize new tasks when task workers are disabled
MenkibLeela-dag-previewfix-bound-update-thread-reorderingdiff8.0+0.08LLR: -0.70 (-2.94, 2.94) [0.00, 3.00]
Games: 72176 W: 18155 L: 18048 D: 35973
Ptnml(0-2): 63, 7473, 20898, 7602, 52
Increase error tolerances for value calculation. NOTE: This should have been regression test because changes are CPU optimization. BT4 is GPU bound. It has already enough games to pass a regression test.
MenkibLeela-dag-previewfix-bound-update-thread-reorderingdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [-3.00, 0.00]
Games: 53846 W: 13418 L: 13369 D: 27059
Ptnml(0-2): 7, 5294, 16274, 5339, 9
Increase error tolerances for value calculation
MenkibLeela-dag-previewpath-repetition-informationdiff8.0+0.08LLR: 0.78 (-2.94, 2.94) [-3.00, 0.00]
Games: 104844 W: 26018 L: 26180 D: 52646
Ptnml(0-2): 9, 10493, 31581, 10329, 10
Add path dependant draw evaluations to repetitions
MenkibLeela-dag-previewfix-bound-update-thread-reorderingdiff8.0+0.08LLR: -2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 17994 W: 4417 L: 4535 D: 9042
Ptnml(0-2): 2, 1834, 5442, 1718, 1
Increase error tolerances for value calculation
MenkibLeela-dag-previewfetch-nn-results-taskdiff8.0+0.08LLR: 0.00 (-2.94, 2.94) [-3.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
Add tasks to fetch network results
MenkibLeela-dag-previewuci-output-taskdiff8.0+0.08LLR: 0.00 (-2.94, 2.94) [-3.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
Add a reset computation task
MenkibLeela-dag-previewfix-bound-update-thread-reordering-transposition-includeddiff8.0+0.08LLR: -1.71 (-2.94, 2.94) [-3.00, 0.00]
Games: 32588 W: 7985 L: 8136 D: 16467
Ptnml(0-2): 3, 3298, 9845, 3143, 5
Increase error tolerances for value calculation
MenkibLeela-dag-previewtcec-season-30-task-workersdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 59990 W: 14852 L: 14815 D: 30323
Ptnml(0-2): 8, 5896, 18150, 5933, 8
Add missing fields to node to process debug output
MenkibLeela-dag-previewfix-bound-update-thread-reordering-pathless-repetitiondiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 14128 W: 3585 L: 3407 D: 7136
Ptnml(0-2): 0, 1292, 4305, 1464, 3
Increase error tolerances for value calculation
MenkibLeela-dag-previewtcec-season-30-tt-owns-low-nodediff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 40750 W: 10248 L: 10174 D: 20328
Ptnml(0-2): 9, 4021, 12237, 4103, 5
Store shared pointer directly in cache
MenkibLeela-dag-previewpath-repetition-information-transposition-includeddiff8.0+0.08LLR: -2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 18714 W: 4665 L: 4781 D: 9268
Ptnml(0-2): 3, 1882, 5702, 1768, 2
Add path dependant draw evaluations to repetitions
MenkibLeela-dag-previewtcec-season-30-repetition-updatediff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 14970 W: 3775 L: 3651 D: 7544
Ptnml(0-2): 4, 1426, 4501, 1550, 4
Trace scope contested spin mutex and variable spin limit.
MenkibLeela-dag-previewtcec-season-30-solid-edgesdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 29888 W: 7463 L: 7372 D: 15053
Ptnml(0-2): 3, 2677, 9492, 2770, 2
Avoid losing tree in single child release
JohnspLeela-dag-previewt3d-kd2-03477500diffN=300Elo: -72.07 +- 5.44 (95%) [N=4000]
Games: 4000 W: 644 L: 1462 D: 1894
Ptnml(0-2): 41, 916, 866, 174, 3
Test T3d-KD2 to BT4-tf13tune at fixed 300 node count
MenkibLeela-dag-previewtcec-season-30-task-workersdiff8.0+0.08LLR: -0.15 (-2.94, 2.94) [0.00, 3.00]
Games: 36 W: 2 L: 19 D: 15
Ptnml(0-2): 2, 13, 3, 0, 0
Add uci output task.
MenkibLeela-dag-previewtcec-season-30-solid-edgesdiff8.0+0.08LLR: -1.17 (-2.94, 2.94) [-3.00, 0.00]
Games: 9304 W: 2254 L: 2331 D: 4719
Ptnml(0-2): 0, 936, 2859, 855, 2
Limit maximum allocation size of MakeSolidQueue.
KovaxLeela-dag-previewpolicy-blend-gpudiff10.0+0.10Elo: 20.21 +- 3.07 (95%) [N=10000]
Games: 10000 W: 2542 L: 1961 D: 5497
Ptnml(0-2): 1, 745, 2929, 1322, 3
no early stopping
KovaxLeela-dag-previewpolicy-blend-gpudiff10.0+0.10Tuning 3 Parameters
2500/2500 Iterations
40000/40000 Games Played
optimism blend tune, uci overwrites backendopts
MenkibLeela-dag-previewtcec-season-30-solid-edgesdiff8.0+0.08LLR: -0.46 (-2.94, 2.94) [-3.00, 0.00]
Games: 7784 W: 1885 L: 1923 D: 3976
Ptnml(0-2): 0, 773, 2384, 735, 0
Fix msvc build using aligned_malloc
KovaxLeela-dag-previewpolicy-blend-gpudiff10.0+0.10LLR: 2.94 (-2.94, 2.94) [0.00, 3.00]
Games: 2082 W: 568 L: 408 D: 1106
Ptnml(0-2): 0, 137, 609, 293, 2
testing policy blending on gpu with the params of cpu blending
MenkibLeela-dag-previewtcec-season-30-solid-edgesdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 1234 W: 409 L: 225 D: 600
Ptnml(0-2): 0, 48, 337, 232, 0
Use waitable atomic for task worker state