OpenBench Testing Framework

Active : 32 Machines / 64 Threads / 2.14 MNPS
Priority 1
MenkibLeela-dag-previewcache_concurrency_refactoringdiff40.0+0.40LLR: 0.12 (-2.94, 2.94) [0.00, 3.00]
Games: 26688 W: 6407 L: 6353 D: 13928
Ptnml(0-2): 0, 2289, 8712, 2343, 0
Avoid race between ucinewgame and search stopping.
Priority 0
MenkibLeela-dag-previewtcec-season-30-swissdiff20.0+0.20LLR: 0.00 (-2.94, 2.94) [0.00, 3.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
Calibration Elo test Dev 3305 vs Base 3185
MenkibLeela-dag-previewtcec-season-30-swissdiff20.0+0.20LLR: -0.94 (-2.94, 2.94) [0.00, 3.00]
Games: 20674 W: 5388 L: 5397 D: 9889
Ptnml(0-2): 14, 2097, 6120, 2096, 10
Calibration Elo test Dev 3305 vs Base 3245
Priority -5
MenkibLeela-dag-previewtcec-tune-with-blocking-cuda *diff40.0+0.40Tuning 12 Parameters
68290/100000 Iterations
273162/400000 Games Played
Finished
MenkibLeela-dag-previewcache_concurrency_refactoringdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [-3.00, 0.00]
Games: 20062 W: 5030 L: 4915 D: 10117
Ptnml(0-2): 1, 1953, 6009, 2066, 2
Avoid race between ucinewgame and search stopping.
MenkibLeela-dag-previewtcec-season-30-swissdiff20.0+0.20LLR: 2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 53004 W: 13980 L: 13721 D: 25303
Ptnml(0-2): 24, 5216, 15767, 5467, 28
Calibration Elo test Dev 3305 vs Base 3365
MenkibLeela-dag-previewcache_concurrency_refactoringdiff8.0+0.08LLR: 0.01 (-2.94, 2.94) [-3.00, 0.00]
Games: 396 W: 107 L: 107 D: 182
Ptnml(0-2): 0, 40, 119, 38, 1
Add missing bit include
MenkibLeela-dag-previewcache_concurrency_refactoringdiff8.0+0.08LLR: 0.00 (-2.94, 2.94) [-3.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
Remove windows libhwloc build.
MenkibLeela-dag-previewcache_concurrency_refactoringdiff8.0+0.08LLR: 0.00 (-2.94, 2.94) [-3.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
Remove windows libhwloc build.
MenkibLeela-dag-previewtcec-season-30-swissdiff80.0+0.80LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 30182 W: 7763 L: 7551 D: 14868
Ptnml(0-2): 7, 2918, 9026, 3136, 4
Calibration Elo test Dev 3320 vs Base 3260
MenkibLeela-dag-previewtcec-season-30-swissdiff80.0+0.80LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 36670 W: 9487 L: 9265 D: 17918
Ptnml(0-2): 7, 3479, 11144, 3695, 10
Calibration Elo test Dev 3320 vs Base 3380
MenkibLeela-dag-previewtcec-season-30-swissdiff40.0+0.40LLR: 0.39 (-2.94, 2.94) [0.00, 3.00]
Games: 67962 W: 17730 L: 17577 D: 32655
Ptnml(0-2): 22, 6803, 20170, 6972, 14
Calibration Elo test Dev 3320 vs Base 3290
MenkibLeela-dag-previewtcec-season-30-swissdiff40.0+0.40LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 17374 W: 4594 L: 4407 D: 8373
Ptnml(0-2): 3, 1648, 5199, 1833, 4
Calibration Elo test Dev 3320 vs Base 3350
MenkibLeela-dag-previewno-task-workersdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [-3.00, 0.00]
Games: 29400 W: 7375 L: 7275 D: 14750
Ptnml(0-2): 24, 3018, 8513, 3124, 21
Optimize new tasks when task workers are disabled
MenkibLeela-dag-previewfix-bound-update-thread-reorderingdiff8.0+0.08LLR: -0.70 (-2.94, 2.94) [0.00, 3.00]
Games: 72176 W: 18155 L: 18048 D: 35973
Ptnml(0-2): 63, 7473, 20898, 7602, 52
Increase error tolerances for value calculation. NOTE: This should have been regression test because changes are CPU optimization. BT4 is GPU bound. It has already enough games to pass a regression test.
MenkibLeela-dag-previewfix-bound-update-thread-reorderingdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [-3.00, 0.00]
Games: 53846 W: 13418 L: 13369 D: 27059
Ptnml(0-2): 7, 5294, 16274, 5339, 9
Increase error tolerances for value calculation
MenkibLeela-dag-previewpath-repetition-informationdiff8.0+0.08LLR: 0.78 (-2.94, 2.94) [-3.00, 0.00]
Games: 104844 W: 26018 L: 26180 D: 52646
Ptnml(0-2): 9, 10493, 31581, 10329, 10
Add path dependant draw evaluations to repetitions
MenkibLeela-dag-previewfix-bound-update-thread-reorderingdiff8.0+0.08LLR: -2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 17994 W: 4417 L: 4535 D: 9042
Ptnml(0-2): 2, 1834, 5442, 1718, 1
Increase error tolerances for value calculation
MenkibLeela-dag-previewfetch-nn-results-taskdiff8.0+0.08LLR: 0.00 (-2.94, 2.94) [-3.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
Add tasks to fetch network results
MenkibLeela-dag-previewuci-output-taskdiff8.0+0.08LLR: 0.00 (-2.94, 2.94) [-3.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
Add a reset computation task
MenkibLeela-dag-previewfix-bound-update-thread-reordering-transposition-includeddiff8.0+0.08LLR: -1.71 (-2.94, 2.94) [-3.00, 0.00]
Games: 32588 W: 7985 L: 8136 D: 16467
Ptnml(0-2): 3, 3298, 9845, 3143, 5
Increase error tolerances for value calculation
MenkibLeela-dag-previewtcec-season-30-task-workersdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 59990 W: 14852 L: 14815 D: 30323
Ptnml(0-2): 8, 5896, 18150, 5933, 8
Add missing fields to node to process debug output
MenkibLeela-dag-previewfix-bound-update-thread-reordering-pathless-repetitiondiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 14128 W: 3585 L: 3407 D: 7136
Ptnml(0-2): 0, 1292, 4305, 1464, 3
Increase error tolerances for value calculation
MenkibLeela-dag-previewtcec-season-30-tt-owns-low-nodediff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 40750 W: 10248 L: 10174 D: 20328
Ptnml(0-2): 9, 4021, 12237, 4103, 5
Store shared pointer directly in cache
MenkibLeela-dag-previewpath-repetition-information-transposition-includeddiff8.0+0.08LLR: -2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 18714 W: 4665 L: 4781 D: 9268
Ptnml(0-2): 3, 1882, 5702, 1768, 2
Add path dependant draw evaluations to repetitions
MenkibLeela-dag-previewtcec-season-30-repetition-updatediff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 14970 W: 3775 L: 3651 D: 7544
Ptnml(0-2): 4, 1426, 4501, 1550, 4
Trace scope contested spin mutex and variable spin limit.
MenkibLeela-dag-previewtcec-season-30-solid-edgesdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 29888 W: 7463 L: 7372 D: 15053
Ptnml(0-2): 3, 2677, 9492, 2770, 2
Avoid losing tree in single child release
JohnspLeela-dag-previewt3d-kd2-03477500diffN=300Elo: -72.07 +- 5.44 (95%) [N=4000]
Games: 4000 W: 644 L: 1462 D: 1894
Ptnml(0-2): 41, 916, 866, 174, 3
Test T3d-KD2 to BT4-tf13tune at fixed 300 node count
MenkibLeela-dag-previewtcec-season-30-task-workersdiff8.0+0.08LLR: -0.15 (-2.94, 2.94) [0.00, 3.00]
Games: 36 W: 2 L: 19 D: 15
Ptnml(0-2): 2, 13, 3, 0, 0
Add uci output task.