OpenBench Testing Framework

Active : 0 Machines / 0 Threads / 0 MNPS
Priority 0
MenkibLeela-dag-previewtcec-season-30-swissdiff80.0+0.80LLR: -0.05 (-2.94, 2.94) [0.00, 3.00]
Games: 2202 W: 547 L: 545 D: 1110
Ptnml(0-2): 2, 235, 624, 239, 1
Calibration Elo test Dev 3320 vs Base 3260
Priority -5
MenkibLeela-dag-previewtcec-tune-with-blocking-cuda *diff40.0+0.40Tuning 12 Parameters
68290/100000 Iterations
273162/400000 Games Played
Finished
MenkibLeela-dag-previewtcec-season-30-swissdiff80.0+0.80LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 36670 W: 9487 L: 9265 D: 17918
Ptnml(0-2): 7, 3479, 11144, 3695, 10
Calibration Elo test Dev 3320 vs Base 3380
MenkibLeela-dag-previewtcec-season-30-swissdiff40.0+0.40LLR: 0.39 (-2.94, 2.94) [0.00, 3.00]
Games: 67962 W: 17730 L: 17577 D: 32655
Ptnml(0-2): 22, 6803, 20170, 6972, 14
Calibration Elo test Dev 3320 vs Base 3290
MenkibLeela-dag-previewtcec-season-30-swissdiff40.0+0.40LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 17374 W: 4594 L: 4407 D: 8373
Ptnml(0-2): 3, 1648, 5199, 1833, 4
Calibration Elo test Dev 3320 vs Base 3350
MenkibLeela-dag-previewno-task-workersdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [-3.00, 0.00]
Games: 29400 W: 7375 L: 7275 D: 14750
Ptnml(0-2): 24, 3018, 8513, 3124, 21
Optimize new tasks when task workers are disabled
MenkibLeela-dag-previewfix-bound-update-thread-reorderingdiff8.0+0.08LLR: -0.70 (-2.94, 2.94) [0.00, 3.00]
Games: 72176 W: 18155 L: 18048 D: 35973
Ptnml(0-2): 63, 7473, 20898, 7602, 52
Increase error tolerances for value calculation. NOTE: This should have been regression test because changes are CPU optimization. BT4 is GPU bound. It has already enough games to pass a regression test.
MenkibLeela-dag-previewfix-bound-update-thread-reorderingdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [-3.00, 0.00]
Games: 53846 W: 13418 L: 13369 D: 27059
Ptnml(0-2): 7, 5294, 16274, 5339, 9
Increase error tolerances for value calculation
MenkibLeela-dag-previewpath-repetition-informationdiff8.0+0.08LLR: 0.78 (-2.94, 2.94) [-3.00, 0.00]
Games: 104844 W: 26018 L: 26180 D: 52646
Ptnml(0-2): 9, 10493, 31581, 10329, 10
Add path dependant draw evaluations to repetitions
MenkibLeela-dag-previewfix-bound-update-thread-reorderingdiff8.0+0.08LLR: -2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 17994 W: 4417 L: 4535 D: 9042
Ptnml(0-2): 2, 1834, 5442, 1718, 1
Increase error tolerances for value calculation
MenkibLeela-dag-previewfetch-nn-results-taskdiff8.0+0.08LLR: 0.00 (-2.94, 2.94) [-3.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
Add tasks to fetch network results
MenkibLeela-dag-previewuci-output-taskdiff8.0+0.08LLR: 0.00 (-2.94, 2.94) [-3.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
Add a reset computation task
MenkibLeela-dag-previewfix-bound-update-thread-reordering-transposition-includeddiff8.0+0.08LLR: -1.71 (-2.94, 2.94) [-3.00, 0.00]
Games: 32588 W: 7985 L: 8136 D: 16467
Ptnml(0-2): 3, 3298, 9845, 3143, 5
Increase error tolerances for value calculation
MenkibLeela-dag-previewtcec-season-30-task-workersdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 59990 W: 14852 L: 14815 D: 30323
Ptnml(0-2): 8, 5896, 18150, 5933, 8
Add missing fields to node to process debug output
MenkibLeela-dag-previewfix-bound-update-thread-reordering-pathless-repetitiondiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 14128 W: 3585 L: 3407 D: 7136
Ptnml(0-2): 0, 1292, 4305, 1464, 3
Increase error tolerances for value calculation
MenkibLeela-dag-previewtcec-season-30-tt-owns-low-nodediff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 40750 W: 10248 L: 10174 D: 20328
Ptnml(0-2): 9, 4021, 12237, 4103, 5
Store shared pointer directly in cache
MenkibLeela-dag-previewpath-repetition-information-transposition-includeddiff8.0+0.08LLR: -2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 18714 W: 4665 L: 4781 D: 9268
Ptnml(0-2): 3, 1882, 5702, 1768, 2
Add path dependant draw evaluations to repetitions
MenkibLeela-dag-previewtcec-season-30-repetition-updatediff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 14970 W: 3775 L: 3651 D: 7544
Ptnml(0-2): 4, 1426, 4501, 1550, 4
Trace scope contested spin mutex and variable spin limit.
MenkibLeela-dag-previewtcec-season-30-solid-edgesdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 29888 W: 7463 L: 7372 D: 15053
Ptnml(0-2): 3, 2677, 9492, 2770, 2
Avoid losing tree in single child release
MenkibLeela-dag-previewtcec-season-30-task-workersdiff8.0+0.08LLR: -0.15 (-2.94, 2.94) [0.00, 3.00]
Games: 36 W: 2 L: 19 D: 15
Ptnml(0-2): 2, 13, 3, 0, 0
Add uci output task.
MenkibLeela-dag-previewtcec-season-30-solid-edgesdiff8.0+0.08LLR: -1.17 (-2.94, 2.94) [-3.00, 0.00]
Games: 9304 W: 2254 L: 2331 D: 4719
Ptnml(0-2): 0, 936, 2859, 855, 2
Limit maximum allocation size of MakeSolidQueue.
MenkibLeela-dag-previewtcec-season-30-solid-edgesdiff8.0+0.08LLR: -0.46 (-2.94, 2.94) [-3.00, 0.00]
Games: 7784 W: 1885 L: 1923 D: 3976
Ptnml(0-2): 0, 773, 2384, 735, 0
Fix msvc build using aligned_malloc
MenkibLeela-dag-previewtcec-season-30-solid-edgesdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 1234 W: 409 L: 225 D: 600
Ptnml(0-2): 0, 48, 337, 232, 0
Use waitable atomic for task worker state
MenkibLeela-dag-previewtcec-season-30-swissdiff1800.0+3.00LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 23838 W: 5924 L: 5745 D: 12169
Ptnml(0-2): 0, 1846, 8049, 2023, 1
Calibration Elo test for LCZeroCPU on TCEC. (100 Elo)
MenkibLeela-dag-previewtcec-season-30-swissdiff1800.0+3.00LLR: -2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 5404 W: 1275 L: 1406 D: 2723
Ptnml(0-2): 1, 519, 1792, 390, 0
Calibration Elo test for LCZeroCPU on TCEC. (200 Elo)
MenkibLeela-dag-previewt3d-kd2-03007500.pb.gzdiff180.0+0.30LLR: 2.94 (-2.94, 2.94) [0.00, 3.00]
Games: 2076 W: 605 L: 444 D: 1027
Ptnml(0-2): 0, 139, 600, 298, 1
t3d vs BT4
MenkibLeela-dag-previewt3d-kd2-03007500.pb.gz *diff180.0+0.30LLR: 2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 2184 W: 666 L: 487 D: 1031
Ptnml(0-2): 10, 137, 610, 334, 1
t3d vs BT4