OpenBench Testing Framework

Finished
CremagLeela-lc5lc5-ob-r1-t1diff8.0+0.08LLR: 0.13 (-2.94, 2.94) [0.00, 3.00]
Games: 1008 W: 250 L: 241 D: 517
Ptnml(0-2): 0, 102, 291, 111, 0
lc5: smooth time manager with tree reuse, piggybank crisis budget, and t=0ms blended nps (R1-T1)
CremagLeela-lc5lc5-ob-r3-session-cleandiff8.0+0.08LLR: -0.72 (-2.94, 2.94) [0.00, 3.00]
Games: 408 W: 89 L: 124 D: 195
Ptnml(0-2): 0, 55, 129, 20, 0
lc5: add bounded minibatch floor to VisitLimiter active visit limit
CremagLeela-lc5lc5-ob-r1-p1diff8.0+0.08LLR: -0.28 (-2.94, 2.94) [0.00, 3.00]
Games: 408 W: 92 L: 106 D: 210
Ptnml(0-2): 0, 50, 118, 36, 0
lc5: default to puct-dag with HistoryKeyLength=1 and race/2-fold guards
CremagLeela-lc5lc5-ob-p3a-p5diff8.0+0.08LLR: -0.17 (-2.94, 2.94) [0.00, 3.00]
Games: 472 W: 122 L: 130 D: 220
Ptnml(0-2): 1, 49, 143, 43, 0
lc5 P3a+P5: root smart pruning + monotonic bounds & proven-loss skip vs 7df34ca3
CremagLeela-lc5lc5-7df34ca3diff8.0+0.08LLR: 0.44 (-2.94, 2.94) [0.00, 3.00]
Games: 722 W: 201 L: 177 D: 344
Ptnml(0-2): 0, 58, 222, 80, 1
lc5: 7df34ca3 vs 6f98444d
CremagLeela-lc5[Leela] lc5-7df34ca3diff8.0+0.08Elo: -24.36 +- 14.74 (95%) [N=500]
Games: 500 W: 102 L: 137 D: 261
Ptnml(0-2): 1, 74, 134, 41, 0
lc5 vs classic at 7df34ca3 (500 games)
CremagLeela-lc5lc5_tournament_trivial_batchdiff8.0+0.08LLR: -0.22 (-2.94, 2.94) [0.00, 3.00]
Games: 1000 W: 246 L: 256 D: 498
Ptnml(0-2): 1, 116, 276, 106, 1
lc5: T2 log-logistic time mgr + batch pipeline vs prev lc5 (6f98444d)
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [-3.00, 0.00]
Games: 23852 W: 6052 L: 5944 D: 11856
Ptnml(0-2): 16, 2308, 7170, 2416, 16
lc5: GameGraph edge cleanup, drop TwoFoldDraws, and poll info changes in controller vs e01293f2
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 20400 W: 5112 L: 4999 D: 10289
Ptnml(0-2): 10, 1931, 6209, 2036, 14
lc5: back up owner before resuming waiters and drop P::Reselect (plus Node rename/API cleanup) vs 61be7b27
CremagLeela-lc5[Leela] lc5-implementationdiff8.0+0.08Elo: -32.05 +- 14.90 (95%) [N=500]
Games: 500 W: 104 L: 150 D: 246
Ptnml(0-2): 0, 85, 126, 39, 0
lc5 vs classic (500 games)
CremagLeela-lc5[Leela-dag-preview] lc5-implementationdiff8.0+0.08Elo: -36.97 +- 14.84 (95%) [N=500]
Games: 500 W: 91 L: 144 D: 265
Ptnml(0-2): 0, 89, 125, 36, 0
lc5 vs dag-preview (500 games)
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 0.00 (-2.94, 2.94) [-3.00, 0.00]
Games: 0 W: 0 L: 0 D: 0
Ptnml(0-2): 0, 0, 0, 0, 0
lc5: back up owner before resuming waiters and drop P::Reselect (plus Node rename/API cleanup) vs 61be7b27
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [-3.00, 0.00]
Games: 36160 W: 9018 L: 8934 D: 18208
Ptnml(0-2): 15, 3561, 10847, 3639, 18
lc5: compact NodeState, MaterializationTable-only in-flight, and VisitValue/NodeEval renames vs d082de37
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 18666 W: 4707 L: 4590 D: 9369
Ptnml(0-2): 9, 1776, 5644, 1897, 7
lc5: VisitWorker cleanup, inline helpers, and replace leaf_counted/kBackupAbove vs 145be6d9
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 1.64 (-2.94, 2.94) [-3.00, 0.00]
Games: 13258 W: 3357 L: 3298 D: 6603
Ptnml(0-2): 5, 1270, 4022, 1325, 7
lc5: VisitLimiter/MaterializationTable/VisitWorker/Evaluator cleanup and ensure root is expanded before stopping vs 08c99639
CremagLeela-lc5[Leela] lc5-implementationdiff8.0+0.08Elo: -13.90 +- 13.76 (95%) [N=500]
Games: 500 W: 112 L: 132 D: 256
Ptnml(0-2): 0, 61, 148, 41, 0
lc5 vs classic (500 games)
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [-3.00, 0.00]
Games: 28878 W: 7218 L: 7120 D: 14540
Ptnml(0-2): 20, 2834, 8624, 2950, 11
lc5: SearchSession refactor (13 commits: slot mutex removal, local wakeups, eviction/starvation fix, TicketTable/SessionGate/VisitWorker/Evaluator extraction) vs 1d0e209a
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: -2.58 (-2.94, 2.94) [0.00, 3.00]
Games: 26750 W: 6640 L: 6724 D: 13386
Ptnml(0-2): 28, 2746, 7903, 2678, 20
lc5 step 14: StickyEndgames=true vs false
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: -0.00 (-2.94, 2.94) [0.00, 3.00]
Games: 28104 W: 6924 L: 6869 D: 14311
Ptnml(0-2): 13, 2831, 8313, 2878, 17
lc5 step 15: TwoFoldDraws=contained vs root
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 0.13 (-2.94, 2.94) [-3.00, 0.00]
Games: 16488 W: 4153 L: 4178 D: 8157
Ptnml(0-2): 5, 1618, 5027, 1585, 9
lc5 NodeStore stores node statistics (63951bd4) vs 0a668749; default Lc5GraphNodeLimit=0, so no eviction: checks the default path is unchanged
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: -2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 21798 W: 5401 L: 5514 D: 10883
Ptnml(0-2): 13, 2255, 6485, 2124, 22
lc5 step 16: Lc5Policy=puct-dag vs puct
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 2.95 (-2.94, 2.94) [0.00, 3.00]
Games: 19584 W: 4918 L: 4721 D: 9945
Ptnml(0-2): 15, 1928, 5712, 2119, 18
lc5 step 16: puct-dag vs puct, HistoryKeyLength=1
CremagLeela-lc5[Leela] b80da3dd2a44156c7cf62686136e84b47d652c66diff8.0+0.08Elo: -25.58 +- 5.16 (95%) [N=4000]
Games: 4000 W: 868 L: 1162 D: 1970
Ptnml(0-2): 2, 614, 1061, 322, 1
lc5 checkpoint after step 16 (defaults: reselect, MovesLeft) vs classic, same commit
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: 2.96 (-2.94, 2.94) [0.00, 3.00]
Games: 8662 W: 2264 L: 2090 D: 4308
Ptnml(0-2): 3, 806, 2544, 970, 8
lc5 step 12: WaiterResume=reselect vs select
CremagLeela-lc5lc5-implementationdiff8.0+0.08LLR: -0.47 (-2.94, 2.94) [0.00, 3.00]
Games: 9078 W: 2253 L: 2260 D: 4565
Ptnml(0-2): 7, 939, 2651, 938, 4
lc5 step 13: MovesLeft=true vs false