mirror of
https://github.com/deepseek-ai/deepseek-harness
synced 2026-08-15 21:04:50 +00:00
3e1c63b2ea
`StatsLine` renders its LLM, tool-call, and throughput segments only while the matching measurement exceeds zero, and all three are wall clock taken during the replay. A machine that finishes a step inside one millisecond drops the segment a slower one keeps, so a golden recorded what the recording machine's speed was rather than what the page shows. Goldens across this suite already disagreed about the LLM segment for that reason, and CI failed on whichever test landed on a slow enough runner — a different test each run, always the same one-line difference. Tokenizing the values was never enough, because presence is what moves. The normalizer now drops those segments outright, each taking one adjacent separator so nothing is left holding a dangling separator or a doubled space, and the recorded goldens are normalized the same way. `TTFT avg` stays: it gates on a step count the fixture determines.