deepseek-harness/apps/web/tests/snapshots/steering/settled.expected.md at f3a4833dbf2be4ebb18831dbae0bfc2c299a20e7

mirror of https://github.com/deepseek-ai/deepseek-harness synced 2026-08-15 21:04:50 +00:00

Files

Tianyi Cui ea1d8d06b3 test(web): pin every scenario end-state with an aria golden

Every spec now commits at least one golden and the interactive ones one
per distinct end-state (nine new .expected.md):

- live-interactions: cancel.expected.md (frozen partial + 已停止 marker),
  error-auth.expected.md (the prompt bubble alone — the committed artifact
  of the web-error-surface gap, the diff that flips when error rendering
  lands), retry.expected.md (indistinguishable from a clean completion —
  retries are deliberately invisible in the transcript).
- question-composer: answered.expected.md (the question resolved into its
  tool round trip plus the final reply, takeover gone) beside the existing
  waiting-state golden.
- steering: mid-steer.expected.md pins the accepted-but-INVISIBLE state
  (the loop drains steering only at the step boundary, so no interjection
  bubble exists while the question still blocks — if the client ever
  renders pending steers eagerly, this golden flips first) and
  settled.expected.md the badged bubble plus obeying reply.
- navigation-panes: waterfall.expected.md and details-open.expected.md
  (tool-name header, Input args, Output result) beside the trajectory one.
- lifecycle-chrome: reloaded.expected.md — rendering the same settled
  transcript from persistence alone IS the recovery claim.

Fixture inventories extended to the new closed sets; the Agent Note's
expected-outputs policy updated in both languages (per-end-state goldens
for interactive scenarios), pairing re-recorded.

2026-07-26 12:45:44 +08:00

1.8 KiB

Raw Blame History

banner:
- navigation "Session hierarchy":
  - button "Use the ask_user_question tool to" [disabled]
  - text: · 1 turns
- tablist:
  - tab "Chat" [selected]
  - tab "Trajectory"
  - tab "Waterfall"
text: Use the ask_user_question tool to ask me exactly one question with id "checkpoint", question "Ready to continue?", header "Checkpoint", and options labeled "Yes" and "No". After I answer, reply with one short sentence acknowledging my answer and stop.
button "Think The user wants me to use the ask_user_question tool to ask them a specific question with the given parameters. Let me do exactly that.":
- img
- text: Think The user wants me to use the ask_user_question tool to ask them a specific question with the given parameters. Let me do exactly that.
button:
- img
text: "Tool call ask_user_question · {"questions": [{"id": "checkpoint", "question": "Ready to continue?", "header": "Checkpoint", "options": [{"label": "Yes"}, {"label": "No"}]}]} 插话 Interjection: include the word BANANA in your final reply."
button "Think The user selected "Yes" and wants me to include the word "BANANA" in my final reply. Let me acknowledge their answer.":
- img
- text: Think The user selected "Yes" and wants me to include the word "BANANA" in my final reply. Let me acknowledge their answer.
paragraph: Great, let's move forward. BANANA!
text: cache hit 98% · 15,967 tokens · 1 turns · 2 steps
textbox "Message the agent"
button "Add attachment":
- img
combobox "Plan mode":
- option "Plan" [selected]
- option "Agent"
combobox "Access mode":
- option "Read-only" [selected]
- option "Read-write"
combobox "Model":
- option "DeepSeek-V4-Pro High" [selected]
- option "DeepSeek-V4-Pro"
button "Send message" [disabled]

1.8 KiB Raw Blame History

1.8 KiB

Raw Blame History