Files
deepseek-harness/packages/llm/README.md
2026-07-15 14:47:29 +08:00

1.2 KiB

llm/ — LLM capability family

The LLM seam and its provider adapters. The interface package (llm) owns the abstract service, the content-block vocabulary, and the stream-chunk assembler; the adapters are concrete implementations that register on ctx.llm. All product packages.

Package Role ctx key
llm/ Abstract LLM service + content-block vocabulary + chunk assembler ctx.llm
token-meter/ Replay-aware, per-model request and surface token measurement ctx.tokenMeter
llm-deepseek/ DeepSeek API adapter (hand-rolled fetch/SSE) (registers on ctx.llm)
llm-pi-ai/ DeepSeek adapter via @earendil-works/pi-ai (design twin) (registers on ctx.llm)

The interface lives at llm/llm/; adapters and the reusable token meter are flat siblings under the group. A new provider adapter joins here and registers on ctx.llm without touching the interface. See twin LLM adapters for why two adapters exist and the replay token meter RFC for measurement ownership.