mirror of
https://github.com/deepseek-ai/deepseek-harness
synced 2026-08-15 21:04:50 +00:00
aa0ca6c836
core.md read as a type grab-bag: LLM wire vocabulary up front, the agent/loop story buried, and no correspondence to packages/core. It now opens on the packages/core control spine — the package-by-package loop map with a Page column into session/system-prompt/tools/scope — and keeps only what the spine group declares plus the repo-wide patterns: the Agent handle with its delivery/cancellation/interception contracts, the SessionEvent envelope, branded ids, the …Map pattern. The conversation vocabulary (Message/ContentBlock, the model request, adapters — 17 type-equiv blocks) moves to llm-streaming.md, which now declares packages/llm end-to-end; the duplicate ContentBlockMap paste near its seam section folds into the moved section, and the manifest, LINK_MAP, README table rows, website label (Core data structures → Core), and inbound anchors follow. Every packages/<group>/README pair is now a thin front door in one shape: a why-first intro (bash's seam-pattern-first paragraph rewritten as 'shell execution for the agent'), the package table, and a closing pointer to the owning docs/subsystems page — the bash-style table stays the load-bearing middle. Load-bearing trailing paragraphs relocate rather than vanish: the fs no-timeout rationale becomes a filesystem.md section (both languages), session's four sectioned tables merge into one 12-row table, examples' legacy-bin H2 collapses to a pointer at jsonrpc-demo's README, and design rationale that already lives in an Agent Note or subsystem page is now linked instead of restated. All 40 pair records re-recorded.
91 lines
4.5 KiB
Markdown
91 lines
4.5 KiB
Markdown
# Token Meter
|
|
|
|
English | [中文](token-meter.zh.md)
|
|
|
|
`@deepseek-ai/dsh-token-meter` exposes one detached replay snapshot for request pressure and positional surface pricing. `logRevision` is the number of durable events consumed for every field in the measurement.
|
|
|
|
Source: [`packages/llm/token-meter/src/types.ts`](../../packages/llm/token-meter/src/types.ts)
|
|
|
|
## `TokenMeasurement`
|
|
|
|
```ts type-equiv
|
|
/** Detached immutable request-pressure and surface snapshot at one consumed log revision. */
|
|
interface TokenMeasurement {
|
|
/** Number of durable events consumed; equal to the next unread event seq. */
|
|
readonly logRevision: number
|
|
/** Provider or heuristic anchor used for this measurement. */
|
|
readonly baseline: TokenMeasurementBaseline
|
|
/** Signed repricing of current surface content relative to the baseline anchor. */
|
|
readonly surfaceDeltaTokens: number
|
|
/** Non-negative current request-and-response pressure. */
|
|
readonly totalTokens: number
|
|
/** Total heuristic tokens across the current surface. */
|
|
readonly surfaceTokens: number
|
|
/** Current surface nodes in positional head-to-tail order. */
|
|
readonly nodes: readonly TokenSurfaceNode[]
|
|
}
|
|
```
|
|
|
|
`baseline.kind === 'usage'` means the latest successful provider call has the same canonical request envelope and its total is no lower than that call's full heuristic anchor. `estimated` means no reusable conservative usage anchor exists, so the service priced the complete envelope and surface with its fixed heuristic. A later successful request replaces the earlier anchor; signed `surfaceDeltaTokens` preserves growth and shrinkage relative to a matching anchor. `totalTokens` remains request-and-response pressure, while `surfaceTokens` is the surface-only heuristic total and equals the sum of the node prices.
|
|
|
|
## `TokenSurfaceNode`
|
|
|
|
```ts type-equiv
|
|
/** One token-priced node in the current ordered session surface. */
|
|
interface TokenSurfaceNode {
|
|
/** Durable sequence number of the surface event. */
|
|
readonly seq: number
|
|
/** Heuristic tokens for the exact message projected by this node. */
|
|
readonly tokens: number
|
|
}
|
|
```
|
|
|
|
Surface order is authoritative; replacement nodes can have higher durable seqs than later positional nodes. The snapshot is immutable and does not grow when the underlying replay fold advances.
|
|
|
|
<!-- BEGIN GENERATED cordis-surface (gen-cordis-catalog.ts) — do not edit between markers -->
|
|
|
|
<a id="cordis-surface"></a>
|
|
|
|
## Cordis surface
|
|
|
|
Generated from source by `scripts/gen-cordis-catalog.ts` (verified fresh by `pnpm run verify-cordis-catalog` in doc-sync; regenerate with `pnpm run gen-cordis-catalog`) — this section is byte-identical in both language sides of the page. Signature blocks use a `ts cordis-catalog` fence and keep the original source JSDoc; dispatch modes are defined in the [primer](../cordis-primer.md#dispatch-modes), and the framework-inherited `ctx` surface lives in [cordis-api/inherited.md](../cordis-api/inherited.md).
|
|
|
|
<a id="ctxtokenmeter--tokenmeterservice"></a>
|
|
|
|
### `ctx.tokenMeter` — `TokenMeterService`
|
|
|
|
Replay owner for one service-wide estimator and isolated per-session folds.
|
|
|
|
```ts cordis-catalog
|
|
/**
|
|
* Measure current request pressure and surface through the durable tail.
|
|
*
|
|
* Provider usage is reused only when the latest successful call's canonical
|
|
* request envelope matches `requestHeader` and its total is no lower than
|
|
* that call's full heuristic anchor; otherwise the complete envelope and
|
|
* surface are heuristically repriced.
|
|
*
|
|
* `requestHeader` affects request pressure only; surface fields always
|
|
* describe the current session surface. Every call clones those positional
|
|
* nodes, so measurement is O(surface).
|
|
*
|
|
* @param session - session to replay through its current durable tail.
|
|
* @param requestHeader - optional effective request envelope replacing the latest logged header.
|
|
* @returns a detached deeply immutable pressure and surface measurement.
|
|
*/
|
|
measure(session: Session, requestHeader?: EpochHeader): TokenMeasurement
|
|
|
|
/**
|
|
* Heuristically price one model-visible message (instance face of the pure
|
|
* `estimateMessage` export from `estimate.ts`).
|
|
* @param message - message to price without mutation.
|
|
* @returns content and role-framing tokens under the fixed service heuristic.
|
|
*/
|
|
estimateMessage(message: Message): number
|
|
```
|
|
|
|
Types: [EpochHeader](session.md) · [Message](llm-streaming.md) · [Session](session.md)
|
|
|
|
Source: [`packages/llm/token-meter/src/index.ts:74`](../../packages/llm/token-meter/src/index.ts)
|
|
<!-- END GENERATED cordis-surface -->
|