Interface ContextWindowManagerConfig

interface ContextWindowManagerConfig {
    maxContextTokens: number;
    infiniteContext: Partial<InfiniteContextConfig>;
    llmInvoker?: ((prompt) => Promise<string>);
    observer?: MemoryObserver;
    reflector?: MemoryReflector;
    onTracesCreated?: ((traces) => Promise<void | string[]>);
}

Properties

maxContextTokens infiniteContext llmInvoker? observer? reflector? onTracesCreated?

Properties

maxContextTokens

maxContextTokens: number

Maximum context window size in tokens.

infiniteContext

infiniteContext: Partial<InfiniteContextConfig>

Infinite context configuration.

Optional llmInvoker

llmInvoker?: ((prompt) => Promise<string>)

Writes the summaries. infiniteContext.llmInvoker takes its place when set. Without either, compaction runs on extractive summaries: each strategy takes the segment's user messages (or the hybrid strategy's observation notes), and the summary chain joins and cuts its oldest summaries.

Type declaration

    • (prompt): Promise<string>

    • Parameters

      • prompt: string

      Returns Promise<string>

Optional observer

observer?: MemoryObserver

Optional: MemoryObserver for hybrid strategy.

Optional reflector

reflector?: MemoryReflector

Optional: MemoryReflector for hybrid strategy.

Optional onTracesCreated

onTracesCreated?: ((traces) => Promise<void | string[]>)

Encodes a compaction's traces into long-term memory. It runs after the turn goes on, and the ids it answers become the compaction's tracesCreated in the log.

Type declaration

    • (traces): Promise<void | string[]>

    • Parameters

      Returns Promise<void | string[]>

Settings

Member Visibility

Theme

On This Page

maxContextTokensinfiniteContextllmInvokerobserverreflectoronTracesCreated