Interface ContextFitRequest

The request one model would be sent.

interface ContextFitRequest {
    provider: string;
    model: string;
    messages?: readonly unknown[];
    system?: unknown;
    prompt?: string;
    tools?: unknown;
    maxTokens?: number;
    customModelParams?: Record<string, unknown>;
}

Properties

provider: string
model: string
messages?: readonly unknown[]

The messages as sent, system messages included.

system?: unknown

A system prompt kept apart from messages, when the caller has one.

prompt?: string
tools?: unknown

The tool schemas as sent.

maxTokens?: number

The call's maxTokens (a fallback hop's, after its overrides).

customModelParams?: Record<string, unknown>