Interface ModelServiceConfig

Operational configuration wrapped around the ModelService resource.

interface ModelServiceConfig {
    inferenceTable?: InferenceTableConfig;
    rateLimits?: RateLimit[];
    routing?: ModelServiceConfig_RoutingConfig;
}

Index

Properties

inferenceTable? rateLimits? routing?

Properties

`Optional`inferenceTable

inferenceTable?: InferenceTableConfig

Inference table config for payload logging.

`Optional`rateLimits

rateLimits?: RateLimit[]

Rate limits applied to requests routed through this model service.

`Optional`routing

routing?: ModelServiceConfig_RoutingConfig

Routing configuration: destinations, routing strategy, and fallback.