Interface PutInferenceEndpointRateLimitsRequest

interface PutInferenceEndpointRateLimitsRequest {
name?: string;
rateLimits?: RateLimit[];
}

Properties

name?: string

The name of the serving endpoint whose rate limits are being updated. This field is required.

rateLimits?: RateLimit[]

The list of endpoint rate limits.