Get build logs for a served model.

Delete a serving endpoint.

Get metrics of a serving endpoint.

Get the schema for a serving endpoint.

The response is an OpenAPI spec in JSON format that typically includes fields like openapi, info, servers and paths, etc.

Get serving endpoint permission levels.

Get serving endpoint permissions.

Get a single serving endpoint.

Get the latest logs for a served model.

Update AI Gateway of a serving endpoint.

Update rate limits of a serving endpoint.

The Serving Endpoints API allows you to create, update, and delete model serving endpoints.

Serving endpoints DataPlane provides a set of operations to interact with data plane endpoints for Serving endpoints service.

WaitGetServingEndpointNotUpdating is a wrapper that calls [ServingEndpointsAPI.WaitGetServingEndpointNotUpdating] and waits to reach NOT_UPDATING state.

Serving endpoints DataPlane provides a set of operations to interact with data plane endpoints for Serving endpoints service.

The Serving Endpoints API allows you to create, update, and delete model serving endpoints.

Behavior for PII filter.

Key field for a rate limit.

Renewal period field for a rate limit.

The underlying provider in Amazon Bedrock.

The role of the message.

This will always be 'embedding'.

The state of an endpoint's config update.

The state of an endpoint, indicating whether or not the endpoint is queryable.

The name of the provider for the external model.

The type of object returned by the __external/foundation model__ serving endpoint, one of [text_completion, chat.completion, list (of embeddings)].

Key field for a serving endpoint rate limit.

Renewal period field for a serving endpoint rate limit.

The workload size of the served model.

The workload type of the served model.

The state of the served entity deployment.

The permission level of the principal making the request.

Permission level.