NewPredictClient returns an instance of PredictClient.

NewPredictError constructs an error.

Default endpoint is the gateway mode.

Direct endpoint is used for direct accessing to the services' instances both inside a eas service and in user's client ecs.

Vipserver endpoint is only used for services which registered vipsever domains in alibaba internal clusters.

TfType_DT_INVALID and listed types use ALL_CAPS names here to consist with other language's sdk.

TfType_DT_INVALID and listed types use ALL_CAPS names here to consist with other language's sdk.

TfType_DT_INVALID and listed types use ALL_CAPS names here to consist with other language's sdk.

TfType_DT_INVALID and listed types use ALL_CAPS names here to consist with other language's sdk.

TfType_DT_INVALID and listed types use ALL_CAPS names here to consist with other language's sdk.

TfType_DT_INVALID and listed types use ALL_CAPS names here to consist with other language's sdk.

TfType_DT_INVALID and listed types use ALL_CAPS names here to consist with other language's sdk.

TfType_DT_INVALID and listed types use ALL_CAPS names here to consist with other language's sdk.

TfType_DT_INVALID and listed types use ALL_CAPS names here to consist with other language's sdk.

TorchType_DT_FLOAT and listed types use ALL_CAPS names here to consist with other language's sdk.

PredictClient for accessing prediction service by creating a fixed size connection pool to perform the request through established persistent connections.

PredictError is a custom err type.

QueueClient is client of queue server, which also implements queue service interface.

TFRequest class for tensorflow data and requests.

TFResponse class for Pytf predicted results.

TorchRecRequest class for PyTorch data and requests.

TorchResponse class for PyTorch predicted results.

TorchRequest class for PyTorch data and requests.

TorchResponse class for PyTorch predicted results.