REST.

REST.

REST.

For control plane operations except load/unload.

GRPC.

How long to wait for a model to load? think of LLM Load, maybe should be a config.

GRPC.

GRPC.

around 3.2s in total wait duration.

REST.

REST.

this is at the grpc library level.

REST.

REST.