ChatService_ServiceDesc is the grpc.ServiceDesc for ChatService service.

InferenceInternalService_ServiceDesc is the grpc.ServiceDesc for InferenceInternalService service.

InferenceWorkerService_ServiceDesc is the grpc.ServiceDesc for InferenceWorkerService service.

Message has fields for system message, user message, assistant message, and tool message.

AudioUrl is non-openai compatible.

Refer to https://platform.openai.com/docs/api-reference/chat/create#chat-create-messages.

RagFunction is used to unmarshal the json string specified in `Parameters` of Tool message.

UnimplementedChatServiceServer must be embedded to have forward compatible implementations.

UnimplementedInferenceInternalServiceServer must be embedded to have forward compatible implementations.

UnimplementedInferenceWorkerServiceServer must be embedded to have forward compatible implementations.

ChatServiceClient is the client API for ChatService service.

ChatServiceServer is the server API for ChatService service.

InferenceInternalServiceClient is the client API for InferenceInternalService service.

InferenceInternalServiceServer is the server API for InferenceInternalService service.

InferenceWorkerServiceClient is the client API for InferenceWorkerService service.

InferenceWorkerServiceServer is the server API for InferenceWorkerService service.

UnsafeChatServiceServer may be embedded to opt out of forward compatibility for this service.

UnsafeInferenceInternalServiceServer may be embedded to opt out of forward compatibility for this service.

UnsafeInferenceWorkerServiceServer may be embedded to opt out of forward compatibility for this service.