CompleteChat handles the chat completion endpoint.

NewControllersPoolRandom Creates a new ControllersPoolRandom.

NewControllersPoolSmoothWeightedRoundRobin Creates a new ControllersPoolSmoothWeightedRoundRobin.

NewOpenAIConfigFromEnv creates a new OpenAIConfig.

NewOpenAIConfigFromFile creates a new OpenAIConfig.

NewOpenAIController creates a new OpenAIController.

ControllersPoolRandom A simple implementation of ControllersPool.

OpenAIController The controller for OpenAI.

ChatCompletionStream The interface for the stream.

Controller The interface for the controller.

ControllersPool The interface for the pool of controllers.

ChatCompletionRequest The unified request.

ChatCompletionResponse The unified response.

ChatCompletionStreamResponse The unified stream response.