Categorygithub.com/llmariner/inference-managerserverinternalinfprocessor
package
1.13.0
Repository: https://github.com/llmariner/inference-manager.git
Documentation: pkg.go.dev
Overview
Versions
2
Dependencies
12
Dependents
9
Files
750 SLOC

# Functions

NewP creates a new processor.

# Structs

EngineStatus is the status of an engine.
P processes inference tasks.
Status is the status of the processor.
TaskStatus is the status of a task.
TenantStatus is the status of a tenant.

# Interfaces

TaskSender sends a new task to the engine.