Categorygithub.com/llmariner/inference-managerserverinternalrouter
package
1.13.0
Repository: https://github.com/llmariner/inference-manager.git
Documentation: pkg.go.dev
Overview
Versions
2
Dependencies
3
Dependents
2
Files
186 SLOC

# Functions

New creates a new router.

# Structs

R manages the routing table of models to engines.