Categorygithub.com/mKaloer/TFServingCachepkgtfservingproxy
package
0.0.0-20250203130515-f1cf3b64ddcd
Repository: https://github.com/mkaloer/tfservingcache.git
Documentation: pkg.go.dev
Overview
Versions
1
Dependencies
16
Dependents
2
Files
215 SLOC

# Functions

NewGrpcProxy creates a new GrpcProxy for TF Serving.
NewRestProxy creates a new RestProxy for TF Serving.

# Structs

GrpcProxy is the proxy for the TFServing GRPC api that directs api calls to the right nodes.
RestProxy is the proxy for the TFServing HTTP REST api that directs api calls to the right nodes.