Categorygithub.com/infinilabs/coco-serverliblangchaingollmscache
package
0.0.0-20250219065129-52aed497bc00
Repository: https://github.com/infinilabs/coco-server.git
Documentation: pkg.go.dev
Overview
Versions
1
Dependencies
5
Dependents
0
Files
70 SLOC

# Packages

No description provided by the author

# Functions

New wraps a Model and adds caching capabilities using the provided cache backend.

# Structs

Cacher is an LLM wrapper that caches the responses from the LLM.

# Interfaces

Backend is the interface that needs to be implemented by cache backends.