See also types/models.go for model name constants.

rather then keep processing model names from sessions into instances of the model struct (just so we can ask it GetMemoryRequirements()) this gives us an in memory cache of model instances we can quickly lookup from.

NewMockModel creates a new mock instance.

NewMockModelSessionFileManager creates a new mock instance.

this will handle aliases and defaults.

define 1 GB as a uint64 number of bytes.

We only need constants for _some_ ollama models that are hardcoded in various places (backward compat).

get hackily written to at process startup TODO: remove this when we rip out cog downloading its weights over http.

the same chunker works for inference and fine tuning.

MockModel is a mock of Model interface.

MockModelMockRecorder is the mock recorder for MockModel.

MockModelSessionFileManager is a mock of ModelSessionFileManager interface.

MockModelSessionFileManagerMockRecorder is the mock recorder for MockModelSessionFileManager.

Model struct represents an OpenAPI model.

ModelsList is a list of models, including those that belong to the user or organization.

Permission struct represents an OpenAPI permission.

a configurable text stream to process llm output.

go:generate mockgen -source $GOFILE -destination types_mocks.go -package $GOPACKAGE.

an interface that allows models to be opinionated about how they manage a sessions files for example, for text fine tuning - we want to download all JSONL files across interactions and then concatenate them into one file a ModelSessionFileManager implmentation will be per session and so have allocated a folder for each session.

TODO: having a separate ModelName type just so we can put the InferenceRuntime() method on it is silly, we should move the InferenceRuntime logic onto the Model struct maybe.