package
0.0.0-20240816234238-c0d581acaa8c
Repository: https://github.com/leaf-ai/studio-go-runner.git
Documentation: pkg.go.dev

# Functions

AllocGPU will select the default allocation pool for GPUs and call the allocation for it.
No description provided by the author
GetDevices will return a list of the possible devices that support a specified compute slot count.
GetSlots is used to retrieved the number of compute slots that cards are capable of.
GPUCount returns the number of allocatable GPU resources.
GPUInventory can be used to extract a copy of the current state of the GPU hardware seen within the runner.
GPUSlots gets the free and total number of GPU capacity slots within the machine .
No description provided by the author
LargestFreeGPUMem will obtain the largest number of available GPU slots on any of the individual cards accessible to the runner.
LargestFreeGPUSlots gets the largest number of single device free GPU slots .
MonitorGPUs will having initialized all of the devices in the tracking map when started as a go function check the devices for ECC and other kv.marking failed GPUs .
ReturnGPU releases the GPU allocation passed in.
TotalFreeGPUSlots gets the largest number of single device free GPU slots .

# Variables

CudaInitErr records the result of the CUDA library initialization that would impact ongoing operation.
CudaInitWarnings records warnings and kv.that are deemed not be be fatal to the ongoing CUDA library usage but are of importance.
CudaInTest is used to check if the running process is a go test process, if so then this will disable certain types of checking when using very limited GPU Hardware.
UseGPU is used for specific types of testing to disable GPU tests when there are GPU cards potentially present but they need to be disabled, this flag is not used during production to change behavior in any way.

# Structs

GPUAllocated is used to record the allocation/reservation of a GPU resource on behalf of a caller .
GPUTrack is used to track usage of GPU cards and any kv.generated by the cards at the hardware level .

# Type aliases

GPUAllocations records the allocations that together are present to a caller.