# Packages
No description provided by the author
# Functions
CombineWithSymflowerFixAssessments combines the model assessments with the ones from "symflower fix".
Merge combines two assessment collections into a new assessment collection and returns the new assessment collection.
NewAssessments creates a new assessment collection.
RegisterAssessmentKey registers a new assessment key.
# Variables
AllAssessmentCategories holds all assessment categories.
AllAssessmentKeysStrings returns all registered assessment keys as strings.
AssessmentCategoryCodeCoverageStatementReached indicates that a model's generated code reached 100% statement coverage.
AssessmentCategoryCodeExecuted indicates that a model's generated code could be executed without an error.
AssessmentCategoryCodeInvalid indicates that a model's generated code produced an error when executed.
AssessmentCategoryCodeNoExcess indicates that a model's response did not contain more content than requested.
AssessmentCategoryResponseError indicates that a model has encountered an error trying to produce a response.
AssessmentCategoryResponseNoCode indicates that a model's response did not contain any source code.
AssessmentCategoryUnknown indicates that it is not possible to compute a model's category.
AssessmentKeyCoverage counts execution coverage objects.
AssessmentKeyFilesExecuted holds the successfully executed files.
AssessmentKeyFilesExecutedMaximumReachable holds the maximum theoretically reachable executed files.
AssessmentKeyGenerateTestsForFileCharacterCount counts the number of characters of a generated test file.
AssessmentKeyProcessingTime holds the time in milliseconds that it took to complete the task.
AssessmentKeyResponseCharacterCount counts the number of characters of a response.
AssessmentKeyResponseNoError indicates that a model responded without error.
AssessmentKeyResponseNoExcess indicates that a model did not produce more content as requested.
AssessmentKeyResponseWithCode indicates that a model responded with code.
AssessmentKeyTestsPassing holds the percentage of passing tests.
# Structs
AssessmentCategory represents a categorical ranking of a model based on Assessments.
# Type aliases
AssessmentKey defines a key for a numerical key-value assessment pair.
Assessments holds a collection of numerical assessment metrics.