CountPanics updates the PanicCount metric, then repanics.

DurationHandler wraps the call of an inner http.HandlerFunc and records the runtime.

PanicToErr captures panics and converts them to errors.

ActiveErrors measures the errors encountered during active processing.

ActiveTasks tracks the number of active tasks in flight.

AnnotationErrorCount measures the number of annotation errors Provides metrics: etl_annotator_Error_Count Example usage: metrics.AnnotationErrorCount.Inc().

AnnotationMissingCount measures the number of IPs with missing annotation.

AnnotationRequestCount measures the number of annotation requests Provides metrics: etl_annotator_Request_Count Example usage: metrics.AnnotationRequestCount.Inc().

AnnotationTimeSummary measures the latencies of requests to the Annotation Service as measured by the pipeline Provides metrics: etl_annotator_Annotation_Time_Summary Example usage: metrics.AnnotationTimeSummary.observe(float64).

AnnotationWarningCount measures the number of annotation warnings Provides metrics: etl_annotator_Warning_Count Example usage: metrics.AnnotationWarningCount.Inc().

BackendFailureCount counts the all bulk backend failures.

CommitHash records the passed in Git commit.

TODO(dev): fields/row - generalize this metric for any file type.

DurationHistogram provides a histogram of worker processing times.

TODO(dev): rows/test - generalize this metric for any file type.

ErrorCount counts the all errors that result in test loss.

FileCount counts the number of files processed by machine, rsync module, and day.

FileSizeHistogram provides a histogram of source file sizes.

GCSRetryCount counts the number of retries on GCS read operations.

InsertionHistogram provides a histogram of bigquery insertion times.

NumCPU makes the number of cpus available for prometheus calculations.

PanicCount counts the number of panics encountered in the pipeline.

PTBitsAwayFromDestV4 provides a histogram of number of bits difference between last hop and expected destination IP for the PT tests that did not reach the expected destination IP.

PTBitsAwayFromDestV6 provides a histogram of number of bits difference between last hop and expected destination IP for the PT tests that did not reach the expected destination IP.

PTHopCount counts the number of hops in PT tests successfully processed by the parsers.

PTMoreHopsAfterDest counts the PT tests that reach the expected destination IP in the middle of a test per metro, but do more hops afterwards instead of ending there.

PTNotReachDestCount counts the PT tests that did not reach the expected destination IP at the last hop per metro.

PTPollutedCount counts the PT polluted tests per metro.

PTTestCount counts the PT tests per metro.

ReleaseTag records the passed in Git commit.

TODO(dev): bytes/row - generalize this metric for any file type.

TaskCount counts the number of tasks processed by the pipeline.

TestCount counts the number of tests successfully processed by the parsers.

WarningCount counts the all warnings that do NOT result in test loss.

WorkerCount counts the number of workers currently active.

WorkerState counts the number of workers in each worker state.