New creates a new stage for the given type and configuration.

NewCRI creates a predefined pipeline for parsing entries in the CRI log format.

NewDocker creates a predefined pipeline for parsing entries in the Docker json log format.

NewGenMap created which maintains at most maxSize recently used entries.

NewPipeline creates a new log entry pipeline from a configuration.

RunWith will reads from the input channel entries, mutate them with the process function and returns them via the output channel.

RunWithSkip same as RunWith, except it skip sending it to output channel, if `process` functions returns `skip` true.

RunWithSkiporSendMany same as RunWithSkip, except it can either skip sending it to output channel, if `process` functions returns `skip` true.

Sanitize a input string to convert it into a valid prometheus label TODO: switch to prometheus/prometheus/util/strutil/SanitizeFullLabelName.

Config Errors.

Config Errors.

Config Errors.

Config Errors.

Config Errors.

Metric types.

Metric types.

Metric types.

80bytes per rate.Limiter ~ 1MiB memory.

ReservedLabelTenantID is a shared value used to refer to the tenant ID.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(thampiotr): Add support for eventlogmessage stage.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

TODO(@tpaschalis) Let's use this as the list of stages we need to port over.

Debug is used to wrap debug log statements, the go-kit logger won't let us introspect the current log level so this global is used for that purpose.

DefaultCRIConfig contains the default CRIConfig values.

DefaultMultilineConfig applies the default values on.

DefaultPackConfig sets the defaults.

Config Errors.

ErrEmptyLabelAllowStageConfig error is returned if the config is empty.

ErrEmptyLabelDropStageConfig error returned if the config is empty.

Config Errors.

Configuration errors.

Configuration errors.

Config Errors.

Config Errors.

Config Errors.

Config Errors.

ErrEmptyStaticLabelStageConfig error returned if the config is empty.

Config Errors.

Config errors.

Config Errors.

Config errors.

Configuration errors.

Config errors.

Configuration errors.

Configuration errors.

Config Errors.

Configuration errors.

Configuration errors.

Configuration errors.

Configuration errors.

Configuration errors.

Config Errors.

Configuration errors.

Configuration errors.

Configuration errors.

Configuration errors.

Configuration errors.

Config Errors.

Configuration errors.

Configuration errors.

Config errors.

Config errors.

Config errors.

Config errors.

Config errors.

Configuration errors.

Inspect is used to debug promtail pipelines by showing diffs between pipeline stages.

Configuration errors.

Configuration errors.

Config errors.

Config errors.

TimestampActionOnFailureOptions defines the available options for the `action_on_failure` field.

Config errors.

Config errors.

Config errors.

Config errors.

Config errors.

CRIConfig is an empty struct that is used to enable a pre-defined pipeline for decoding entries that are using the CRI logging format.

DockerConfig is an empty struct that is used to enable a pre-defined pipeline for decoding entries that are using the Docker logs format.

DropConfig contains the configuration for a dropStage.

GenerationalMap is ported from Loki's pkg/util package.

GeoIPConfig represents GeoIP stage config.

JSONConfig represents a JSON Stage configuration.

LabelAllowConfig contains the slice of labels to allow through.

LabelDropConfig contains the slice of labels to be dropped.

LabelsConfig is a set of labels to be extracted.

LimitConfig sets up a Limit stage.

LogfmtConfig represents a logfmt Stage configuration.

LuhnFilterConfig configures a processing stage that filters out Luhn-valid numbers.

MatchConfig contains the configuration for a matcherStage.

MetricConfig is a single metrics configuration.

MetricsConfig is a set of configured metrics.

MultilineConfig contains the configuration for a Multiline stage.

OutputConfig initializes a configuration stage which sets the log line to a value from the extracted map.

PackConfig contains the configuration for a packStage.

Packed keeps track of the labels and log entry.

Pipeline pass down a log entry to each stage for mutation and/or label extraction.

RegexConfig configures a processing stage uses regular expressions to extract values from log lines into the shared values map.

ReplaceConfig contains a regexStage configuration.

SamplingConfig contains the configuration for a samplingStage.

StageConfig defines a single stage in a processing pipeline.

StaticLabelsConfig contains a map of static labels to be set.

TemplateConfig configures template value extraction.

TenantConfig configures a tenant stage.

TimestampConfig configures a processing stage for timestamp extraction.

Processor takes an existing set of labels, timestamp and log entry and returns either a possibly mutated timestamp and log entry.

Stage can receive entries via an inbound channel and forward mutated entries to an outbound channel.