NewPipeline creates a new DataPipeline.

NewProcessorWorker creates a new ProcessorWorker.

NewReadWorker creates a new ReadWorker.

NewWriteWorker creates a new Worker.

ErrFilteredOut is returned by a processor when a token should be filtered out of the pipeline.

Pipeline runs a series of workers in parallel.

ProcessorWorker implements the pipeline.Worker interface It wraps a DataProcessor and processes data with it.

DataProcessor is an interface for processing data go:generate mockery --name DataProcessor.

DataWriter is an interface for writing data to a destination.

Worker is an interface for a pipeline item Each worker has a send and receive channel that connects it to the previous and next stage in the pipeline The Run method starts the worker go:generate mockery --name Worker.