NewDefaultPipeline returns a new Transporter Pipeline with the given node tree, and uses the events.HttpPostEmitter to deliver metrics.

NewNodeWithOptions initializes a Node with the required parameters and then applies each OptionFunc provided.

NewPipeline creates a new Transporter Pipeline using the given tree of nodes, and Event Emitter eg.

WithClient sets the client.Client to be used for providing a client.Session to the client.Reader/Writer..

WithCommitLog configures a CommitLog for the reader to persist messages.

WithCompactionInterval configures the duration for running log compaction.

WithOffsetManager configures an offset.Manager to track message offsets.

WithParent sets the parent node and reconfigures the pipe.

WithReader sets the client.Reader to be used to source data from.

WithResumeTimeout configures how long to wait before all sink offsets match the newest offset.

WithTransforms adds the provided transforms to be applied in the pipeline.

WithWriter sets the client.Writer to be used to send data to.

WithWriteTimeout configures the timeout duration for a writer to return.

ErrConfirmOffset is returned if the underling OffsetManager fails to commit the offsets.

ErrResumeStopped is returned when the underling pipe.Pipe has been stopped while a Node is in the process of resuming.

ErrResumeTimedOut is returned when the resumeTimeout is reached after attempting to check that a sink offset matches the newest offset.

A Node is the basic building blocks of transporter pipelines.

A Pipeline is a the end to end description of a transporter data flow.

Transform defines the struct for including a native function in the pipeline.

OptionFunc is a function that configures a Node.