GCSSourceFactory returns the default SourceFactory.

GetStorageClient provides a storage reader client.

NewLocalFactory creates a new LocalFactory that produces LocalWriters that output to the named output directory.

NewLocalWriter creates a new LocalWriter for output to the given dir and path.

NewRowWriter creates a RowWriter.

NewSinkFactory returns the default SinkFactory.

NewTestSource creates an TestSource suitable for injecting into Task.

ErrOversizeFile is returned when exceptionally large files are skipped.

Closer handles gzip files.

GCSSource wraps a gsutil tar file containing tests.

LocalFactory creates LocalWriters sinks within a given output directory.

LocalWriter provides a Sink interface for parsers to output to local files.

RowWriter implements row.Sink to a GCS file backend.

SinkFactory implements factory.SinkFactory.

TarReader provides Next and Read functions.