Create a new Checkpointer.

Create a new stream starting at the latest position This uses the Kinesis LATEST iterator type and assumes the caller only wants new data.

Create a new stream given a specific sequence number This uses the Kinesis AFTER_SEQUENCE_NUMBER interator type, so this assumes the provided sequenceNumber has already been processed, and the caller wants records produced since.

Create a new stream starting at the oldest position This uses the Kinesis TRIM_HORIZON iterator type and assumes the caller only wants all availible data.

Utility function to pick a shard id given an integer shard number.

Recommended minimum polling interval to keep from overloading a Kinesis shard.

An ArchiveReader understands how to translate our archive data store format into indivdual records.

An Uploader is just a simple wrapper around an S3manager.

A SerialReader let's us read from multiple readers, in sequence.

A ShardStreamReader provides records from a Kinesis stream.

A store manages buffering records together into files, and uploading them somewhere.

A StoreArchive represents an instance of a data file stored, usually, in S3.

A StreamReader is a higher-level interface for reading data from a live Triton stream.

Some types to make sure our lists of func args don't get confused.

Sortable list of store archives.