NewContinuousCollector returns a new collector for continuous processing with given datasource.

newSqsPublisher creates a new SQS message publisher.

NewS3EventHandler returns a new handler to process S3 events send from Cloud Watch.

NewScheduledCollector returns a new scheduled collector for given config.

ORIGIN_QUEUE is used to add name of a source queue to message attributes of archive events.

ContinuousCollector is used as a deamon to permanently collect data from a source.

EventHandlerS3 is used to process an S3 event send from Cloud Watch to a Lambda function on AWS.

A ScheduledCollector calls fetch method of a datasource one time and publishes returned event to a given AWS SQS queue.

SqsPublisher is used to publish messages on AWS SQS.

A Collector calls fetch method of a datasource and process the returned event.

DataSource retrieves data from a specific source.

Publisher is used to send messages to one or multiple queues.

S3EventHandler is used to process an event published for S3 actions.

S3EventProcessor processes an event for a specific S3 object.

SqsEventProcessor is used to handle event forwarded from AWS SQS to a lambda function.