package "sak" (Swiss Army knife) provides some basic util functions.

Creates an AsyncJobScheduler which is tied to the RunStatus of EventSource.

A shortcut method for createing a ChangeLogEntry with a value endcoded using the provided codec.

A shortcut method for createing a ChangeLogEntry with a json endcoded value.

Creates all necessary topics in the Kafka appropriate clusters as defined by Source.

The default DeserializationErrorHandler.

The default ProcessingErrorHandler.

The default and recommended TxnErrorHandler.

Deletes all topics associated with a Source.

A convenience function for encoding an item into a ChangeLogEntry suitable writing to a StateStore Please not that the Key on the entry will be left uninitialized.

Creates an IncrementalRebalancer suitatble for use by the kgo Kafka driver.

Initializes the GKES logger.

A convenience function for decoding an IncomingRecord.

A convenience function for encoding an item into a Record suitable for sending to a producer Please not that the Key on the record will be left uninitialized.

A convenience function for creating unit tests for an EventContext from an incoming Kafka Record.

A convenience function for creating unit tests for an EventContext from an interjection.

Create a new AsynBatcher.

Creates an AsyncJobScheduler which will continue to run while runStatus.Running().

Creates a container for BatchItems and ties them to an EventContext.

Provides similar functionality to [AsyncBatcher], but in the context of producing Kafka records.

NewClient creates a kgo.Client from the options retuned from the provided [Cluster] and addtional `options`.

Create an EventSource.

Creates a NewGlobalChangeLog consumer and forward all records to `receiver`.

Creates a NewGlobalChangeLog consumer and forward all records to `receiver`.

A kgo compatible partitioner which respects Record partitions that are manually assigned.

A kgo compatible partitioner which respects Record partitions that are manually assigned.

Create a new Producer.

Returns a new, empty TopicPartitionSet.

A convenience method to avoid chick-egg scenarios when initializing an EventSource.

Registers eventType with a transformer (usuall a codec.Codec) with the supplied EventProcessor.

A convenience function provided in case you are working with a raw kgo producer and want to integrate with streams.

WrapLogger allows GKES to emit logs at a higher level than your own Logger.

Complete signals the EventSource that the event or interjection is completely processed.

Instructs GKES to ignore any error stateand continue processing as normal.

Signifies that the consumer should no longer continue processing events.

Instructs GKES to immediately stop processing and the consumer to immediately leave the group.

Signifies that the consumer should panic.

As the name implies, the application will fatally exit.

Incomplete signals the EventSource that the event or interjection is still ongoing, and that your application promises to fulfill the EventContext in the future.

let's keep it small.

Convenience codec for working with raw `[]byte`s.

Convenience codec for working with int32 types Will never induce an error unless there is an OOM condition, so they are safe to ignore on Encode/Decode.

Convenience codec for working with int64 types Will never induce an error unless there is an OOM condition, so they are safe to ignore on Encode/Decode.

Convenience codec for working with int types.

A convenience Codec for integers where the encoded value is suitable for sorting in data structure which use []byte as keys (such as an LSM based db like BadgerDB or RocksDB).

Convenience codec for working with strings.

AsyncBatcher performs a similar function to the [AsyncJobScheduler], but is intended for performing actions for multiple events at a time.

The AsyncJobScheduler provides a generic work scheduler/job serializer which takes a key/value as input via Schedule.

ChangeLogEntry represents a Kafka record which wil be produced to the StateStore for your EventSource.

EosDiagarm On-Deck Txn Pending Txn Channel Commit Go-Routine ┌───────────┐ ┌─────────────────┐ ┌─────────────────────────────────────┐ │ EventCtx │ │ Pending Txn(s) │ │ Committing Txn │ │ Offset: 7 │ │ ┌───────────┐ │ │ ┌───────────┐ │ ├───────────┤ │ │ EventCtx │ │ │ │ EventCtx │ 1: Receive Txn │ │ EventCtx │ │ │ Offset: 4 │ │ │ │ Offset: 1 │ │ │ Offset: 8 │ │ ├───────────┤ │ │ ├───────────┤ 2: EventCtx(s).Wait │ ├───────────┼──────────►│ │ EventCtx │ ├─────────►│ │ EventCtx │ │ │ EventCtx │ │ │ Offset: 5 │ │ │ │ Offset: 2 │ 3: Flush Records │ │ Offset: 9 │ │ ├───────────┤ │ │ ├───────────┤ │ └───────────┘ │ │ EventCtx │ │ │ │ EventCtx │ 4: Commit │ ▲ │ │ Offset: 6 │ │ │ │ Offset: 3 │ │ │ │ └───────────┘ │ │ └───────────┘ │ │ └─────────────────┘ └─────────────────────────────────────┘ Incoming EventCtx */.

Contains information about the current event.

EventSource provides an abstraction over raw kgo.Record/streams.IncomingRecord consumption, allowing the use of strongly typed event handlers.

A GlobalChangeLog is simply a consumer which continously consumes all partitions within the given topic and forwards all records to it's StateStore.

A generic JSON en/decoder.

A simple kafka producer.

A readonly wrapper of [EventSourceConfig].

A convenience data structure.

An interface for implementing a resusable Kafka client configuration.

The IncrementalGroupRebalancer interface is an extension to kgo.GroupBalancer.

Defines the interface needed for the IncrementalGroupRebalancer to function.

Provides the interface needed by GKES to intergrate with your loggin mechanism.

A callback invoked when a previously scheduled AsyncJob has been completed.

A handler invoked when a previously scheduled AsyncJob should be performed.

in structs GKES and how to proceed when an error is encountered.

A callback invoked when a new record has been received from the EventSource, after it has been transformed via IncomingRecordTransformer.

Returned by an EventProcessor or Interjector in response to an EventContext.

A callback invoked when a new record has been received from the EventSource.

Defines the method signature needed by the EventSource to perform a stream interjection.

The status of a consumer group member.

A [Cluster] implementation useful for local development/testing.

SimpleLogger implements Logger and writes to STDOUT.

Defines a method which accepts a TopiCPartition argument and returns T.