NewCluster creates a new cluster module and tries to connect to the kafka cluster If it cannot connect to the cluster it will panic.

NewOffsetConsumer creates a consumer which process all messages in the __consumer_offsets topic If it cannot connect to the cluster it will panic.

StorageAddConsumerOffset is the request type to add a consumer's offset commit.

StorageAddGroupMetadata is the request type to add a group member's partition assignment.

StorageAddPartitionHighWaterMark is the request type to add a partition's high water mark.

StorageAddPartitionLowWaterMark is the request type to add a partition's low water mark.

StorageAddSizeByBroker is the request type to add aggregated partition sizes grouped by broker.

StorageAddSizeByTopic is the request type to add aggregated partition sizes grouped by topic.

StorageAddTopicConfiguration is the request type to add configuration entries for a topic.

StorageDeleteConsumerGroup is the request type to remove an offset commit for a topic:group:partition combination.

StorageDeleteGroupMetadata is the request type to delete a group member's partition assignment.

StorageDeleteTopic is the request type to delete all topic information.

StorageMarkOffsetPartitionReady is the request type to mark a partition consumer of the consumer offsets topic as ready (=caught up partition lag).

StorageRegisterOffsetPartitions is the request type to make the storage module aware that the offset consumer first has to fully consume a specific number of partitions before it should expose any metrics.

Cluster is a module which connects to a Kafka Cluster and periodically fetches all topic and partition information (e.

ConsumerGroupMetadata contains additional information about consumer groups, such as: - Partition assignments (which hosts are assigned to partitions) - Session timeouts (hosts which haven't sent the keep alive in time) - Group rebalancing.

ConsumerPartitionOffset represents a consumer group commit which can be decoded from the consumer_offsets topic.

OffsetConsumer is a consumer module which reads consumer group information from the offsets topic in a Kafka cluster.

PartitionWaterMark contains either the first or last known committed offset (water mark) for a partition.

StorageRequest is an entity to send messages / requests to the storage module.

TopicConfiguration indicates config entries for a topic along with the partition count.

StorageRequestType is used to determine the message type / request when communicating with the storage module via channel.