package
1.6.2
Repository: https://github.com/kubemq-io/kubemq-sources.git
Documentation: pkg.go.dev

# README

Kubemq AWS S3 Source Connector

Kubemq AWS S3 source connector allows services using kubemq server to sync aws s3 objects to remote location.

Prerequisites

The following are required to run the aws s3 source connector:

  • kubemq cluster
  • kubemq-sources deployment

Configuration

S3 source connector configuration properties:

Properties KeyRequiredDescriptionExample
aws_keyyesaws keyaws key supplied by aws
aws_secret_keyyesaws secret keyaws secret key supplied by aws
regionyesregionaws region
tokennoaws token ("default" empty stringaws token
foldersyesset list of folders to watch"/"
target_typeyesset remote target sync type"aws", "gcp", "minio", "filesystem","hdfs","azure","pass-through"
bucket_nameyesset source bucket"bucket"
concurrencynoset sending concurrency"1"
scan_intervalnoset bucket scan interval in sec"5"

Example:

bindings:
- name: s3
  source:
    kind: aws.s3
    properties:
      aws_key: "id"
      aws_secret_key: 'json'
      region:  "region"
      token: ""
      folders: 'folder1,folder2/sub1/sub2'
      target_type: filesystem
      bucket_name: bucket
      concurrency: 1
      scan_interval: 5
  target:
    kind: kubemq.queue
    properties:
      address: localhost:50000
      channel: queue.s3
  properties: {}

# Functions

No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author
No description provided by the author

# Structs

No description provided by the author
No description provided by the author
No description provided by the author

# Type aliases

No description provided by the author