GetDriverAnnotationOption returns a spark-submit option for a driver annotation of the given key and value.

GetDriverEnvVarConfOptions returns a list of spark-submit options for setting driver environment variables.

GetDriverSecretConfOptions returns a list of spark-submit options for mounting driver secrets.

GetExecutorAnnotationOption returns a spark-submit option for an executor annotation of the given key and value.

GetExecutorEnvVarConfOptions returns a list of spark-submit options for setting executor environment variables.

GetExecutorSecretConfOptions returns a list of spark-submit options for mounting executor secrets.

GetK8sConfigMap gets the cmName configmap in app.Namespace and returns the configMapPath.

GetK8sSecret gets the secretName secret in app.Namespace and returns the secretPath.

GetPrometheusConfigMapName returns the name of the ConfigMap for Prometheus configuration.

RemoveDirectory removes the directory where configmaps and secrets are dynamically copied.

DefaultHadoopConfDir is the default directory for Spark configuration files if not specified.

DefaultMetricsProperties is the default content of metrics.properties.

DefaultPrometheusConfiguration is the default content of prometheus.yaml.

DefaultPrometheusJavaAgentPort is the default port used by the Prometheus JMX exporter.

DefaultSparkConfDir is the default directory for Spark configuration files if not specified.

GoogleApplicationCredentialsEnvVar is the environment variable used by the Application Default Credentials mechanism.

HadoopConfDirEnvVar is the environment variable to add to the driver and executor Pods that point to the directory where the Hadoop ConfigMap is mounted.

HadoopConfigMapVolumeName is the name of the ConfigMap volume of Hadoop configuration files.

HadoopDelegationTokenFileName is the assumed name of the file storing the Hadoop delegation token.

HadoopTokenFileLocationEnvVar is the environment variable for specifying the location where the file storing the Hadoop delegation token is located.

Kerberos Keytab parameter.

KDC krb5.conf parameter.

Kerberos principal parameter.

LabelAnnotationPrefix is the prefix of every labels and annotations added by the controller.

LaunchedBySparkOperatorLabel is a label on Spark pods launched through the Spark Operator.

PrometheusConfigMapMountPath is the mount path of the Prometheus ConfigMap.

PrometheusConfigMapNameSuffix is the name prefix of the Prometheus ConfigMap.

ScheduledSparkAppNameLabel is the name of the label for the ScheduledSparkApplication object name.

ServiceAccountJSONKeyFileName is the assumed name of the service account Json key file.

SparkApplicationSelectorLabel is the AppID set by the spark-distribution on the driver/executors Pods.

SparkAppNameKey is the configuration property for application name.

SparkAppNameLabel is the name of the label for the SparkApplication object name.

SparkAppNamespaceKey is the configuration property for application namespace.

SparkConfDirEnvVar is the environment variable to add to the driver and executor Pods that point to the directory where the Spark ConfigMap is mounted.

SparkConfigMapVolumeName is the name of the ConfigMap volume of Spark configuration files.

SparkContainerImageKey is the configuration property for specifying the unified container image.

SparkContainerImagePullPolicyKey is the configuration property for specifying the container image pull policy.

SparkDownloadTimeout is the Spark configuration key for specifying the timeout in seconds of downloading remote dependencies.

SparkDriverAnnotationKeyPrefix is the Spark configuration key prefix for annotations on the driver Pod.

SparkDriverContainerImageKey is the configuration property for specifying a custom driver container image.

SparkDriverContainerName is name of driver container in spark driver pod.

SparkDriverCoreLimitKey is the configuration property for specifying the hard CPU limit for the driver pod.

SparkDriverCoreRequestKey is the configuration property for specifying the physical CPU request for the driver.

SparkDriverEnvVarConfigKeyPrefix is the Spark configuration prefix for setting environment variables into the driver.

SparkDriverJavaOptions is the Spark configuration key for a string of extra JVM options to pass to driver.

SparkDriverLabelKeyPrefix is the Spark configuration key prefix for labels on the driver Pod.

SparkDriverPodNameKey is the Spark configuration key for driver pod name.

SparkDriverRole is the value of the spark-role label for the driver.

SparkDriverSecretKeyPrefix is the configuration property prefix for specifying secrets to be mounted into the driver.

SparkDriverSecretKeyRefKeyPrefix is the configuration property prefix for specifying environment variables from SecretKeyRefs for the driver.

SparkDriverServiceAccountName is the Spark configuration key for specifying name of the Kubernetes service account used by the driver pod.

SparkDriverVolumesPrefix is the Spark volumes configuration for mounting a volume into the driver pod.

SparkExecutorAnnotationKeyPrefix is the Spark configuration key prefix for annotations on the executor Pods.

SparkExecutorContainerImageKey is the configuration property for specifying a custom executor container image.

SparkExecutorContainerName is name of executor container in spark executor pod.

SparkExecutorCoreLimitKey is the configuration property for specifying the hard CPU limit for the executor pods.

SparkExecutorCoreRequestKey is the configuration property for specifying the physical CPU request for executors.

SparkExecutorDeleteOnTermination is the Spark configuration for specifying whether executor pods should be deleted in case of failure or normal termination.

SparkExecutorDeleteOnTermination is the Spark configuration for specifying whether executor pods should be deleted in case of failure or normal termination.

SparkExecutorEnvVarConfigKeyPrefix is the Spark configuration prefix for setting environment variables into the executor.

SparkExecutorJavaOptions is the Spark configuration key for a string of extra JVM options to pass to executors.

SparkExecutorLabelKeyPrefix is the Spark configuration key prefix for labels on the executor Pods.

SparkExecutorRole is the value of the spark-role label for the executors.

SparkExecutorSecretKeyPrefix is the configuration property prefix for specifying secrets to be mounted into the executors.

SparkExecutorSecretKeyRefKeyPrefix is the configuration property prefix for specifying environment variables from SecretKeyRefs for the executors.

SparkExecutorVolumesPrefix is the Spark volumes configuration for mounting a volume into the driver pod.

SparkFilesDownloadDir is the Spark configuration key for specifying the download path in the driver and executors for remote files.

SparkImagePullSecretKey is the configuration property for specifying the comma-separated list of image-pull secrets.

SparkInitContainerImage is the Spark configuration key for specifying a custom init-container image.

SparkJarsDownloadDir is the Spark configuration key for specifying the download path in the driver and executors for remote jars.

SparkLocalDirVolumePrefix is the volume name prefix for "scratch" space directory.

SparkMaxSimultaneousDownloads is the Spark configuration key for specifying the maximum number of remote dependencies to download.

SparkMemoryOverheadFactor is the Spark configuration key for specifying memory overhead factor used for Non-JVM memory.

SparkNodeSelectorKeyPrefix is the configuration property prefix for specifying node selector for the pods.

SparkPythonVersion is the Spark configuration key for specifying python version used.

SparkRoleLabel is the driver/executor label set by the operator/spark-distribution on the driver/executors Pods.

SparkWaitAppCompletion is the Spark configuration key for specifying whether to wait for application to complete.

SubmissionIDLabel is the label that records the submission ID of the current run of an application.