https://spark.apache.org/docs/latest/configuration.html.

DefaultHadoopConfDir is the default directory for Spark configuration files if not specified.

https://spark.apache.org/docs/latest/configuration.html.

1 Gi.

DefaultMetricsProperties is the default content of metrics.properties.

https://spark.apache.org/docs/latest/configuration.html.

DefaultPrometheusConfiguration is the default content of prometheus.yaml.

DefaultPrometheusJavaAgentPort is the default port used by the Prometheus JMX exporter.

DefaultPrometheusPortName is the default port name used by the Prometheus JMX exporter.

DefaultPrometheusPortProtocol is the default protocol used by the Prometheus JMX exporter.

DefaultSparkConfDir is the default directory for Spark configuration files if not specified.

EnvGoogleApplicationCredentials is the environment variable used by the Application Default Credentials mechanism.

EnvHadoopConfDir is the environment variable to add to the driver and executor Pods that point to the directory where the Hadoop ConfigMap is mounted.

EnvHadoopTokenFileLocation is the environment variable for specifying the location where the file storing the Hadoop delegation token is located.

Spark environment variables.

Spark environment variables.

EnvSparkConfDir is the environment variable to add to the driver and executor Pods that point to the directory where the Spark ConfigMap is mounted.

Spark environment variables.

Epsilon is a small number used to compare 64 bit floating point numbers.

SparkApplication events.

SparkApplication events.

SparkApplication events.

SparkApplication events.

SparkApplication events.

SparkApplication events.

Spark driver events.

Spark driver events.

Spark driver events.

Spark driver events.

Spark driver events.

Spark executor events.

Spark executor events.

Spark executor events.

Spark executor events.

Spark executor events.

HadoopConfigMapVolumeName is the name of the ConfigMap volume of Hadoop configuration files.

HadoopDelegationTokenFileName is the assumed name of the file storing the Hadoop delegation token.

LabelAnnotationPrefix is the prefix of every labels and annotations added by the controller.

LabelLaunchedBySparkOperator is a label on Spark pods launched through the Spark Operator.

LabelMutatedBySparkOperator is a label on Spark pods that need to be mutated by webhook.

LabelScheduledSparkAppName is the name of the label for the ScheduledSparkApplication object name.

LabelSparkApplicationSelector is the AppID set by the spark-distribution on the driver/executors Pods.

LabelSparkAppName is the name of the label for the SparkApplication object name.

LabelSparkExecutorID is the label that records executor pod ID.

LabelSparkRole is the driver/executor label set by the operator/spark-distribution on the driver/executors Pods.

LabelSubmissionID is the label that records the submission ID of the current run of an application.

Spark application metric names.

Spark application metric names.

Spark application metric names.

Spark application metric names.

Spark application metric names.

Spark application metric names.

Spark application metric names.

Spark application metric names.

Spark application metric names.

Spark application metric names.

Spark executor metric names.

Spark executor metric names.

Spark executor metric names.

384 Mi.

PrometheusConfigMapMountPath is the mount path of the Prometheus ConfigMap.

PrometheusConfigMapNameSuffix is the name prefix of the Prometheus ConfigMap.

ServiceAccountJSONKeyFileName is the assumed name of the service account Json key file.

Spark3DefaultExecutorContainerName is the default executor container name in Spark 3.x, which allows the container name to be configured through the pod template support.

SparkAppName is the configuration property for application name.

SparkConfigMapVolumeName is the name of the ConfigMap volume of Spark configuration files.

SparkDriverContainerName is name of driver container in spark driver pod.

Spark properties.

SparkDriverExtraJavaOptions is the Spark configuration key for a string of extra JVM options to pass to driver.

Spark properties.

Spark properties.

Dynamic allocation properties.

SparkDynamicAllocationEnabled is the Spark configuration key for specifying if dynamic allocation is enabled or not.

Dynamic allocation properties.

Dynamic allocation properties.

SparkDynamicAllocationInitialExecutors is the Spark configuration key for specifying the initial number of executors to request if dynamic allocation is enabled.

SparkDynamicAllocationMaxExecutors is the Spark configuration key for specifying the upper bound of the number of executors to request if dynamic allocation is enabled.

SparkDynamicAllocationMinExecutors is the Spark configuration key for specifying the lower bound of the number of executors to request if dynamic allocation is enabled.

Dynamic allocation properties.

SparkDynamicAllocationShuffleTrackingEnabled is the Spark configuration key for specifying if shuffle data tracking is enabled.

SparkDynamicAllocationShuffleTrackingTimeout is the Spark configuration key for specifying the shuffle tracking timeout in milliseconds if shuffle tracking is enabled.

Dynamic allocation properties.

SparkExecutorContainerName is name of executor container in spark executor pod.

Spark properties.

Spark properties.

SparkExecutorEnvVarConfigKeyPrefix is the Spark configuration prefix for setting environment variables into the executor.

SparkExecutorExtraJavaOptions is the Spark configuration key for a string of extra JVM options to pass to executors.

Spark properties.

Spark properties.

Spark properties.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

SparkKubernetesAuthenticateDriverServiceAccountName is the Spark configuration key for specifying name of the Kubernetes service account used by the driver pod.

account used by the executor pod.

SparkKubernetesContainerImage is the configuration property for specifying the unified container image.

SparkKubernetesContainerImagePullPolicy is the configuration property for specifying the container image pull policy.

SparkKubernetesContainerImagePullSecrets is the configuration property for specifying the comma-separated list of image-pull secrets.

SparkKubernetesDriverAnnotationPrefix is the Spark configuration key prefix for annotations on the driver Pod.

SparkKubernetesDriverContainerImage is the configuration property for specifying a custom driver container image.

SparkKubernetesDriverEnvPrefix is the Spark configuration prefix for setting environment variables into the driver.

SparkKubernetesDriverLabelPrefix is the Spark configuration key prefix for labels on the driver Pod.

SparkKubernetesDriverLimitCores is the configuration property for specifying the hard CPU limit for the driver pod.

SparkKubernetesDriverMaster is the Spark configuration key for specifying the Kubernetes master the driver use to manage executor pods and other Kubernetes resources.

Spark on Kubernetes properties.

SparkKubernetesDriverPodName is the Spark configuration key for driver pod name.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

SparkKubernetesDriverRequestCores is the configuration property for specifying the physical CPU request for the driver.

Spark on Kubernetes properties.

SparkKubernetesDriverSecretKeyRefPrefix is the configuration property prefix for specifying environment variables from SecretKeyRefs for the driver.

SparkKubernetesDriverSecretsPrefix is the configuration property prefix for specifying secrets to be mounted into the driver.

SparkKubernetesDriverServiceAnnotationPrefix is the key prefix of annotations to be added to the driver service.

SparkKubernetesDriverServiceLabelPrefix is the key prefix of annotations to be added to the driver service.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

SparkKubernetesDriverVolumesPrefix is the Spark volumes configuration for mounting a volume into the driver pod.

SparkKubernetesExecutorAnnotationPrefix is the Spark configuration key prefix for annotations on the executor Pods.

SparkKubernetesExecutorContainerImage is the configuration property for specifying a custom executor container image.

SparkKubernetesExecutorDeleteOnTermination is the Spark configuration for specifying whether executor pods should be deleted in case of failure or normal termination.

SparkKubernetesExecutorLabelPrefix is the Spark configuration key prefix for labels on the executor Pods.

SparkKubernetesExecutorLimitCores is the configuration property for specifying the hard CPU limit for the executor pods.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

SparkKubernetesExecutorRequestCores is the configuration property for specifying the physical CPU request for executors.

Spark on Kubernetes properties.

SparkKubernetesExecutorSecretKeyRefPrefix is the configuration property prefix for specifying environment variables from SecretKeyRefs for the executors.

SparkKubernetesExecutorSecretsPrefix is the configuration property prefix for specifying secrets to be mounted into the executors.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

Spark on Kubernetes properties.

SparkKubernetesExecutorVolumesPrefix is the Spark volumes configuration for mounting a volume into the driver pod.

SparkKubernetesInitContainerImage is the Spark configuration key for specifying a custom init-container image.

SparkKubernetesMemoryOverheadFactor is the Spark configuration key for specifying memory overhead factor used for Non-JVM memory.

SparkKubernetesMountDependenciesFilesDownloadDir is the Spark configuration key for specifying the download path in the driver and executors for remote files.

SparkKubernetesMountDependenciesJarsDownloadDir is the Spark configuration key for specifying the download path in the driver and executors for remote jars.

SparkKubernetesMountDependenciesMaxSimultaneousDownloads is the Spark configuration key for specifying the maximum number of remote dependencies to download.

SparkKubernetesMountDependenciesTimeout is the Spark configuration key for specifying the timeout in seconds of downloading remote dependencies.

SparkKubernetesNamespace is the configuration property for application namespace.

SparkKubernetesNodeSelectorPrefix is the configuration property prefix for specifying node selector for the pods.

SparkKubernetesPysparkPythonVersion is the Spark configuration key for specifying python version used.

SparkKubernetesSubmissionWaitAppCompletion is the Spark configuration key for specifying whether to wait for application to complete.

SparkLocalDirVolumePrefix is the volume name prefix for "scratch" space directory.

SparkRoleDriver is the value of the spark-role label for the driver.

SparkRoleExecutor is the value of the spark-role label for the executors.

Spark properties.

Spark properties.

Kubernetes volume types.

Kubernetes volume types.

Kubernetes volume types.

Kubernetes volume types.