SDP 23.11 is not the latest You're viewing SDP 23.11, not the current release (SDP 26.3).

View SparkHistoryServer in SDP 26.3 View SDP 26.3 →

Custom resource

SparkHistoryServer

Auto-generated derived type for SparkHistoryServerSpec via `CustomResource`

View SDP 23.11 release Download CRD (YAML)

API group: spark.stackable.tech
API versions in 23.11: v1alpha1
Scope: Namespaced
Operator: Apache Spark
Roles: 1 (nodes)

Schema

SparkHistoryServer.spark.stackable.tech .spec fields for SDP 23.11.

Schema

nodes # role object required *
This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.

This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.
image # object required *
logFileDirectory # object required *
clusterConfig # object = {"listenerClass":"cluster-internal"}
Global Spark history server configuration that applies to all roles and role groups

Global Spark history server configuration that applies to all roles and role groups
sparkConf # object = {}
vectorAggregatorConfigMapName # string
Name of the Vector aggregator discovery ConfigMap. It must contain the key ADDRESS with the address of the Vector aggregator.

Name of the Vector aggregator discovery ConfigMap. It must contain the key ADDRESS with the address of the Vector aggregator.