SDP 23.11 is not the latest You're viewing SDP 23.11, not the current release (SDP 26.3).

View AirflowCluster in SDP 26.3 View SDP 26.3 →

Custom resource

AirflowCluster

Auto-generated derived type for AirflowClusterSpec via `CustomResource`

View SDP 23.11 release Download CRD (YAML)

API group: airflow.stackable.tech
API versions in 23.11: v1alpha1
Scope: Namespaced
Operator: Apache Airflow
Roles: 3 (celeryExecutors, schedulers, webservers)

Schema

AirflowCluster.airflow.stackable.tech .spec fields for SDP 23.11.

Schema

image # object required * The Airflow image to use

The Airflow image to use
celeryExecutors # role object
This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.

This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.
schedulers # role object
This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.

This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.
webservers # role object
This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.

This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.
clusterConfig # object = {"dagsGitSync":[],"listenerClass":"cluster-internal","authentication":[],"cre... Global cluster configuration that applies to all roles and role groups

Global cluster configuration that applies to all roles and role groups
clusterOperation # object = {"stopped":false,"reconciliationPaused":false} Cluster operations like pause reconciliation or cluster stop.

Cluster operations like pause reconciliation or cluster stop.
kubernetesExecutors # object