SDP 23.11 is not the latest You're viewing SDP 23.11, not the current release (SDP 26.3).

View HdfsCluster in SDP 26.3 View SDP 26.3 →

Custom resource

HdfsCluster

Auto-generated derived type for HdfsClusterSpec via `CustomResource`

View SDP 23.11 release Download CRD (YAML)

API group: hdfs.stackable.tech
API versions in 23.11: v1alpha1
Scope: Namespaced
Operator: Apache Hadoop HDFS
Roles: 3 (dataNodes, journalNodes, nameNodes)

Schema

HdfsCluster.hdfs.stackable.tech .spec fields for SDP 23.11.

Schema

clusterConfig # object required *
image # object required *
dataNodes # role object
This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.

This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.
journalNodes # role object
This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.

This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.
nameNodes # role object
This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.

This struct represents a role - e.g. HDFS datanodes or Trino workers. It has a [HashMap] containing all the roleGroups that are part of this role. Additionally, there is a config, which is configurable at the role and roleGroup level. Everything at roleGroup level is merged on top of what is configured on role level using the [Merge] trait. There is also a second form of config, which can only be configured at role level, the roleConfig.
clusterOperation # object = {"stopped":false,"reconciliationPaused":false} Cluster operations like pause reconciliation or cluster stop.

Cluster operations like pause reconciliation or cluster stop.