TELEMETRY PIPELINE
Configure
Kubernetes settings
Workloads

Workloads

In Chronosphere Telemetry Pipeline, you can use the PipelineKind attribute to specify workload (opens in a new tab) types for pipelines.

Pipelines can run as the following workload types:

  • Deployment (opens in a new tab): A pipeline run as a Deployment has a configurable number of replica Pods. If you don’t specify a workload type, new pipelines run as Deployments by default.
  • StatefulSet (opens in a new tab): A pipeline run as a StatefulSet has a configurable number of replica Pods, similar to a Deployment pipeline, but each Pod has persistent data storage and a stable identity.
  • DaemonSet (opens in a new tab): A pipeline run as a DaemonSet adds a Pod to every node in the Kubernetes cluster where it’s deployed.

Set a pipeline’s workload type

To set the workload type for a new pipeline, use the --kind flag in Pipeline CLI:

calyptia create pipeline \
--core-instance INSTANCE \
--name PIPELINE \
--kind WORKLOAD

Replace the following:

  • INSTANCE: The name of your Core Instance.
  • PIPELINE: The name to give your new pipeline.
  • WORKLOAD: The workload type for your pipeline. Possible values: deployment, statefulSet, or daemonSet.

After you create a pipeline, you can’t change its workload type.

Additional settings for StatefulSet pipelines

There are several additional settings unique to StatefulSet pipelines, including one required setting:

--storage-class CLASS \
--pvc-retention-policy-when-deleted POLICY1 \
--pvc-retention-policy-when-scaled POLICY2
  • CLASS: Required. The StorageClass (opens in a new tab) to use for each Pod’s PersistentVolume (opens in a new tab). After you set this value for a StatefulSet pipeline, you can’t modify it.
  • POLICY1: Specifies whether Kubernetes should retain or delete each Pod’s PersistentVolumeClaim (opens in a new tab) (PVC) if the StatefulSet pipeline is deleted. Possible values: Retain (default) and Delete. To use this flag, you must be running Kubernetes v1.32 or newer and must enable the StatefulSetAutoDeletePVC feature gate in Kubernetes.
  • POLICY2: Specifies whether Kubernetes should retain or delete PVCs associated with any affected Pods if the StatefulSet pipeline is scaled down. Possible values: Retain (default) and Delete. To use this flag, you must be running Kubernetes v1.32 or newer and must enable the StatefulSetAutoDeletePVC feature gate in Kubernetes.

If you’re using Kubernetes v1.31 or earlier, you can’t set the --pvc flags to specify how Kubernetes handles PVC cleanup because older versions of Kubernetes don’t handle PVC cleanup. Instead, Telemetry Pipeline handles the cleanup process by deleting PVCs for deleted pipelines and retaining PVCs for scaled-down pipelines.

If you’re using Kubernetes v1.32 or later but don’t enable the StatefulSetAutoDeletePVC feature gate, or if you attempt to set the --pvc flags in Kubernetes v1.31 or earlier, neither Kubernetes nor Telemetry Pipeline handles PVC cleanup. In this scenario, all PVCs persist until you delete them manually.

TolerationsMetadata