Release notes

Chronosphere Telemetry Pipeline release notes

Information for each release is displayed by component.

Version 3.3.0

Also known as Calyptia Core v3.3.0.

Released: 2024.08.29

Dashboard

  • Renamed the Teammates page to Team.
  • Core Instance tags can now include numbers.
  • Added a confirmation modal when pausing a pipeline.
  • Clarified the names of menu items in the Data Pipelines section of the Core Instance details page.
  • Added the Status History button to the More options menu in the Data Pipelines section of the Core Instance details page.
  • Updated the link to Chronosphere Support included in the pipeline Status History modal.
  • Added role tags to the project selector menu.
  • Added the pipeline builder playground.
  • Invalid cluster logging configurations now display an error message.
  • Added the Datagen source plugin to the pipeline builder.
  • Updated in-page links to the Chronosphere docs library.
  • Changed the behavior of the processing rules builder to load an empty state on startup.
  • Processing rules now support metrics and traces.
  • Fix: Fixed a bug that made processing rules disappear after updating a destination plugin's configuration settings.
  • Fix: Fixed a bug related to reserved words in Core Instance names.

Calyptia CLI

  • Added the ability to set proxy environment variables using the following flags: –cloud-proxy, –http_proxy, –https_proxy, and –no_proxy.
  • Added support for the --metrics flag to enable Kubernetes server metrics.
  • Removed the deprecated --auto-create-ports flag.
  • Added the --disable-auto-checks flag as an option when creating or updating pipelines.
  • Improved the performance of the autocomplete feature and the quality of its results.

Calyptia Cloud API

  • Added the new audit logs feature.
  • Users with read-only permissions (the Viewer role) can no longer create or access API tokens.
  • Processing rules now draw upon V2 of the template API.
  • The horizontal pod autoscaling API now supports the Unknown scaling policy.
  • Ports are now configured on a per-pipeline level.
  • Pipeline image validation now supports any image that follows the repo:tag syntax.
  • The validation process for pipeline configuration files now supports arrays in addition to comma-separated and space-separated strings.
  • Configuration files now return an error in response to unknown fields.
  • Updated the list of resources returned in search results.
  • Updated the performance of the list endpoint when including ?include=ports,files,secrets as a search query.
  • Added support for the exact parameter when performing searches.
  • Tags now support numbers and dashes.
  • Fix: The Metrics API now ignores empty metrics instead of returning an error.
  • Fix: Sending invalid AWS tokens to the AWS Marketplace API now returns the correct 422 HTTP status code.
  • Fix: The validation process for configuration files no longer returns an error for core-prefixed properties.

Core Agent

  • Added support for raw messages to the S3 Input (SQS) source plugin.
  • Processing rules now support metrics and traces.
  • Added the SQL DB source plugin.
  • Added proxy support to the calyptia plugin.
  • Fix: Fixed a fatal error that stopped agent execution during a hot reload.
  • Fix: Various improvements to the Splunk source plugin.

Core Operator

  • Added support for proxies.
  • Improved image version replacement logic for Helm charts.

Version 2.13.0

Also known as Calyptia Core v2.13.0.

Released: 2024.06.12

Dashboard

  • Added support for the Kubernetes Metadata input plugin and the Datadog input plugin.
  • The OpenTelemetry input plugin now sets Tag_From_URI to false by default.
  • Added a Help Center Menu to the sidebar with links to various Calyptia and Fluent Bit resources.
  • Added an About section to settings with version information about different Calyptia components.
  • Fix: Fixed an issue where switching to a new project would not hide pipelines from the previous project.

Calyptia CLI

  • Added parameters to configure horizontal pod autoscaling.
  • Fix: Fixed an issue that automatically reverted a pipeline's service type to LoadBalancer when updating a pipeline without providing a --service-type flag.

Calyptia Cloud API

  • Updated the plugins schema for pipeline configuration validation.
  • Fix: Added a detailed error response to handle duplicate pipeline aliases.
  • Fix: Metrics that are more than 30 minutes old are no longer ingested.
  • Fix: Improved the performance of the Calyptia API pipeline endpoint.

Core Agent

  • Added a Datagen input plugin that uses Gofakeit (opens in a new tab) to generate simulated log data.
  • Fix: Fixed a potential security issue (Fluent Bit CVE-2024-4323) related to input requests.

Core Operator

  • Pipelines now support horizontal pod autoscaling.
  • Fix: Fixed an issue that prevented Core Instance from fetching more than 10 pipelines at a time.
  • Fix: Changed the way that Core Instance assigns names to pipelines. The previous naming schema was [pipeline_name]-[random_4_char_string], and the new naming schema is [core-instance-name]-[pipeline_name]

Version 2.12.3

Released: 2024.05.21

Core Agent

  • Fix: Fixed a potential security issue (Fluent Bit CVE-2024-4323) related to input requests.

Version 2.12.0

Released: 2024.05.15

Dashboard

  • Added output plugins for Exabeam, Oracle Logging Analytics, Azure Log Ingestion API, GELF (Graylog), Clickhouse DB, Scalyr DataSet, and Chronosphere logs.
  • Various updates to pipeline-related UI elements, including plugin metrics, output logs, and load-balanced endpoints.
  • Improved the look and feel of the pipeline editor.
  • Processing rules now remain visible in the UI after you disable them.
  • Added the ability to disable automated logging.
  • Fix: Fixed an issue that prevented empty Core Instances from redirecting to the Create new instance page.
  • Fix: Fixed an issue with the configuration settings for the Okta System Logs plugin.
  • Fix: Fixed an issue with automated logging that caused a CrashLoopBackOff state.
  • Fix: Added Calyptia CLI installation instructions that were missing from the Core Instance install wizard.
  • Deprecated: Removed "Test connection" feature from the automate logging onboarding modal.
  • Deprecated: Removed Helm tags from Kubernetes aggregator onboarding instructions.
  • Deprecated: Removed Validate button from fleet management onboarding modal.

Calyptia CLI

  • Added the ability to set a tolerations parameter for new Core Instances, which sets pod tolerations to the Core Instance and propagates that value to pipeline replicas. For example:

    calyptia create core_instance operator --name test8900 --tolerations key1=Exists:-:NoSchedule,key2=Equal:val2:PreferNoSchedule
  • Added the ability to set permissions for new members when sending invites to a project.

Calyptia Cloud API

  • Upgraded metrics backend to Prometheus.
  • Added the ability to immediately create a fleet with files by using the create endpoint.
  • Fix: Improved performance by adding SQL index to pipeline statuses and configuration.
  • Fix: Empty arrays now initialize to [] instead of null in the cluster object regular expressions API.
  • Fix: Fixed an error that prevented users from deleting fleets.
  • Deprecated: Removed the ability to query metrics through the v1 API.

Core Agent

  • Added the Scalyr DataSet output plugin.
  • Updated various dependencies.

Core Operator

  • Updated sync to accept the new tolerations parameter.

  • The Core Instance tolerations parameter is now propagated to pipeline replica sets.

  • Updated Helm chart to include the skipServiceCreation parameter. This parameter disables the creation of new Kubernetes services for all pipelines in the Core Instance. For example:

    helm install ci calyptia/core-instance --set "skipServiceCreation=true" --set "coreInstance=12l34" --set "cloudToken=1l234"
  • Updated Helm chart to include the tolerations parameter. For example:

    helm install ci core-instance/ --set "tolerations=key1=Equal:value1:Execute:3600\,key2=Exists:value2:NoExecute" --set "coreInstance=12l34" --set "cloudToken=1l234"
  • Fix: Fixed an issue with annotations flag parsing that affected comma-separated values.

Processing rules

  • Added multiple regular expression engine options for most processing rules that support regular expressions.
  • Updated the "parse" processing rule to support extended regular expression syntax.
  • Added the "join" processing rule.