Custom pipelines

Custom pipelines allow you to read data from sources such as agents, network devices, syslog, APIs, and collect data from metric endpoints and object stores, such as S3.

Creating custom pipelines has these advantages:

• Automatically load balanced when reading from a network source and multiple replicas selected.
• Self-healing in the case of unintended data.
• Buffering and Error-handling by default when the backend might not be functioning properly.
• Automatically monitored for performance and data statistics.

Get started

• Create, modify, or delete pipelines
• Retrieve pipeline history and revert settings
• Create processing rules
• Scale a pipeline
• Add secrets to a pipeline