Complimentary Gartner® Report! 'A CTO's Guide to Open-Source Software: Answering the Top 10 FAQs.'Read more

Coalesce

Description

The Coalesce processor can be used to consolidate many field names into a single field name.

Use

The Coalesce processor is utilized for consolidating telemetry fields in metrics, logs, and traces based on specified conditions.

note

While this is similar on concept to SQL Coalesce, it has some key differences. Especially around the order of precedence. See the behavior section.

Supported Types

MetricsLogsTraces

Configuration

FieldDescription
Telemetry TypesThe types of telemetry to apply the processor to.
ConditionA condition that determines when this processor is applied.
ActionThe action to take (insert, update, upsert) when coalescing telemetry
Coalesce FromThe telemetry fields to coalesce from.
Coalesce ToThe telemetry field to coalesce to.

Behavior

The behavior of this processor is dependent on the selected action.

When insert is selected, the target field only gets coalesced to if it doesn't exist. Precedence: First item in list. When update is selected, the target field gets coalesced to only if it already exists. Precedence: Last item in list. When upsert it selected, the target field gets coalesces to regardless whether it existed or not. Precedence: Last item in list.

Example Configuration(s)

Coalesce timestamp fields

This configuration will coalesce the body fields ts, time, and timestamp to an attribute named time for later parsing. Upsert is used for the action.

Web Interface

observIQ docs - Coalesce Field - Timestamps

Coalesce severity fields

This configuration will coalesce the body fields sev, severity, and level to an attribute named severity for later parsing. Upsert is used for the action.

Web Interface

observIQ docs - Coalesce Field - Severity

Coalesce datacenter fields

This configuration will coalesce the body fields dc, datacenter, and location to an attribute named datacenter for later parsing. Upsert is used for the action.

Web Interface

observIQ docs - Coalesce Field - Datacenter