Skip to content

Telemetry schema

Vector normalizes events before ClickHouse. Invalid transformations are dropped and reported through Vector metrics.

Edge events

FieldType or bound
occurred_atUTC millisecond timestamp
event_idgenerated UUID
domain_idunsigned integer
hostnamestring, 253 characters
methodupper-case string, 16 characters
pathquery removed, 2,048 characters
statusunsigned 16-bit integer
bytes_in, bytes_outunsigned integers
cache_statuslow-cardinality string, 24 characters
origin_latency_msnullable unsigned integer
origin_error, tls_errorbounded strings, 256 characters
origin_roleprimary or backup
origin_transitionstable reason, 32 characters
security_actionlow-cardinality string, 24 characters
security_reasonlow-cardinality string, 64 characters
edge_idlow-cardinality string, 64 characters
client_ipstring, 45 characters
country, continentupper-case two-character code
user_agent256 characters
referrer512 characters
event_typelow-cardinality string, 32 characters
compression_encodingidentity, gzip, or br
compression_ratiofloat clamped to 1–100,000
compression_profilelow-cardinality string, 24 characters
compression_fallbackstable reason, 32 characters
waf_profileoff, monitor, balanced, or strict
waf_rule_idnumeric managed-rule ID; zero means no match
waf_scorebounded unsigned anomaly score
waf_actionoff, allow, detect, block, or excluded
waf_processing_usbounded processing time in microseconds
waf_body_limitnone or exceeded
waf_exclusion_idnumeric audit reference; zero means none

DNS events

FieldType or bound
occurred_at, event_idUTC timestamp and generated UUID
domain_idunsigned integer; dnstap fallback uses zero
zone, qname253 characters
qtype, rcodeupper-case, 16 characters
client_ip45 characters
dns_cluster64 characters
country, continenttwo-character code
outcome32 characters

DNSdist dnstap accepts only client, resolver, or authoritative response frames. Fallback events use the question name as the zone and dnsdist as the cluster.

Removed fields

Both transforms delete authorization, cookies, request bodies, and bodies. Edge events also delete query strings. Control characters are removed from stored text fields. WAF telemetry never contains matched values, raw ModSecurity messages, request bodies, query values, cookie values, or customer rule text.

Aggregates

Materialized views write hourly and daily edge aggregates by domain, interval, hostname, status, cache status, geography, and edge. Counters include requests, bytes, latency sum/sample count, origin errors, TLS failures, and security blocks.

DNS aggregates group queries by domain, zone, interval, type, response code, geography, and cluster.

Raw tables retain seven days, hourly tables 400 days, and daily tables three years in docker/clickhouse/init.sql.

CDNFoundry documentation