Bridging Platform Engineering and Observability:
Empowering Developers with Insights Kasper Borg Nissen, Developer Advocate at
@phennex
kaspernissen.xyz
Slide 2
Who? Developer Advocate at Dash0 KubeCon+CloudNativeCon EU/NA 24/25 Co-Chair CNCF Ambassador Golden Kubestronaut CNCG Aarhus, KCD Denmark Organizer Co-founder & Community Lead Cloud Native Nordics
Slide 3
tl;dr ●
OpenTelemetry is standardizing telemetry collection.
●
Perses is standardizing dashboards.
●
Applying Platform Engineering principles transforms observability from an afterthought into a seamless, scalable, and developer-friendly experience.
Slide 4
Kubernetesʼ Rails moment
Bryan Liles at KubeCon+CloudNativeCon North America 2019
@phennex
kaspernissen.xyz
Slide 5
To some degree, Platform Engineering is enabling the Rails moment for Kubernetes in many organizations.
@phennex
kaspernissen.xyz
Slide 6
The Principles of Platform Engineering
Self-Service Experience
Explicit and Consistent APIs
Paved Paths/ Golden Paths
Modularity
Platform as a Product
Core Requirements
@phennex
kaspernissen.xyz
Slide 7
@phennex
kaspernissen.xyz
Slide 8
Observability is still fragmented
Metrics @phennex
kaspernissen.xyz
Logs
Traces Image by pngtree.com
Slide 9
Observability is still fragmented
We donʼt have a metrics problem, or a tracing problem. We have systems problems. Metrics @phennex
kaspernissen.xyz
Logs
Traces Image by pngtree.com
Slide 10
Observability is often fragmented, leading to
@phennex
kaspernissen.xyz
Image by pngtree.com
Slide 11
Observability is often fragmented, leading to
Complex Query Languages
@phennex
kaspernissen.xyz
Image by pngtree.com
Slide 12
Observability is often fragmented, leading to
Complex Query Languages
@phennex
kaspernissen.xyz
Vendor lock-in
Image by pngtree.com
Slide 13
Observability is often fragmented, leading to
Complex Query Languages
@phennex
kaspernissen.xyz
Vendor lock-in
Metadata Inconsistency
Image by pngtree.com
Slide 14
Observability is often fragmented, leading to
Complex Query Languages
Vendor lock-in
Metadata Inconsistency
No instrumentation due to high complexity
@phennex
kaspernissen.xyz
Image by pngtree.com
Slide 15
Observability is often fragmented, leading to
Complex Query Languages
Vendor lock-in
No instrumentation due to high complexity
@phennex
kaspernissen.xyz
Metadata Inconsistency
Lack of unified insights
Image by pngtree.com
Slide 16
We need to find the Rails moment of Observability.
@phennex
kaspernissen.xyz
Slide 17
A shift is happening.
@phennex
kaspernissen.xyz
Slide 18
A shift toward correlation
Find related information
@phennex
kaspernissen.xyz
Jump between signals
Reconstruct chain of events
Slide 19
A shift toward standardization Instrumentation OTel API & SDK
Telemetry Backends The OpenTelemetry Collector
auto-instrumentation
Time-series database … Log database Receive
Process
Analysis Tools
Export Trace database
Infrastructure … Kubernetes …
Generate and Emit
transmit
Inspired by visualizations from LFS148
Collect, Convert, Process, Route, Export
transmit
Store & Analyze
Slide 20
Vendor - space
Instrumentation OTel API & SDK
Telemetry Backends The OpenTelemetry Collector
auto-instrumentation
Time-series database … Log database Receive
Process
Analysis Tools
Export Trace database
Infrastructure … Kubernetes …
Generate and Emit
transmit
Inspired by visualizations from LFS148
Collect, Convert, Process, Route, Export
transmit
Store & Analyze
So, why OpenTelemetry?
Instrument once, use everywhere
@phennex
Separate telemetry generation from analysis
kaspernissen.xyz
Make software observable by default
Improve how we use telemetry
Slide 24
Thatʼs all great, but how do I make it easily accessible for my developers?
@phennex
kaspernissen.xyz
Slide 25
Platform Engineering for Observability
Self-Service Experience
Explicit and Consistent APIs
Golden Paths
Modularity
Platform as a Product
Core Requirements
@phennex
kaspernissen.xyz
Slide 26
Platform Engineering for Observability
Self-Service Experience Auto-Instrumentation
Explicit and Consistent APIs Semantic Conventions
Golden Paths Observability built-in
Modularity Collector Pipelines
Platform as a Product Documentation + Support
Core Requirements Cross-signal correlation
@phennex
kaspernissen.xyz
Auto-Instrumentation with the OpenTelemetry Operator Instrumentation
Instructs how to inject auto-instrumentation
Injects instrumentation in to the pod
OpenTelemetry Operator
@phennex
kaspernissen.xyz
Slide 29
Observability doesnʼt stop at instrumentation.
@phennex
kaspernissen.xyz
Slide 30
Perses An open specification for dashboards. CNCF Sandbox project
@phennex
kaspernissen.xyz
Slide 31
Dashboards as Code
@phennex
kaspernissen.xyz
Slide 32
Dashboards as Code
Perses
PersesDatasource
perses-operator
@phennex
kaspernissen.xyz
PersesDashboard
The Real Goal: Observability as a Paved Path
@phennex
kaspernissen.xyz
Slide 37
Observability is evolving - fast.
@phennex
kaspernissen.xyz
Slide 38
OpenTelemetry is standardizing telemetry collection.
@phennex
kaspernissen.xyz
Slide 39
Perses is standardizing dashboarding.
@phennex
kaspernissen.xyz
Slide 40
Applying Platform Engineering principles can transform observability from an afterthought into a seamless, scalable, and developer-friendly experience.
@phennex
kaspernissen.xyz
Slide 41
Observability is a systems problem - not a tracing, logging, or metrics problem.
@phennex
kaspernissen.xyz
Slide 42
When we connect signals together, we empower developers to solve problems faster.
@phennex
kaspernissen.xyz
Slide 43
Thank you! Metrics
Open Standards
Traces
Logs @phennex
kaspernissen.xyz
Slide 44
Thank you! Metrics
Open Standards
Traces
Logs @phennex
kaspernissen.xyz