Ideal OTeL Configurations for Bare-Metal and Kubernetes (Part 2)

PublishedJuly 23, 2024

•3 min read•View as Markdown

Ideal OTeL Configurations for Bare-Metal and Kubernetes (Part 2)

Praneet Sharma

Comments

Join the discussion

No comments yet. Be the first to comment.

More from this blog

"World Modeling" across Disparity

An SRE agent starts every investigation missing the same thing: a model of how the system is wired. Which services call which, what each one reads from, where workloads are co-resident, how much redun

Jun 14, 20264 min read

Minimal vulnerability and easy OpenClaw with Omlet OS

OpenClaw's role as a constantly running agent that performs various encoded tasks has been exciting. Its focus on prioritizing communication channels and its strong emphasis on sessions are particularly noteworthy. However, security concerns have inc...

Feb 17, 20261 min read

Minimal vulnerability and easy OpenClaw with Omlet OS

AI Observability Agents as "Platform Experts"

As AI agents flood the enterprise software landscape, companies must integrate their existing data hubs. In the data analytics world, this can include platforms like Snowflake. In CRM / front-office land, platforms like Salesforce. In Observability, ...

Dec 1, 20252 min read

AI Observability Agents as "Platform Experts"

Agentic AI Workflows for SRE / DevOps

There have been several posts about AI SRE solutions being deployed in a "fire and forget" manner, even for complex setups. One post that tested this idea is from the Clickhouse team. They concluded that "Models are not ready" and needed guidance thr...

Aug 25, 20252 min read

Omlet MCP

A while ago, we explored different LLM use cases through “Skillet”. During our experiments, we quickly realized the advantages of using tools, precise integration with observability data sources, and sparse tokenization. The ecosystem has been evolvi...

Jul 18, 20252 min read

OMLET: Open Metrics Logs Events Traces

21 posts

opentelemetry-collector: presets: logsCollection: enabled: true kubernetesAttributes: enabled: true kubeletMetrics: enabled: true hostMetrics: enabled: true clusterMetrics: enabled: true kubernetesEvents: enabled: true

Kubernetes Attributes

The Kubernetes Attributes Processor is probably considered the most important component. It specifically adds Kubernetes context to telemetry for effective correlation and filtration. Additional options should also be examined for further metadata extraction:

opentelemetry-collector: presets: kubernetesAttributes: enabled: true # When enabled the processor will extra all labels for an associated pod and add them as resource attributes. # The label's exact name will be the key. extractAllPodLabels: false # When enabled the processor will extra all annotations for an associated pod and add them as resource attributes. # The annotation's exact name will be the key. extractAllPodAnnotations: false

This is recommended for most deployments to maximize metadata decoration. In our minimal example we can expect these attributes by default:

Config Section

Beyond the presets, within the values.yaml, one can provide specific configurations in the config section:

opentelemetry-collector: presets: kubernetesAttributes: enabled: true kubeletMetrics: enabled: true hostMetrics: enabled: true clusterMetrics: enabled: true kubernetesEvents: enabled: true config: receivers: kubeletstats: insecure_skip_verify: true extensions: bearertokenauth: token: $API_KEY exporters: otlphttp/example: endpoint: "https://intake.test_domain.com" auth: authenticator: bearertokenauth service: pipelines: traces: exporters: [spanmetrics, otlphttp/example] metrics: exporters: [otlphttp/example] logs: exporters: [otlphttp/example] extensions: [health_check, bearertokenauth] telemetry: metrics: level: "none"

In this configuration example, we are defining exporter configurations with authentication. Additionally, we are modifying the kubeletstatsreceiver from the preset, and adding a config option (insecure_skip_verify: true).

Ideal OTeL Configurations for Bare-Metal and Kubernetes (Part 2)

Comments

More from this blog

"World Modeling" across Disparity

Minimal vulnerability and easy OpenClaw with Omlet OS

AI Observability Agents as "Platform Experts"

Agentic AI Workflows for SRE / DevOps

Omlet MCP

Logs Collection

Kubernetes Attributes

Kublet Metrics

Host Metrics

Cluster Metrics

Kubernetes Events

Config Section

Conclusion

Command Palette

Comments

More from this blog

Logs Collection

Kubernetes Attributes

Kublet Metrics

Host Metrics

Cluster Metrics

Kubernetes Events

Config Section

Conclusion