11.3 Change Version

Monitoring applications with distributed tracing

Event Streams 10.3.0 and later versions are built on Strimzi. Strimzi 0.14.0 and later support distributed tracing based on the open-source OpenTracing and Jaeger projects.

Distributed tracing provides a way to understand how applications work across processes, services, or networks. Tracing uses the trail they leave behind based on requests made, carrying tracing information in the requests as they pass from system to system. Through tracing, you can monitor applications that work with Event Streams, helping you to understand the shape of the generated traffic, and pinpoint the causes of any potential problems.

To use distributed tracing for your Kafka client applications, you add code to your applications that gets called on the client’s send and receive operations. This code adds headers to the client’s messages to carry tracing information.

OpenTelemetry tracing with Instana

OpenTelemetry (OTel) aims to simplify and automate the collection and analysis of telemetry data by providing a unified and extensible instrumentation framework that can be integrated into any application or infrastructure component.

Integrating OpenTelemetry with Event Streams can provide a powerful way to gain real-time insights into the performance and behavior of your event-driven applications. By streaming telemetry data to Event Streams, you can monitor the health of your applications, troubleshoot issues quickly, and optimize your applications for better performance.

IBM Instana supports OpenTelemetry for collecting distributed traces, metrics, and logs from various sources. Instana can seamlessly integrate with OpenTelemetry and can also enhance the data from OpenTelemetry. As an observability backend for OpenTelemetry, use Instana to monitor and analyze the performance and health of your applications in real-time.

There are two ways to ingest the generated OpenTelemetry traces and metrics with Instana: by using the Otel collector or by using an Instana host agent.

Note: The OpenTelemetry operator available for the OpenShift Container Platform does not support Instana as an exporter while using the Otel collector. To collect OTel trace details on an OpenShift deployment of Event Streams, use an Instana host agent as described in the following sections.

Configuring the host agent and OpenTelemetry

Instana host agent for OpenTelemetry is a powerful tool for collecting and analyzing telemetry data from hosts, infrastructure, and various applications.

Use the host agent to seamlessly integrate OpenTelemetry data into the Instana observability platform, providing a unified view of telemetry data, which you can use to analyze and troubleshoot issues quickly and efficiently.

To configure the host agent and OpenTelemetry:

Install and configure an Instana host agent for Event Streams.
Configure OpenTelemetry to send tracing and metric data to the Instana host agent.

Enabling OpenTelemetry tracing

You can enable OpenTelemetry tracing for the following components in Event Streams:

Kafka Connect
Kafka Bridge

To enable OpenTelemetry tracing:

Enable OpenTelemetry by setting the spec.tracing.type property to opentelemetry in the custom resource for the selected component as follows (KafkaConnect and KafkaBridge):
```
spec:
    # ...
    tracing:
      type: opentelemetry
```

Configure the tracing environment variables in spec.template for the required custom resource as follows:

Configuration for Kafka Bridge:

spec:
  #...
  template:
    bridgeContainer:
      env:
        - name: OTEL_SERVICE_NAME
          value: <instana-agent-service-name>
        - name: OTEL_EXPORTER_OTLP_ENDPOINT
          value: <instana-agent-address>
    tracing:
      type: opentelemetry

Configuration for Kafka Connect:

spec:
  #...
  template:
    connectContainer:
      env:
        - name: OTEL_SERVICE_NAME
          value: <instana-agent-service-name>
        - name: OTEL_EXPORTER_OTLP_ENDPOINT
          value: <instana-agent-address>
  tracing:
    type: opentelemetry

For more information about tracing in Apache Kafka and OpenTelemetry, see the Strimzi documentation.