266 questions
1
vote
1
answer
151
views
Prevent trace exports for the Metrics endpoint with OpenTelemetry
I have this easy setup in my ASP.NET Core web app:
using Microsoft.AspNetCore.Hosting;
using Microsoft.AspNetCore;
using Microsoft.Extensions.Configuration;
using Microsoft.Extensions....
- 37.4k
0
votes
1
answer
50
views
tracing in spring boot application using sleuth
I have an already existing spring boot application, i am trying to add sleuth dependency into it, But due to the auto-config feature of sleuth it tries to override existing beans for jdbc,kafka,redis ...
- 118
0
votes
0
answers
48
views
How to fail a trace when @Valid fails in Spring Boot
I would like to fail a trace when the validation @Valid of the request payload fails.
@Autowired MyService myService;
@PostMapping("/validate")
String question(@Valid @...
- 5,418
0
votes
0
answers
86
views
Jaeger Tracing with Kafka in Spring Boot - Kafka spans not visible in Jaeger UI
I'm working on integrating Jaeger tracing (v2) into my Spring Boot microservices which use Kafka for messaging. The tracing integration is partially working — I can see the API calls and database ...
0
votes
0
answers
37
views
Enabling tracing in Spring RSocket client
There is a RSocket server which I am interacting with. This RSocket server has tracing enabled.
Meaning, when I, and actually other clients talk to it, I can see server side traces in Grafana Cloud ...
- 21
0
votes
1
answer
183
views
Azure Durable Function Distributed Tracing, How to hide Storage related tasks
Is there a way to hide the microsft table activity when viewing the full length of the distributed trace...
If I have dozens of sub activities and orchestrations, having this additional noise is ...
- 2,101
0
votes
1
answer
73
views
why Console print spans in reverse order?
namespace WeatherForecastSimpleTracing
{
public class Program
{
public static void Main(string[] args)
{
var builder = WebApplication.CreateBuilder(args);
...
- 117
1
vote
1
answer
300
views
Trace context not propagating between microservices using micrometer with openfeign
My structure log is Logstash, and I see my trace ID in every microservice log. However, my trace ID is not the same in all requests between microservices.
How can I ensure that trace context (...
0
votes
1
answer
104
views
Using W3C baggage keys for routing in RabbitMQ headers exchange
I use RabbitMQ as a message broker to enable data producers and consumers to communicate, and today I'd like to introduce OpenTelemetry's notions of tracing into them. So I did my implementation and ...
0
votes
0
answers
55
views
Issue getting Spark Structured Streaming Kafka headers as JSON
I would like to get the Kafka header as JSON when using Spark Structured Streaming with Kafka consumer.
We have several Kafka producers that produce messages to one Kafka topic.
There is a Go producer,...
- 5,418
0
votes
0
answers
137
views
How to Add OpenTelemetry Tracing to NiFi Custom Processors?
I have a NiFi flow that includes various custom processors to collect data from Kafka, perform calculations, and store results in a database. I want to add OpenTelemetry tracing to gain better ...
- 197
0
votes
0
answers
97
views
Same trace_id is being propagated using @microsoft/applicationinsights-web
I'm working on end-to-end transaction
Frontend: React.js
Backend: Node.js
app-insights.ts
import {
ApplicationInsights,
DistributedTracingModes,
} from "@microsoft/applicationinsights-web&...
- 1,120
0
votes
0
answers
127
views
Grafana tempo / faro - joining traces
I'm relatively new to tempo but I have setup a faro -> alloy -> tempo flow which joins traces from my otel traces from my backend process, this works well, but what I would like to see a trace ...
- 492
1
vote
1
answer
2k
views
What's the difference between OpenTelemetry and Sentry?
What's the difference between OpenTelemetry and Sentry?
At first glance they look similar with regarding to tracing, logs etc.
However, there should difference between them
- 1,797
0
votes
0
answers
39
views
Jaeger Collector not reports jaeger_collector_queue_length
I have deployed jaeger collector v1.66 and jaeger ui 1.66 which are pointing to elastic search cluster. I want to test the throughput of the infrastructure but some of the key metrics are not reported ...
- 1,424
3
votes
0
answers
154
views
Azure Message-Triggered Logic App Workflow Open Telemetry Distributed Tracing with Data Dog
I have an issue with Open Telemetry distributed tracing and Service Bus Message-triggered Logic App Workflows. We have OTEL and distributed tracing in Azure involving Web APIs, Azure Functions and ...
- 33
0
votes
1
answer
58
views
Tracing lifetime of an object in a distributed system
I want to trace the lifetime of an object that can exist for quite a long time and be processed by multiple microservices. Objects are not linked to any request, so the standard scheme with "...
- 137
1
vote
0
answers
46
views
Grpc tracing in Flutter with Embrace.io
I need to trace GRPC calls in Flutter using Embrace.io.
I can succesfully manage to export the OTEL traces to Grafana but, in order to make the traces being aggregated with others, the network call ...
- 11
1
vote
1
answer
695
views
How to add http request body to tracing span?
I want to add request body to my tracing spans for easier debugging when issues occur.
Here's my current tracing configuration.
var resourceBuilder = ResourceBuilder.CreateDefault()
...
- 3,651
0
votes
0
answers
116
views
Problem in Distributed Tracing over WebSocket with STOMP: Transitioning from Sleuth to Micrometer, Trace IDs and Span IDs does not appear
I have been working on a project implemented using Spring Boot 2.7.8. The WebSocket protocol was chosen to handle real-time messaging, and STOMP over WebSocket is used for effective client-server ...
0
votes
0
answers
184
views
Correlate traces for spans sent in parallel for Springboot micrometer
I have a Springboot 3.4 web service with micrometer
The endpoint is straightforward, the controller accepts a list of messages to be sent to an external rest API I have no control over. The processing ...
- 5,418
2
votes
0
answers
167
views
Propagate/continue the traces from a client sending traces via custom headers in Springboot 3.4
We have a Springboot 3.4 web service with micrometer, serving traffic for two clients.
Client one, we are lucky, is also using Springboot 3+. Like magic, Springboot is able to "propagate", &...
- 5,418
0
votes
0
answers
106
views
How to send traces to Elastic Cloud APM using OpenTelemetry OTLP (without using the Collector) in nodejs
I am trying to send distributed traces to Elastic Cloud APM and because I want to be able to send traces originating from multiple services, I cannot use elastic-apm-node as it only supports only a ...
- 818
0
votes
0
answers
69
views
OpenTelemetry: Span for Message Delivery Time Between two Services
I'm trying to trace an application based on the actor model (independent units communicating using messaging).
Each actor is modeled as a service, and I'm sending the SpanContext with each message.
I'...
0
votes
0
answers
41
views
trace_id is not passed to worker threads using opentelmnetry with jaeger
I am trying to integrate my service with opentelmentry to trace the service flow .
Tracing tool : Yaeger
Note : I cannot go with javaagent becuase yaeger-exporter is not supoprted in latest version of ...
- 15
0
votes
0
answers
29
views
.NET Azure Function Kafka Propagator
I am using latest .NET 9 for Azure Function and want to use distributed tracing accorss different Kafka messages that are created by Azure Functions and are read by other Azure Functions.
So far I am ...
- 2,302
1
vote
1
answer
268
views
Datadog ingest only 1% of span, DD_SPAN_SAMPLING_RULES is not working
I am developing a microservice using ASP.NET Core. We are using Datadog.Tracer library for distributed traces & span. Currenlty it is collecting all the spans and traces. I only want 1% of spans ...
- 1,968
2
votes
1
answer
1k
views
How to extend micrometer observation context in Spring Boot
I have read the Spring blog post Observability with Spring Boot 3 and Micrometer manual. But the examples are too simple, showing how to start a new observation:
ObservationRegistry registry = ...
- 1,902
0
votes
1
answer
43
views
Tracing data consumption
I need to implement distributed-tracing for our applications hosted on OpenShift. We have many projects, some with a user count < 100 and some > 1000 and greater.
We do need to estimate how much ...
0
votes
1
answer
282
views
New Trace and Span Generated even after using TraceId and SpanID from Remote Context
I am injecting the spanId and traceId flowing via HTTP header to to build a remote context and creating new Span, however the new span does not get the parent trace and span but created its own trace ...
- 6,009
0
votes
1
answer
1k
views
Spring boot 3 open telemetry how does the trace id propagation takes place
I am trying to implement observations and monitoring in my local application.
I have a question that how is the trace id propagated from one application to another application. specifically how or ...
- 658
-1
votes
1
answer
53
views
OpenTelemetry Java Agent extension not loaded
I have created a simple, dummy OpenTelemetry Java Agent extension. It contains only one class and it looks like this:
import com.google.auto.service.AutoService;
import io.opentelemetry.sdk....
- 10.2k
0
votes
0
answers
873
views
Error in OpenTelemetry With Istio: sending queue is full
I'm using OpenTelemetry as a tracing collector in istio, but after running OpenTelemetry Collector for a while, the logs for istio-ingressgateway and the logs for Sidecar (istio-proxy) in the Pod keep ...
0
votes
1
answer
280
views
Receive logs, traces and metrics from the same receiver and forward them to different backends
I have deployed an open-telemetry collector in Kubernetes with the helm chart.
It takes data from several services running a java agent that ships logs, metrics and traces in otlp format.
I want to ...
- 377
0
votes
1
answer
200
views
Retrieve HTTP requests statistics with Grafana / Prometheus / Tempo
I'm trying to monitor a java application deployed on several Kubernetes Deployments.
So far I've managed to ship
logs to Loki using Promtail
Kubernetes metrics to Prometheus using the operator
...
- 377
1
vote
1
answer
3k
views
How to log traces in Opentelemetry Collector to stdout
we're using an OTel collector to funnel and sample traces from several microservices. We would like to log those traces (the actual trace) as single-line JSONs, crucially including attributes, to ...
- 101
1
vote
0
answers
1k
views
Set custom trace ID with Spring Boot 3, Micrometer and OTEL
I have two proprietary microservices (A and B) and a third-party one (C), both consuming and producing Kafka events.
A produces event1, and B consumes it.
B processes event1 and eventually delegates ...
1
vote
0
answers
127
views
How to start new span inside RabbitMQ listener?
I am trying to find out ways to add tracing when RabbitMQ consumer consumes message from queue and starts processing.
Here is the flow:
Webhook data received -> gateway server -> inbox-service -&...
- 91
2
votes
1
answer
1k
views
Grouping multiple traces in OpenTelemetry
I have a request 'Get a list of books', the request contains a uniqueId, the API creates a new Trace using StartActivity.
I have another request 'Buy book', the request contains the same uniqueId as '...
0
votes
1
answer
464
views
quarkus opentelemetry not propagating the traces to the smallrye-messaging consumer of another quarkus microserice
I have 2 quarkus applications, microserviceA, microservieB.
having below dependency with other required dependencies in both the services,
implementation 'io.quarkus:quarkus-smallrye-reactive-...
- 191
1
vote
1
answer
2k
views
Exporting OpenTelemetry data in node.js to OTLP endpoint AND to local console
I am super impressed by the OpenTelemetry project and would like to learn more about it and experiment with it. This is super flexible and I am not even locked in to a vendor.
Currently I am working ...
- 21
0
votes
1
answer
80
views
Node.js - AWS X-Ray and Elasticsearch Client, are these compatible?
Is it possible to instrument a node.js application with AWS X-ray SDK simply by using the client wrapper without having to use segments and subsegments? The app is sort of legacy and it is using @...
- 159
1
vote
1
answer
1k
views
How to configure Badger DB for Jaeger all-in-one deployment using config file on Windows server
I am trying to setup jaeger-all-in-one on one windows server [without Docker] with Badger DB for persistent storage to test it.
Used the following config file to run the Jaeger by command
jaeger-all-...
- 574
1
vote
1
answer
77
views
why Activity.Id has two leading 0s and trailing 01?
using (Activity activity = source.StartActivity("demo"))
{
Console.WriteLine(activity?.Id);
}
the output is something like 00-bbd8c75b04cda7f7fe9ee03b54b2d7ba-72dc8c0dc24fc406-01
and it ...
- 429
1
vote
0
answers
177
views
What instrumenting module name should I use with Opentelemetry tracer provider?
The documentation suggests:
instrumenting_module_name (str) –
The uniquely identifiable name for instrumentation scope, such as instrumentation library, package, module or class name. __name__ may ...
- 3,234
1
vote
0
answers
283
views
Filtering Azure API Management Logs for Ingested Tracing in Dynatrace (2xx-4xx-5xx Response Code)
I'm successfully collecting ingested traces from my Azure API Management (APIM) using Application Insights and OpenTelemetry (OTLP) integration with Dynatrace SaaS. However, I'm unable to filter the ...
- 1,201
-1
votes
1
answer
795
views
Running OTEL agent as windows service is not working
Want to run Otel collecor agent as Windows services. So downloaded latest windows release package and run the following command to create service and start the service.
> sc.exe create otelcol ...
- 574
2
votes
1
answer
1k
views
TraceId and Span are empty in async task logs
I have a REST endpoint in springboot which calls an external api async multiple using CompleteableFuture. The external api is called using resttemplate in Completeablefuture.supplyAsync(() => ...
- 65
1
vote
1
answer
339
views
Does quarkus reactive sql client support tracing?
I was trying to enable jdbc tracing in my quarkus service.
I had quarkus.datasource.jdbc.tracing=true in the property file, and implementation "io.opentracing.contrib:opentracing-jdbc:0.2.15"...
- 3,090
0
votes
1
answer
2k
views
How to create a recording Span given a parent Span's traceId and spanId?
The data flow I am trying to instrument has a variety of in-band mechanisms for propagating context (SQS, Kinesis messages, entries written in a DB, etc.) In the process of manually instrumenting some ...
- 4,000