Skip to content

[Bug] The traceId get from logstash are all mixed up accross multiple tomcat threads #7808

Description

@whohasthis

Search before asking

  • I had searched in the issues and found no similar issues.

Apache SkyWalking Component

Java Agent (apache/skywalking-java)

What happened

We use TraceIdJsonProvider of apm-toolkit-logback-1.x to add the trace id into the logstash fields sent to ELK, we are expecting to use the trace id to get all related log message throughout all services that the trace id involves.

Below is the logback config part related to the trace id logstash appender


logstash.:5045


{
"service" : {
"category" : "xxx",
"type" : "xxxxx",
"name" : "xxx-xxx-xx"
}
}



But somehow the trace ids are all mixed up, we are seeing that one trace id associated to many different tomcat thread name in the same short period of time, below are part of the result we found on ELK

elk-traceid

What you expected to happen

We expect to get one trace id per one thread name during the same period of time, not all mixed up accoss many different thread names.

How to reproduce

We use skywalking 8.4.0, OS centos 6.7,
Skywalking OAP server is running on K8S env, using ES 6.7 as the storage.
The service is running on tomcat 8.5.65 with spring MVC framework.

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Activity

  1. added
    bugSomething isn't working and you are sure it's a bug!
    on Sep 26, 2021
  2. locked and limited conversation to collaborators on Sep 26, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working and you are sure it's a bug!

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions