[Java] Akka 10.2.1 Java Agent APM Transactions Missing

Hello,

akka-http-core version 10.2.1 is not generating apm transactions using java agent 6.1.0.

Please update agent support as able. Thank you!

Looking at https://docs.newrelic.com/docs/agents/java-agent/getting-started/compatibility-requirements-java-agent and the instrumentation modules at https://github.com/newrelic/newrelic-java-agent/tree/main/instrumentation there is built in instrumentation for Akka 10.

Try pushing traffic through those calls while generating verbose logs using https://docs.newrelic.com/docs/agents/java-agent/troubleshooting/generate-debug-logs-troubleshooting-java. Is the agent loading the instrumentation and is it showing it sees the calls?

Hi Jeanie! Sorry for my super lean request, here’s some more useful context!

Not sure if you have access to https://support.newrelic.com/tickets/430194 , but I actually had worked through a support case. Ticket has a lot of context & debug logs+, but the short version is that the docs are not correct.

I believe there is some dev work on your side to get things working again.

Results of https://github.com/newrelic/newrelic-java-agent#instrumentation-module-tests show failures for 10.2.1:

Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.2.1

Here’s the full instrumentation test output:

Task :buildSrc:compileJava UP-TO-DATE
Task :buildSrc:compileGroovy NO-SOURCE
Task :buildSrc:processResources NO-SOURCE
Task :buildSrc:classes UP-TO-DATE
Task :buildSrc:jar UP-TO-DATE
Task :buildSrc:assemble UP-TO-DATE
Task :buildSrc:compileTestJava NO-SOURCE
Task :buildSrc:compileTestGroovy NO-SOURCE
Task :buildSrc:processTestResources NO-SOURCE
Task :buildSrc:testClasses UP-TO-DATE
Task :buildSrc:test NO-SOURCE
Task :buildSrc:check UP-TO-DATE
Task :buildSrc:build UP-TO-DATE
Task :agent-bridge:requiresJava7
Task :agent-bridge:requiresJava8
Task :newrelic-api:requiresJava7
Task :newrelic-api:requiresJava8
Task :newrelic-api:compileJava UP-TO-DATE
Task :newrelic-weaver-api:requiresJava7
Task :newrelic-weaver-api:requiresJava8
Task :newrelic-weaver-api:compileJava UP-TO-DATE
Task :agent-bridge:compileJava UP-TO-DATE
Task :instrumentation:akka-http-cor.0.11:requiresJava7
Task :instrumentation:akka-http-core-10.0.11:requiresJava8
Task :instrumentation:akka-http-core-10.0.11:compileJava NO-SOURCE
Task :instrumentation:akka-http-core-10.0.11:compileScala UP-TO-DATE
Task :instrumentation:akka-http-core-10.0.11:processResources NO-SOURCE
Task :instrumentation:akka-http-core-10.0.11:classes UP-TO-DATE
Task :newrelic-weaver:requiresJava7
Task :newrelic-weaver:requiresJava8
Task :newrelic-weaver-scala-api:requiresJava7
Task :newrelic-weaver-scala-api:requiresJava8
Task :newrelic-weaver-scala-api:compileJava UP-TO-DATE
Task :newrelic-weaver:compileJava UP-TO-DATE
Task :instrumentation-build:compileJava UP-TO-DATE
Task :instrumentation-build:processResources NO-SOURCE
Task :instrumentation-build:classes UP-TO-DATE
Task :newrelic-weaver:processResources UP-TO-DATE
Task :newrelic-weaver:classes UP-TO-DATE
Task :newrelic-weaver:jar UP-TO-DATE
Task :newrelic-weaver-api:processResources NO-SOURCE
Task :newrelic-weaver-api:classes UP-TO-DATE
Task :newrelic-weaver-api:jar UP-TO-DATE
Task :newrelic-weaver-scala-api:processResources NO-SOURCE
Task :newrelic-weaver-scala-api:classes UP-TO-DATE
Task :newrelic-weaver-scala-api:jar UP-TO-DATE
Task :instrumentation-build:shadowJar UP-TO-DATE
Task :instrumentation:akka-http-core-10.0.11:writeCachedWeaveAttributes UP-TO-DATE
Task :instrumentation:akka-http-core-10.0.11:jar UP-TO-DATE
Task :instrumentation:akka-http-core-10.0.11:verifyInstrumentation UP-TO-DATE
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.2.0-M1
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.9
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.5
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.7
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.3
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.4
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.6
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.8
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.2
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.10
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.11
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.0-RC1
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.12
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.0-RC2
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.1
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.1.0
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.0.15
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.0.14
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.8
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.0.12
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.9
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.0.11
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.12_10.0.13
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.7
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.6
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.2
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.5
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.4
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.3
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.11
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.12
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.10
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.1
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.0-RC1
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.0
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.1.0-RC2
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.0.15
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.0.14
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.0.13
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.0.12
Task :instrumentation:akka-http-core-10.0.11:verifyPass_classpath
Task :instrumentation:akka-http-core-10.0.11:verifyPass_com.typesafe.akka_akka-http-core_2.11_10.0.11
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.2.0-RC2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.2.1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.2.0-RC1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.9
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.2.0
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.8
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.6+7-e2ba6752
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.6
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.7
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.4
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.5
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.3
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.10
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.0-RC2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.12_10.0.0
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_3.0.0-RC1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.9-RC2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.9
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.9-RC1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.8
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.6
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.7
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.5
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.4
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.2-RC1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.2-RC3
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.2-RC2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.3
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.11.2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.11.1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.11
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4-ARTERY-M4
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4.10
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4-ARTERY-M2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4-ARTERY-M3
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_2.4-ARTERY-M1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.9
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.7
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.8
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.6+7-e2ba6752
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.6
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.5
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.4
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.3
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.10
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.0
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core_2.11_10.0.0-RC2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.11_2.0.5
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.11_2.0.4
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.11_2.0.3
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.11_2.0.2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.11_2.0.1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.11_2.0-M2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.11_2.0
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.11_2.0-M1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.11_1.0
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.10_2.0.5
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.10_2.0.4
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.10_2.0.3
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.10_2.0.2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.10_2.0.1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.10_2.0-M2
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.10_2.0-M1
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.10_2.0
Task :instrumentation:akka-http-core-10.0.11:verifyFail_com.typesafe.akka_akka-http-core-experimental_2.10_1.0
BUILD SUCCESSFUL in 20s
138 actionable tasks: 124 executed, 14 up-to-date

@jobi-carter I reviewed the ticket in addition to your comment. Now that the Java agent is open source, you can submit an issue at https://github.com/newrelic/newrelic-java-agent/issues with the great information you provided.

I’ll do so then, thank you!

Thanks @Jeanie_Swan for the support here! @jobi-carter please let us know how you resolved your issue or feel free to reach out again if you need further help :slightly_smiling_face:

The temporary solution we’ve gone with is downgrading to akka 10.1.12. If we need to upgrade to a later version, then adding custom instrumentation will be a possible workaround.

Nothing else needed at the moment :crossed_fingers: Thanks!