Skip to content

Refs #1849: document the AWS SDK HTTP client conflict on Confluent Platform images - #1851

Merged
oscerd merged 1 commit into
apache:mainfrom
oscerd:fix/1849
Oct 27, 2026
Merged

oscerd merged 1 commit into
apache:mainfrom
oscerd:fix/1849

Conversation

@oscerd

@oscerd oscerd commented Oct 27, 2026

Copy link
Copy Markdown
Contributor

Refs #1849. The issue stays open until CKC moves to a Camel release with the fix (CAMEL-26343).

Problem

On Confluent Platform cp-kafka-connect images, the 4.22.0 AWS connectors fail when the task starts:

java.util.ServiceConfigurationError: software.amazon.awssdk.http.SdkHttpService: software.amazon.awssdk.http.apache.ApacheSdkHttpService not a subtype

The image puts its own AWS SDK on the worker classpath (/usr/share/java/kafka-serde-tools, with the classic apache-client). The plugin class loader also returns the worker's META-INF/services registration. Since Camel 4.22.0 (CAMEL-23866) the connectors ship only apache5-client, so ApacheSdkHttpService loads from the worker and the AWS SDK lookup fails. 4.18.x shipped apache-client itself, which hid the problem.

Change

This adds an "AWS connectors on Confluent Platform images" entry under Known Incompatibilities in contributor-guide/troubleshooting.adoc. It gives the symptom, the cause and three workarounds:

  • Add apache-client 2.50.2 and its dependencies to the connector directory. Verified in cp-kafka-connect:8.2.4 with the reporter's configuration, as far as the first S3 call.
  • Set software.amazon.awssdk.http.service.impl in KAFKA_OPTS. This applies to the whole worker JVM.
  • Remove the image's apache-client jar, when nothing else on the worker uses that AWS SDK.

The fix belongs in Camel. CAMEL-26343 (apache/camel#28563) makes the AWS components set their HTTP client themselves. CKC gets it with the Camel 4.22.x release that contains it.

This is a docs-only change, so there is no build or test run. The commit title uses Refs #1849 rather than Fix #1849 so that merging this does not close the issue.

Claude Code on behalf of Andrea Cosentino

🤖 Generated with Claude Code

…ent Platform images

AWS connectors 4.22.0 fail on cp-kafka-connect images with
"ServiceConfigurationError: ... ApacheSdkHttpService not a subtype": the
image's own AWS SDK (kafka-serde-tools) registers the classic apache-client
on the worker classpath, which the plugin can see. Add a Known
Incompatibilities entry with the cause and three workarounds. The Camel
fix is CAMEL-26343.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Andrea Cosentino <ancosen@gmail.com>
@oscerd
oscerd requested review from Croway and orpiske October 27, 2026 12:26
@oscerd
oscerd merged commit 63dadf1 into apache:main Oct 27, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants