Skip to content

feat(kafka): New Kafka utility #1898

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 42 commits into from
Jun 18, 2025
Merged

feat(kafka): New Kafka utility #1898

merged 42 commits into from
Jun 18, 2025
+7,413 −21

Conversation

phipag
Copy link
Contributor

@phipag phipag commented Jun 18, 2025 •
edited
Loading

Issue #, if available: #1897

Description of changes:

  • Adds a new Kafka utility to the library which is useful for processing events from Kafka.

E2E tests ✅ https://github.com/aws-powertools/powertools-lambda-java/actions/runs/15732235461

Checklist

phipag added 30 commits May 15, 2025 16:54
@phipag
Add initial code for KafkaJson and KafkaAvro request handlers.
9900ab3
@phipag
Add deserialization via @Deserialization annotation.
47cbc76
@phipag
Add TODOs in code.
680b979
@phipag
Fix typos and make AbstractKafkaDeserializer package private.
15f2923
@phipag
Merge phipag/kafka-event from public repository into feature/kafka
7c4bf30
@phipag
Remove request handler implementation in favor for @Deserialization a…
6ac583f 
…nnotation.
@phipag
Parse Timestamp type correctly.
92ae6ab
@phipag
Remove custom RequestHandler implementation example.
8e13dd6
@phipag
Merge branch 'main' into feature/kafka
623585a
@phipag
Make AspectJ version compatible with min version Java 11.
5ea6d49
@phipag
Clarify exception message when deserialization fails.
73e64e4
@phipag
Add more advanced JSON escpaing to JSONSerializer in logging module.
cbe9181
@phipag
Add protobuf deserialization logic and fully working example.
64e7080
@phipag
Add Maven profile to compile a JAR with different dependency combinat…
f081424 
…ions.
@phipag
Add minimal kafka example.
e11db9a
@phipag
Add missing copyright.
4282a77
@phipag
Add unit tests for kafka utility.
64f7e18
@phipag
Add minimal kafka example to examples module in pom.xml.
1191c56
@phipag
Add some comments.
db9b989
@phipag
Update powertools-examples-kafka with README and make it more minimal…
b64dcbd 
…istic. Remove powertools-examples-kafka-minimal.
@phipag
Implement PR feedback from Karthik.
4624c12
@phipag
Fix SAM outputs.
598cc27
@phipag
Do not fail on unknown properties when deserializating into KafkaEvent.
92f6f8f
@phipag
Merge branch 'main' into feature/kafka
7fcc989
@phipag
Allow customers to bring their own kafka-clients dependency.
77845af
@phipag
Add Kafka utility documentation.
e4875d8
@phipag
Update project version consistently to 2.0.0.
767109b
@phipag
fix: Fix bug where abbreviated _HANDLER env var did not detect the De…
3e6a8b7 
…serialization annotation.
@phipag
fix: Bug when trying to deserialize a type into itself for Lambda def…
ef04849 
…ault behavior. We can just return the type itself. Relevant for simple String and InputStream handlers.
@phipag
When falling back to Lambda default, handle conversion between InputS…
6da89a3 
…tream and String.
leandrodamascena
leandrodamascena requested changes Jun 18, 2025
View reviewed changes
Copy link
Contributor

@leandrodamascena leandrodamascena left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @phipag great work here! Please replace all System.out.printf with Powertools Logger.

leandrodamascena
leandrodamascena reviewed Jun 18, 2025
View reviewed changes
@sonarqubecloud SonarQubeCloud
Copy link

Quality Gate Passed Quality Gate passed

Issues
0 New issues
16 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
1.3% Duplication on New Code

See analysis details on SonarQube Cloud

@phipag
Copy link
Contributor Author

phipag commented Jun 18, 2025

Hey, thanks @leandrodamascena. I implemented your requested changes.

@leandrodamascena leandrodamascena self-requested a review June 18, 2025 16:11
leandrodamascena
leandrodamascena approved these changes Jun 18, 2025
View reviewed changes
Copy link
Contributor

@leandrodamascena leandrodamascena left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

AMAZING WORK @phipag! Ship it!!!

APPROVED!

@phipag phipag merged commit eebc06a into main Jun 18, 2025
14 of 15 checks passed
@phipag phipag deleted the feature/kafka branch June 18, 2025 17:02
@github-project-automation github-project-automation bot moved this from Pending review to Coming soon in Powertools for AWS Lambda (Java) Jun 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@leandrodamascena leandrodamascena leandrodamascena approved these changes

Assignees

@phipag phipag

Labels
feature-request New feature or request size/XXL
Projects
Powertools for AWS Lambda (Java)
Status: Coming soon
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Feature request: Add support for deserializing Kafka records
2 participants
@phipag @leandrodamascena