Amazon DynamoDB Table migration project

[tebanieo]

DynamoDB Migration project

We need a project that helps with the migration of DynamoDB tables. In the DynamoDB Documentation we have a guide on how to do it, but up to date there is no a project/tool that assist with this task, leaving users designing the solution on their own.

The concept is very simple, migrate a DynamoDB table with near zero downtime.

The project/solution/tool will:

• Use CDK as it is easy to convert into a L3 construct that can be imported and re-used.
• Prefer serverless components.
• Not interfere with the source DynamoDB table performance.
• Only migrate the DynamoDB table data, and it will continue to replicate changes (Change Data Capture) to the destination.
• Will have different stages of support for different request rates (throughput).
• Not loose CRUD operations, it is mandatory that 100% of the updates are processed.
• Process the Updates in the same order as in the source table.
• Be eventual consistent (near-real time).

Dear community feel free to add more requirements, or comments as you see fit.

Thanks!

Tasks

Preview Give feedback

1. Use CDK as it is easy to convert into an L3 construct that can be imported and re-used
2. Prefer serverless components
3. Avoid interference with the Source DynamoDB table performance
4. Migrate table data only, continue to replicate CDC (Change data capture) to the destination
5. Avoid loosing CRUD operations, 100% success rate.
6. Process the updates in the same order than the source table.
7. The solution is eventual consistent
8. Add support for different throughput requirements

[terhunej]

.