Feat: Request Hedging Tool

[tebanieo]

Customers that have latency sensitive applications use techniques such as request hedging to reduce their tail latency. Request hedging consists in sending two or more request for the same operation, if t he first operation has a delayed processing the second operation it is likely to respond faster than the first one.

This enhancement request is to include a sample implementation of request hedging that customers can re-use to bootstrap their development.

[Dondehip]

Hi, I already have built an proof of concept code for this and happy to contribute to the community.