Load Balancing Work Load Among Sinks In A Jetstream Application

Often there is a need to distribute the event processing work load among a set of processors with in an application. The EsperProcessor developed by us is single threaded. The time window support in Esper is also using a single timer thread. This could be limiting in a number of scenarios where there are more cores available on the node to process the work load but cannot be utilized because of the threading model of the EsperProcessor. Other processor implementations might have similar issues. In such situations it becomes necessary to deploy multiple instances of EsperProcessor or other processors with in the application instance and distribute event processing among these instances.

To enable this the framework provides 2 processors Viz. RoundRobinLoadbalancer & PartitionedLoadbalancer. These processors can be deployed between an event source and its sinks.