When trying the code from the Ray Summit I get the following error:
AttributeError: 'MultiAgentArena' object has no attribute '_agent_ids'.
Adding "self._agent_ids = ["agent1", "agent2"] manually resolves that error,
but the agent returns no actions to the environment during training (perhaps related, maybe two sep. issues)