Working Memory

[thopkins32]

Working memory as it exists in the human brain operates on the timespan of a few seconds. A potential implementation of something similar to this for our agent would be to hold the previous $n$ tensors in a buffer and use an attention mechanism to mix the information with the incoming tensor.

This can be used at any module that requires its own working memory.