Remove randomness from the unit tests as much as possible

Currently some unit tests fail sporadically just because of random chance it seems. I think the automated testing would be more robust if we isolate the randomness to as small a number of test cases as possible and mostly have deterministic tests. This is kinda challenging because most of the methods in HDC are stochastic by design.