Too many open files error #30
Unanswered
WilderLavington
asked this question in
Q&A
Replies: 1 comment 3 replies
-
This is not a bug. If you enable Memory Mapped File (mmap), Theoretically speaking, this can be solved If you need to create so many replay buffers, you might have to disable mmap feature. |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hello,
I was recently interested in setting up individual replay buffers which each correspond to a specific initial condition. There are a decent number of initial conditions (maybe 500-1000), but I was hoping to do this to make uniform sampling a little bit easier. When generating this set of replay buffers, I ran into the following error:
My question is, is this a bug or a feature? In the sense that the system wants to keep all of these files open for quick access, or are they just going to be temporarily open after being created. I could potentially increase my open file limit to avoid this, but I would have to increase is ~10x to run my current application. Do you have a recommendation to get around this? I could potentially use PER to approximate the sampling distribution I am interested in but just having separate buffers per initial condition would be easier. Any insight would be useful!
Beta Was this translation helpful? Give feedback.
All reactions