Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disk size limits do not work as expected #16

Open
Derkades opened this issue Nov 15, 2020 · 4 comments
Open

Disk size limits do not work as expected #16

Derkades opened this issue Nov 15, 2020 · 4 comments

Comments

@Derkades
Copy link

Derkades commented Nov 15, 2020

When creating four chunk servers with a single disk (but actually all on the same host disk), environment variable SIZE=10 one expects to get four chunk servers that show 0GB / 10GB (0%) used. However, the web interface shows 10GB / 10GB (100%) used. Creating files fails with an out of space error.

image

When removing the size limit the cause of this issue becomes immediately obvious:
image
To calculate 'used' space moosefs uses the drive's used space instead of the size of files actually stored in the directory. This makes a lot of sense due to performance and inconsistency issues when counting individual files, but it makes the SIZE option a lot less useful.

It took me quite a while to figure out why all my disks showed as full, if there is no good fix for this at least you should document this in the README or manual in my opinion.

@Derkades
Copy link
Author

It appears that as soon as one object is uploaded it calculates used space correctly
image

@rocinante-sys
Copy link
Contributor

my test setup does not want to store anything. it says no space on device :)

@Derkades
Copy link
Author

Derkades commented Dec 6, 2020

@rocinante-sys Are you using storage quotas (SIZE environment variable)?

@rocinante-sys
Copy link
Contributor

@Derkades yes, I saw in first post that is the issue. It works if I leave it out 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants