Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

S3 API calls HEAD with extra postfix string #112

Open
silviu001 opened this issue May 10, 2024 · 0 comments
Open

S3 API calls HEAD with extra postfix string #112

silviu001 opened this issue May 10, 2024 · 0 comments

Comments

@silviu001
Copy link

Hello,

I encounter an issue with geesefs, version 0.40.8, when I am using S3 endpoints that return HTTP 403 for any endpoint that doesn't exist, instead of HTTP 404, even though the session is correctly authenticated.

temp/geesefs » ./geesefs-linux-amd64 --debug --debug_s3  --list-type 1 --endpoint https://eodata.dataspace.copernicus.eu EODATA /mnt/eodata                                                                                    
s3.DEBUG HEAD https://eodata.dataspace.copernicus.eu/EODATA = 403 []
s3.DEBUG Server = [envoy]
s3.DEBUG Date = [Fri, 10 May 2024 10:56:20 GMT]
s3.DEBUG DEBUG: Request s3/HeadObject Details:
---[ REQUEST POST-SIGN ]-----------------------------
HEAD /EODATA/9ixpj40xr7jy289wkxvc1i7ki16e9f1l HTTP/1.1
Host: eodata.dataspace.copernicus.eu
User-Agent: GeeseFS/0.40.8 (go1.19.13; linux; amd64)

[......]

s3.DEBUG DEBUG: Validate Response s3/HeadObject failed, attempt 0/3, error Forbidden: Forbidden
        status code: 403, request id: , host id:
main.FATAL Mounting file system: Unable to access 'EODATA': Forbidden: Forbidden
        status code: 403, request id: , host id:

The credentials are correct because I can use them with s3fs or s3cmd without an issue. Our investigation concluded that the issue is with the postfix added to HEAD calls:

HEAD /EODATA/9ixpj40xr7jy289wkxvc1i7ki16e9f1l HTTP/1.1

When I try the same command but with an MinIO S3 endpoint that correctly returns 404 Not Found it works as geesefs will go further and try to list the content of the bucket and mounts the endpoint correctly.

Is there any way to workaround this postfix addon?

Thanks,
Silviu.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant