Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

blobfuse2 failed to authenticate credentials #1651

Open
scottschmidl opened this issue Mar 6, 2025 · 5 comments
Open

blobfuse2 failed to authenticate credentials #1651

scottschmidl opened this issue Mar 6, 2025 · 5 comments
Assignees
Milestone

Comments

@scottschmidl
Copy link

scottschmidl commented Mar 6, 2025

I'm trying to mount my azure blob storage container in my ubuntu docker container.
blobfuse2 version:
Wed Mar 5 17:10:42 UTC 2025 : blobfuse2[5898] : [] LOG_DEBUG [custom.go (54)]: initializePlugins: No plugins to load. blobfuse2 version 2.5.0~preview.1

I checked that Blobfuse2 is compatible with Ubuntu 24.04:
DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=24.04
DISTRIB_CODENAME=noble
DISTRIB_DESCRIPTION="Ubuntu 24.04.1 LTS"
PRETTY_NAME="Ubuntu 24.04.1 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04.1 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo

My config.yaml file is in root@12342:/# /etc/blobfuse2/config.yaml and it's contents are:
components:
libfuse
azstorage
file_cache
libfuse:
path: models/data/mount
azstorage:
account-name: ****
container: ****
mode: key
account-key: ****
file_cache:
path: models/data/tmp

I'm running the command blobfuse2 mount ./models/data/mount --config-file=../etc/blobfuse2/config.yaml and getting error: Thu Mar 6 20:59:29 UTC 2025 : blobfuse2[6306] : [] LOG_DEBUG [custom.go (54)]: initializePlugins: No plugins to load. Error: failed to initialize new pipeline [failed to authenticate credentials for azstorage]. i've confirmed that the account name, container, and key are all correct; see screenshots from where i'm getting them. i do see that this says, Anonymous Access Level = Private, but I've been able to access it from the Python package and via rclone locally. (Can't use rclone now. locally i'm on windows, but my docker container is ubuntu).

Image
Image

@jwest-stratus
Copy link

jwest-stratus commented Mar 6, 2025

We are also failing to authenticate after updating to blobfuse2-2.4.1

Rolling back to 2.4.0 fixes the issue.

Seems to be an issue with the API-version being pushed.

RESPONSE 400: 400 The value for one of the HTTP headers is not in the correct format.
ERROR CODE: InvalidHeaderValue

InvalidHeaderValueThe value for one of the HTTP headers is not in the correct format.
RequestId:{redacted}}
Time:2025-03-06T{{redacted}}x-ms-version2025-05-05

@vibhansa-msft
Copy link
Member

Are you accessing public azure cloud or some other variant ?

@vibhansa-msft
Copy link
Member

With every new release of Blobfuse we tend to upgrade our storage SDK as well and as part of that new service-version will come inherently and this shall work on most tenants on public cloud.

@vibhansa-msft vibhansa-msft self-assigned this Mar 7, 2025
@vibhansa-msft vibhansa-msft added this to the v2-2.5.0 milestone Mar 7, 2025
@scottschmidl
Copy link
Author

scottschmidl commented Mar 7, 2025

Are you accessing public azure cloud or some other variant ?

It's a storage account on Azure Government, but rclone worked with no issues. Are you telling me that I shouldn't be using blobfuse2 because there is no functionality, and I should move to some other open-source library that supports my use case?

EDIT: i added the endpoint parameter to point to usgovcloudapi.net but now i get and error that I didn't get before: Error: failed to initialize new pipeline [config error in Pipeline [component file_cache is out of order]]

@jwest-stratus
Copy link

Are you accessing public azure cloud or some other variant ?

We use Azure public cloud. Mounting Blob storage to an on prem VM to be specific.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants