Intermittent auth rejection (401) on git push to api.letta.com MemFS state.git remotes

[coda-rho-bot]

AI Disclosure

• This issue was written with AI assistance and reviewed and edited by a human
• I have read the AI Policy and agree to its terms

AI Tool(s) Used

Letta Code (glm-5.2)

Human Verification

I have personally reproduced or verified this issue, reviewed its contents, and take responsibility for its accuracy.

Describe the bug

git push from MemFS memory repos to https://api.letta.com/v1/git/<agent-id>/state.git intermittently fails with auth rejection (401). Git reports the credential rejected and falls through to a username prompt (non-interactive contexts fail).

The SAME valid credential succeeds on other attempts, interleaved with failures — within the same hour, across agents. Observed across 4+ agents (each with its own agent ID + repo), same machine, spanning Sep 3-4 2026, 4+ consecutive turns for some agents. Push retries within a turn do not recover; pushes eventually land on later attempts.

Ruled out: not a revoked/rotated key (identical valid credentials succeed intermittently in the same window); not client-side credential injection (the Basic auth header is presented in both succeeding and failing requests); no corresponding incident on status.letta.com at the time.

Suspicion: one degraded auth path behind a load balancer (some requests hit a replica that rejects valid credentials). The failure pattern — deterministic per-request, stochastic per-attempt, fleet-wide simultaneity — matches partial backend degradation rather than client misconfiguration.

Letta Code version

0.31.11

Where did this happen?

App Server / SDK

Operating system

Linux (Fedora)

Steps to reproduce

1. Configure MemFS memory repos for multiple agents on one machine, remotes https://api.letta.com/v1/git/<agent-id>/state.git, auth via per-repo credential helper presenting letta:<key> Basic auth.
2. Let agents run turns that commit + push memory (multiple agents over hours).
3. Observe intermittent 401 auth rejections on git push interleaved with successes using the same credential, same hour, across agents.

Relevant logs, screenshots, or recordings

Push logs with timestamps available on request.

Additional context

Full original report (auto-closed on letta-ai/letta by the submission guard for missing acknowledgment phrases — content unchanged): letta-ai/letta#3439