Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error reading file from S3 bucket with "Transport endpoint is not connected" #1089

Open
jmccl opened this issue Oct 28, 2024 · 2 comments
Open
Labels
bug Something isn't working

Comments

@jmccl
Copy link

jmccl commented Oct 28, 2024

This is entered at the request of vladem in #630.

Mountpoint for Amazon S3 version

1.10.0

AWS Region

us-east-1

Describe the running environment

Running Debian bookworm on a t2.nano ec2 instance in us-east-1. No docker / other container involved.

Mountpoint options

mount-s3 --debug --log-directory <directory> --read-only <bucket> <directory>

(Normally it runs without the '--debug' and '--log-directory' but in #630 I was asked to run with these options. The error happens in either case.)

What happened?

$ cp <file in s3 mount point> <directory>
cp: error reading '<filename>': Transport endpoint is not connected
cp: failed to close '<filename>': Transport endpoint is not connected
$ sudo dmesg -T | egrep -i 'Out of memory'
[Mon Oct 28 20:46:38 2024] Out of memory: Killed process 3470 (mount-s3) total-vm:925588kB, anon-rss:282932kB, file-rss:0kB, shmem-rss:0kB, UID:33 pgtables:752kB oom_score_adj:0

When normal processes are running (including mountpoint-s3) this is the state of ram.

$ free
               total        used        free      shared  buff/cache   available
Mem:          465116      167108      209720        2040      102356      298008
Swap:              0           0           0

Relevant log output

I'll attach a file because it's large.
@jmccl jmccl added the bug Something isn't working label Oct 28, 2024
@jmccl
Copy link
Author

jmccl commented Oct 28, 2024

Log output attached.
mountpoint-s3-2024-10-28T20-44-13Z.aQxxIO.log

@vladem
Copy link
Contributor

vladem commented Oct 29, 2024

Hey! Thanks for opening this issue. I can see that you're using t2.nano instance, which has 512MiB of RAM. This explains the OOM as currently Mountpoint enforces the minimum memory target of 512MiB which allows MP to consume the entire RAM.

We'll continue looking into it and will provide updates here when we'll have them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants