Automated bug report: Too many open files

[SaptakS]

Error Report Type: x_runJob_archiveBuild_ArchiveBuildError

Error report data:

{'error': 'Error invoking remote method \'X:archiveBuild\': Error: {
        "message":"EMFILE: too many open files, open \'C:\\\\Users\\\\<user>\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.2\\\\resources\\\\x-archive.zip\'",
        "name": "Error",
        "stack":"Error: EMFILE: too many open files, open \'C:\\\\Users\\\\<user>\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.2\\\\resources\\\\x-archive.zip\'"
    }\n\nError: Error invoking remote method \'X:archiveBuild\': Error: {
        "message":"EMFILE: too many open files, open \'C:\\\\Users\\\\<user>\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.2\\\\resources\\\\x-archive.zip\'",
        "name": "Error",
        "stack":"Error: EMFILE: too many open files, open \'C:\\\\Users\\\\<user>\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.2\\\\resources\\\\x-archive.zip\'"
    }', 'userDescription': 'you have a very poor service'
}

Sensitive report data:

{
    "logs": [
        {
            "timestamp": "2025-03-25T17:55:53.252Z",
            "func": "runJob",
            "message": "running job archiveBuild"
        }
    ],
    "currentURL": "https://x.com/i/bookmarks"
}

[micahflee]

Another one of these with Cyd 1.1.5 on Windows.

Error report data:

{
  "error": "Error invoking remote method 'X:archiveBuild': Error: {\"message\":\"EMFILE: too many open files, open 'C:\\\\Users\\\\[redacted]\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.5\\\\resources\\\\x-archive.zip'\",\"name\":\"Error\",\"stack\":\"Error: EMFILE: too many open files, open 'C:\\\\Users\\\\[redacted]\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.5\\\\resources\\\\x-archive.zip'\"}\n\nError: Error invoking remote method 'X:archiveBuild': Error: {\"message\":\"EMFILE: too many open files, open 'C:\\\\Users\\\\[redacted]\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.5\\\\resources\\\\x-archive.zip'\",\"name\":\"Error\",\"stack\":\"Error: EMFILE: too many open files, open 'C:\\\\Users\\\\[redacted]\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.5\\\\resources\\\\x-archive.zip'\"}"
}

Sensitive context data (but there's nothing sensitive):

{
  "logs": [
    {
      "timestamp": "2025-04-11T01:05:57.677Z",
      "func": "runJob",
      "message": "running job archiveBuild"
    },
    {
      "timestamp": "2025-04-11T01:06:01.471Z",
      "func": "domReadyHandler",
      "message": "dom-ready"
    }
  ],
  "currentURL": "about:blank"
}

[micahflee]

I'm investigating this. We've gotten this error 4 times, and every time it's been in Windows.

[micahflee]

We got another one, also in Windows. I've tried to reproduce this in Windows but so far no luck. I've looked through the code and I don't see any obvious places where a file descriptor is opened but not closed, which could cause a leak.

[micahflee]

These errors are all happening in XAccountController.archiveBuild. This function basically does two things:

• selects a bunch of stuff from the database, formats it, and saves it as JSON in the user's account data folder (in a file called archive.js) to be used in the static site
• unzips x-archive.zip into the user's account data path

Since I'm not able to reproduce the problem with unzipping, I think it's unlikely that the problem is there. It seems more likely that it's related to writing the JSON to archive.js, since it writes it as a stream to avoid loading everything into RAM.

But it occurs to me that if we implement #460, we can just rip all of this code out, and thus likely fix this issue as well as well as greatly simplifying how the static site works.

[micahflee]

We got more bug reports.

• Created At: 2025-05-05 06:07:41.926378
• App Version: 1.1.6
• Client Platform: win32

Error report data:

{'error': 'Error invoking remote method \'X:archiveBuild\': Error: {"message":"EMFILE: too many open files, open \'C:\\\\Users\\\\redacted\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.6\\\\resources\\\\x-archive.zip\'","name":"Error","stack":"Error: EMFILE: too many open files, open \'C:\\\\Users\\\\redacted\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.6\\\\resources\\\\x-archive.zip\'"}\n\nError: Error invoking remote method \'X:archiveBuild\': Error: {"message":"EMFILE: too many open files, open \'C:\\\\Users\\\\redacted\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.6\\\\resources\\\\x-archive.zip\'","name":"Error","stack":"Error: EMFILE: too many open files, open \'C:\\\\Users\\\\redacted\\\\AppData\\\\Local\\\\Cyd\\\\app-1.1.6\\\\resources\\\\x-archive.zip\'"}'}

[redshiftzero]

Tagging this high priority since we got two reports of this happening again (albeit from the same user on win32)