Skip to content

Automate sort-compress program using ni #34

Description

@spencertipping

Compression trades speed for space, but we should be able to make that decision on the fly. There are two, perhaps three, action items here:

  1. Trade space and speed more intelligently
  2. Automatically prefer pigz to gzip, etc, if available
  3. Rate-limit data throughput if we start running out of disk space, pause entirely if we're near critical so we don't crash the job

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions