Skip to content

Numerical inaccuracies #29

Description

@bersbersbers

The following outputs -1.11022302462516e-16 instead of 0:

udunits2::ud.convert(1, "in", "in") - 1

This leads to cairo_pdf saving images with size 71 pt x 71 pt rather than 72 pt x 72 pt according to pdfinfo, which is quite visible in exactly aligned images.

I wonder if trivial conversions (in -> in, for example) could be skipped to maintain accuracy.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions