perlglossary.pod: GitHub displays some symbols in a malformed way

[vaitkus]

Some Unicode symbols like single and double quotes (e.g. `, “,”) appear malformed when viewed via the GitHub website [1]. For example

“Would you like door A, B, or C?”

as

 “Would you like door A, B, or C?�

The issue does not seem to manifest on the perldoc website [2]

[1] https://github.com/perl-doc-cats/perlfaq/blob/master/lib/perlglossary.pod
[2] https://perldoc.perl.org/perlglossary

[haarg]

Seems like a GitHub bug, not an issue with the document.

[vaitkus]

Thank you for confirming this. I have opened a GitHub support ticket.

From what I understand, the issue is not in the markup [1] code that GitHub uses to make the initial conversion to HTML (code seem to function properly when run locally), but somewhere further down the line.

While the problem does not stem from the document itself, I would like to leave this issue open until GitHub provides any kind of an update (hopefully).

[1] https://github.com/github/markup

[karenetheridge]

I updated all pages to use =encoding UTF-8, but there is no change to the github preview. Other pod files with utf8 characters (e.g. https://github.com/karenetheridge/Acme-LookOfDisapproval/blob/master/README.pod) render just fine though; I don't see what is different about this page other than the specific characters being used.

[vaitkus]

I think that GitHub is tripped by the "é" character as replacing "Sméagol" with "Smeagol" makes the entire document render correctly. It seems that the corrupting influence of the One Ring extends beyond the books.

[Grinnz]

Strange, the encoding on that character seems correct:

0000edb0: 6174 7572 6520 2253 6dc3 a961 676f 6c22  ature "Sm..agol"

It must be an issue related to it being rendered in a verbatim block.

[Grinnz]

I cannot reproduce the issue rendering perlglossary.pod with Pod::Simple::XHTML, Pod::Simple::HTML, or MetaCPAN::Pod::XHTML with default options.

[vaitkus]

GitHub support wrote back that they already got several similar reports and that my inquiry was passed to the engineering team.