Extended ASCII Preservation Fix

2025-07-28

Extended ASCII Preservation Fix

• Switched from Unidecode to ftfy: Replaced aggressive Unicode-to-ASCII conversion with intelligent text fixing
• Preserves Extended ASCII: Now correctly preserves 8-bit extended ASCII characters (128-255) like é, ñ, ü, etc.
• Smarter Unicode Handling: Only converts problematic Unicode characters while preserving intentional extended ASCII usage
• Updated Dependencies: Replaced Unidecode dependency with ftfy in requirements.txt
• Maintains AI Artifact Removal: Still removes smart quotes, EM/EN dashes, and other "AI tells" as designed
• Added a check to see if we are in a VSCode extension and handle EOF newline properly - was being stripped by th extension handler.

All the same, VS Code issue fixed

Was not handling VS Code strangeness while in extensions and inconsistently stripping off newlines at the end of file. VS Code issue, not mine, but had to handle it.

20250722_01-update

20250722_01 update - minor issues - EOF newline missing.

20250722_00 Enough of of Your AI Nonsense Edition

• Major update, new options
• Smarter removal of Unicode and conversion
• More coding artifacts removed - less lint

20250427_01-Updates

Updated to working as a filter and removes trailing spaces

First really solid release

This is a good working release. The shell script wraper is heavily dependent on the user's installation. However, the Shortcut and the Python work just fine.

Full Changelog: https://github.com/unixwzrd/UnicodeFix/commits/20250427_00-Rel