Grant McLean > Encoding-FixLatin > fix_latin   Annotate this POD
Open  0 View/Report Bugs   fix_latin - filters a data stream
that is predominantly utf8 and 'fixes' any latin (ie: non-ASCII
8 bit) characters     fix_latin options <input_file >output_file
-?     detailed help message   The script acts as a filter,
taking source data which may contain a mix of ASCII, UTF8,
ISO8859-1 and CP1252 characters, and producing output will be
all ASCII/UTF8.  Multi-byte UTF8 characters will be passed
through unchanged (although over-long UTF8 byte sequences will
be converted to the shortest normal form). Single byte
characters will be converted as follows:    0x00 - 0x7F   ASCII
- passed through unchanged   0x80 - 0x9F   Converted to UTF8
using CP1252 mappings   0xA0 - 0xFF   Converted to UTF8 using
Latin-1 mappings    Display this documentation.   This script
was originally written to assist in converting a Postgres
database from SQL-ASCII encoding to UNICODE UTF8 encoding. The
following examples illustrate its