RE: Finding illegal UTF8 sequences

From: Weaver, Walt <wweaver_at_rightnow.com>
Date: Thu, 27 May 2004 13:12:43 -0600
Message-ID: <D30BE1A2F9109A43BA989E2F5168405605E9ED1F@pobox.corp.rightnow.com>

> -----Original Message-----
> From: oracle-l-bounce_at_freelists.org=20
> [mailto:oracle-l-bounce_at_freelists.org] On Behalf Of Michael Thomas
> Sent: Thursday, May 27, 2004 12:56 PM
> To: oracle-l_at_freelists.org
> Subject: Re: Finding illegal UTF8 sequences
> --- "Weaver, Walt" <wweaver_at_rightnow.com> wrote:
> > Is anyone experienced with finding illegal UTF8
> > sequences and doing
> > something about them?
> >=20
> > We have a UTF8 database containing Japanese data.

>=20

> "Unicode Debystified, A Practical Programmer's Guide
> to the Encoding Standard" has some algorithms for
> testing Unicode. I have never tried to compile and run
> them however. Its worth a browse at the bookstore.

>=20

> There are clear explanations of different Unicode
> charactersets in the book, and that may help you to
> research the problem.

>=20

> HTH.

>=20

> Regards,

>=20

> Mike Thomas

>=20
Thanks for the info.

In the short time since I posted this question we've narrowed down the culprit responsible for the messed up data to virus-scanning software the client was using to insert incidents into the database. We're not sure why or how it was doing this but the software is no longer being used. So, at least the source of the problem is taken care of.

--Walt

Please see the official ORACLE-L FAQ: http://www.orafaq.com

To unsubscribe send email to: oracle-l-request_at_freelists.org put 'unsubscribe' in the subject line.

--
Archives are at http://www.freelists.org/archives/oracle-l/
FAQ is at http://www.freelists.org/help/fom-serve/cache/1.html
-----------------------------------------------------------------

Received on Thu May 27 2004 - 14:09:46 CDT