Textpipe log file does not support UTF-8 encoding

Get help with installation and running here.

Moderators: DataMystic Support, Moderators, DataMystic Support, Moderators, DataMystic Support, Moderators

Post Reply
dfhtextpipe
Posts: 986
Joined: Sun Dec 09, 2007 2:49 am
Location: UK

Textpipe log file does not support UTF-8 encoding

Post by dfhtextpipe »

This can be divided into two separate observations:

1. Comment filters containing non-ANSI characters are logged as ????
2. Replace filters containing UTF-8 search text are not rendered as UTF-8.

The first example is

Code: Select all

Fix truncations & expansions of Ушод:
This gets logged as

Code: Select all

Fix truncations & expansions of ????:
The second example is with this replace list.

Code: Select all

Replace [Cонъ] with [Сонъ]
   [X] Match case
   [X] Whole words only
   [ ] Case sensitive replace
   [ ] Prompt on replace
   [ ] Skip prompt if identical
   [ ] First only
   [ ] Extract matches

   [ ] Process longest strings first
   [ ] Simultaneous search
   [ ] Log summary only
   [ ] Only log when a replace occurs

 Further search/replace list phrases (TAB format):
идолосu	идолосю
начальn	начальн
кирьдемсh	кирьдемсъ
Vменей	Именей
The log results are rendered badly as

Code: Select all

Info	2019-06-06 15:15:16	Cyrillic words with Latin letters:
Info	2019-06-06 15:15:16	1 replace(s) performed for exact match [Cонъ]
Info	2019-06-06 15:15:16	1 replace(s) performed for exact match [идолосu]
Info	2019-06-06 15:15:16	1 replace(s) performed for exact match [начальn]
Info	2019-06-06 15:15:16	1 replace(s) performed for exact match [кирьдемсh]
Info	2019-06-06 15:15:16	1 replace(s) performed for exact match [Vменей]
What can be done to improve Textpipe logging of non-Roman characters?
David
User avatar
DataMystic Support
Site Admin
Posts: 2227
Joined: Mon Jun 30, 2003 12:32 pm
Location: Melbourne, Australia
Contact:

Re: Textpipe log file does not support UTF-8 encoding

Post by DataMystic Support »

This is fixed in TextPipe 10.9
dfhtextpipe
Posts: 986
Joined: Sun Dec 09, 2007 2:49 am
Location: UK

Re: Textpipe log file does not support UTF-8 encoding

Post by dfhtextpipe »

I've yet to examine a log file after updating to v11.4

David
David
Post Reply