DataMystic

Oops, make that 960,000 lines.

100,000? Try 700,000 lines! Surprisingly, not to bad. The entire pipeline included 7 total Textpipe filters tied together with a command-line batch file. Two of the filters made character-by-character passes on paired data using a PERL replace filter. One filter made two separate passes on paired ha...

Yes, multi-gigabyte processing is great. My three-pass solution saved the "Output count of matches" to a one-line temp file, then a batch file read the temp file into an environment variable which a second textpipe pass used to calculate a percentage of the line total. Your suggestion to u...

Ok, I know there's a trick to this, and I just can't find it. The first I count the line count in a file and save the number to an external text file. Next I read the number in a text file to calculate x percent (5%) of the line count. Third, I use a vbscript to create an array of random numbers wit...

Counting words requires words be identified with boundaries. or "segmented." Europoean languages use spaces. Arabic scripts change the form of the characters. East Asian languages, such as Chinese, Japanese and Korean don't have a consistent method, and Thai doesn't do it at all. Microsoft...

Thanks for the confirmation. I figured this was the case. I know command line is limited, but suites 99% of my functionality. I've come up with a way to do what i want. 1) set an environment Variable form the batch command line before starting textpipe.exe 2) use restrict-to to branch isolate desire...

Currently, I'm using a "Restrict To|Secondary Output|Delete All" comination to branch and send text to an another file, but I want to assign the filename during runtime. I've tried using two "/mergefile=" switches from a command line and it didn't work. I've also tried using @dat...

I have several hundred 1-column files in folder A and corresponding files with identical file names in folders B... A and B are sub-folders off on one root. I need to batch process to merge each pair of 1-column text files in the two folders into a corresponding .CSV (tab or comma) file. I currently...