Search found 8 matches

by tahoar
Wed Jun 24, 2009 7:42 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Using line count in global variable
Replies: 5
Views: 5763

Re: Using line count in global variable

Oops, make that 960,000 lines.
by tahoar
Wed Jun 24, 2009 7:37 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Using line count in global variable
Replies: 5
Views: 5763

Re: Using line count in global variable

100,000? Try 700,000 lines! Surprisingly, not to bad. The entire pipeline included 7 total Textpipe filters tied together with a command-line batch file. Two of the filters made character-by-character passes on paired data using a PERL replace filter. One filter made two separate passes on paired ha...
by tahoar
Tue Jun 23, 2009 11:02 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Using line count in global variable
Replies: 5
Views: 5763

Re: Using line count in global variable

Yes, multi-gigabyte processing is great. My three-pass solution saved the "Output count of matches" to a one-line temp file, then a batch file read the temp file into an environment variable which a second textpipe pass used to calculate a percentage of the line total. Your suggestion to u...
by tahoar
Sun Jun 21, 2009 12:08 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Using line count in global variable
Replies: 5
Views: 5763

Using line count in global variable

Ok, I know there's a trick to this, and I just can't find it. The first I count the line count in a file and save the number to an external text file. Next I read the number in a text file to calculate x percent (5%) of the line count. Third, I use a vbscript to create an array of random numbers wit...
by tahoar
Sat Nov 22, 2008 12:45 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Japanese: word count
Replies: 3
Views: 4737

Re: Japanese: word count

Counting words requires words be identified with boundaries. or "segmented." Europoean languages use spaces. Arabic scripts change the form of the characters. East Asian languages, such as Chinese, Japanese and Korean don't have a consistent method, and Thai doesn't do it at all. Microsoft...
by tahoar
Fri Nov 21, 2008 11:59 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Secondary Output Filter
Replies: 3
Views: 4361

Re: Secondary Output Filter

Thanks for the confirmation. I figured this was the case. I know command line is limited, but suites 99% of my functionality. I've come up with a way to do what i want. 1) set an environment Variable form the batch command line before starting textpipe.exe 2) use restrict-to to branch isolate desire...
by tahoar
Tue Nov 18, 2008 11:45 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: Secondary Output Filter
Replies: 3
Views: 4361

Secondary Output Filter

Currently, I'm using a "Restrict To|Secondary Output|Delete All" comination to branch and send text to an another file, but I want to assign the filename during runtime. I've tried using two "/mergefile=" switches from a command line and it didn't work. I've also tried using @dat...
by tahoar
Mon Oct 13, 2008 10:37 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: merge to CSV
Replies: 1
Views: 3255

merge to CSV

I have several hundred 1-column files in folder A and corresponding files with identical file names in folders B... A and B are sub-folders off on one root. I need to batch process to merge each pair of 1-column text files in the two folders into a corresponding .CSV (tab or comma) file. I currently...