Page 1 of 1

Extracting multiple files from a single file with one filter

Posted: Tue Jan 04, 2005 10:34 am
by forward1
I have 4 years of log files that need to be processed. Each file contains one day’s traffic from over 100 domains on my server. I need to extract individual files from each log – one for each domain.

I can do it one domain at a time, but I’d like to have one filter, not 100. I’m using the Pro version of TextPipe

Thanks in advance,

Posted: Mon Jan 10, 2005 8:30 am
by DataMystic Support
Hi,

The best approach here is to script this from a language such as VBScript. First design the filter to extract for one domain, then use File\Export to VBScript to generate the script.

Take this script and code it so it will run for each domain. Another approach is to use 100 consecutive Restrict to Matching Line filters to direct each domain to a new file. This filter can also be created using VBScript to make it easier.