I have 4 years of log files that need to be processed. Each file contains one day’s traffic from over 100 domains on my server. I need to extract individual files from each log – one for each domain.
I can do it one domain at a time, but I’d like to have one filter, not 100. I’m using the Pro version of TextPipe
Thanks in advance,
Extracting multiple files from a single file with one filter
Moderators: DataMystic Support, Moderators, DataMystic Support, Moderators, DataMystic Support, Moderators
-
DataMystic Support
- Site Admin
- Posts: 2227
- Joined: Mon Jun 30, 2003 12:32 pm
- Location: Melbourne, Australia
- Contact:
Hi,
The best approach here is to script this from a language such as VBScript. First design the filter to extract for one domain, then use File\Export to VBScript to generate the script.
Take this script and code it so it will run for each domain. Another approach is to use 100 consecutive Restrict to Matching Line filters to direct each domain to a new file. This filter can also be created using VBScript to make it easier.
The best approach here is to script this from a language such as VBScript. First design the filter to extract for one domain, then use File\Export to VBScript to generate the script.
Take this script and code it so it will run for each domain. Another approach is to use 100 consecutive Restrict to Matching Line filters to direct each domain to a new file. This filter can also be created using VBScript to make it easier.