Secondary Output Filter: feature request...maybe ;-)

Get help with installation and running here.

Moderators: DataMystic Support, Moderators, DataMystic Support, Moderators, DataMystic Support, Moderators

Post Reply
alnico
Posts: 74
Joined: Fri Oct 12, 2007 11:57 pm

Secondary Output Filter: feature request...maybe ;-)

Post by alnico »

Hello,

I use the 'Secondary Output Filter' quit a bit. I perhaps have an idea for making it more powerful and would save me from running multiple processes in succession. So here goes ;-)

From what I understand, when using a ‘Secondary Output Filter’ the file it is writing to is locked 'open' until the all processing is completed and is then closed. Naturally this renders the file inaccessible to use later on for other processing. What if there was a check box within the 'Secondary Output Filter' called: “close file on exit of sub” (I am guessing this would have to be the immediate parent sub). This option would only be useful in a sub tree. What do you think? Good idea or bad ;-)

Thanks,
alnico
Posts: 74
Joined: Fri Oct 12, 2007 11:57 pm

Post by alnico »

After sleeping on this idea...

Could a new filter be created, called: 'Close Secondary Output Filter'. This filter could then be placed anywhere on the tree and would only close the previous 'one' 'Secondary Output Filter'? Just ideas ;-)

Thanks,
User avatar
DataMystic Support
Site Admin
Posts: 2227
Joined: Mon Jun 30, 2003 12:32 pm
Location: Melbourne, Australia
Contact:

Post by DataMystic Support »

Sorry - definitely would not work :-(

As far as possible, TextPipe processes the whole filter tree simultaneously, so your close filter would act straight after it had been opened. Just image that text is always flowing through every part of the filter tree and you'll see why this doesn't work.
alnico
Posts: 74
Joined: Fri Oct 12, 2007 11:57 pm

Post by alnico »

Okay, thanks...ya wasn't to sure about it ;-)

So...do you know of a way to write to a file and turn around and use the newly written content all within one textpipe processing file?

I am not sure if others have this need...but I extract content, etc. and write it to a file. I then have to open another TextPipe file to access that file and continue forward, (I have about 8 processing steps that I do like this).

Thank you.
User avatar
DataMystic Support
Site Admin
Posts: 2227
Joined: Mon Jun 30, 2003 12:32 pm
Location: Melbourne, Australia
Contact:

Post by DataMystic Support »

Without looking at your filters, I don't understand why you can just extract the needed data and let this flow through the filter to the next stage.

Note - you can also Link filters together - see the items at the bottom of the All Available Filters list.
alnico
Posts: 74
Joined: Fri Oct 12, 2007 11:57 pm

Post by alnico »

I do extract data and form that data into Regex and write them to a file and then open the next processing file, load the Regex's and continue. I guess if variables were allowed in the 'Find' boxes then I wouldn't have to do this. This is just one example. Variables in the 'Find' would be so powerful...but is it possible with the Regex's?

Regards
User avatar
DataMystic Support
Site Admin
Posts: 2227
Joined: Mon Jun 30, 2003 12:32 pm
Location: Melbourne, Australia
Contact:

Post by DataMystic Support »

No - we don't allow variables in the regex to try and optimize performance. It could also become a huge mess with yet another set of escaping needed
\ for special chars such as $ . * ( ) ^ { } \ [ ] +
@@ for variables
- you get the idea.

Does your regex get generated for each file and then applied to the same file? Or is it generated once for a set of files, and then is applied to that set of files? An exmaple would be really helpful
Post Reply