Search found 36 matches

by sheridany
Wed May 04, 2011 3:28 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: create excel file at the end
Replies: 1
Views: 3581

create excel file at the end

I use TP to extract data from a database as pipe delimited. How can I import the pipe delimited files into excel and save them as excel files.
by sheridany
Thu Apr 28, 2011 10:55 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: How big a file?
Replies: 3
Views: 5457

Re: How big a file?

The usual cleanup some search and replace remove blanks trim leading and trailing etc. The usual TP stuff. From a deployment standpoint and a ETL perspective we would like to load the clean data into a database after TP has processed the file. How might we do that?
by sheridany
Wed Apr 27, 2011 2:07 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: How big a file?
Replies: 3
Views: 5457

How big a file?

I have a file that has a 1MM rows (22 columns csv format )daily that needs to be cleaned extensively. How many rows can TP handle on a single cpu workstation or is that even an option. Whats the best way to utilize TP for a job this big.
by sheridany
Wed Jun 23, 2010 9:16 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: remove lines according to the first delimited field value
Replies: 1
Views: 3474

remove lines according to the first delimited field value

i want to remove lines where the first field delimited contains the number of times the second field occurs. so I want to remove any line where the value is between 1-100. I have tried EP 1 to 3 digits and put a restriction filter above it so it only filters on the first delimited field. No luck the...
by sheridany
Tue Jun 08, 2010 9:41 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: tp warning
Replies: 1
Views: 3569

Re: tp warning

I figured it out. If you cut and paste into TP from excel or word, the CR is forced to the next line and thus creates the warning.
by sheridany
Tue Jun 08, 2010 4:21 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: tp warning
Replies: 1
Views: 3569

tp warning

I am getting a warning that says search strings ends in whitespace. The Easy Pattern looks like this and I am looking for all instances where "DiRECT DEP" is preceeded or succeeded by letters, punctuation or spaces. [linestart( 1 or more letters or punctuation)] ["DIRECT DEP"][pi...
by sheridany
Sat Jun 05, 2010 4:23 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: File Size
Replies: 1
Views: 3320

File Size

What is the largest text file size to work with in TP? I have a file of almost 1 mm records with three fields in it. The data is also in teradata so would datapipe be faster?
by sheridany
Fri Mar 26, 2010 1:51 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: odbc
Replies: 1
Views: 3426

odbc

i need to find rows of data from a very large teradata table and am wondering if I can use text pipe to find those rows as it brings the data in. I have a list of company names that will be contained in one of the fields but they will not match perfectly as some company names are abbreviated etc. To...
by sheridany
Fri May 29, 2009 8:21 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: slow running program
Replies: 9
Views: 10312

Re: slow running program

I finally got it run much better all in one program but I am not see the results I expected in removing columns. I read in the help guide to remove columns from right to left but it is still leaving in columns that I wanted to remove. Do I have to shift the position by -1 every time I remove a colum...
by sheridany
Wed May 27, 2009 8:48 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: slow running program
Replies: 9
Views: 10312

Re: slow running program

The only way I can see to do it currently is break it up into two processes. the first step is remove the unwanted columns and output to a csv file. Step 2 is a separate fll that does the search and replace using EP and some other EP cleanups. It runs much faster this way.
by sheridany
Wed May 27, 2009 7:45 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: slow running program
Replies: 9
Views: 10312

Re: slow running program

The issue seems to be in the search and replace list. It is exact in nature so perhaps I am using the wrong filter? There are 190 search and replace rows that look like this? Sales & Service Taxonomy./Cashback,Cashback Sales & Service Taxonomy./Address Change,Addr_Chg Sales & Service Tax...
by sheridany
Wed May 27, 2009 1:52 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: slow running program
Replies: 9
Views: 10312

Re: slow running program

It is still running very slow even after converting the search replace list into a csv file. :shock:
by sheridany
Tue May 26, 2009 11:02 pm
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: slow running program
Replies: 9
Views: 10312

Re: slow running program

There are approximately 190 entries in the replace list. I will try the csv format.
by sheridany
Thu May 21, 2009 9:16 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: slow running program
Replies: 9
Views: 10312

slow running program

Does anyone have a suggestion for making this go faster. it is abysmally slow. It is about 400,000 records in a csv file and we have to remove a lot of colums individually. Filter List ----------- Filter options | [ ] Log to file | [X] Append to logfile | Log filename: textpipe.log | Threshold 500 |...
by sheridany
Thu Jul 03, 2008 4:53 am
Forum: TextPipe Tips and Tricks, Questions and Support
Topic: search and replace basics
Replies: 11
Views: 11374

Re: search and replace basics

That example really helps. Thanks.