DataMystic

I use TP to extract data from a database as pipe delimited. How can I import the pipe delimited files into excel and save them as excel files.

The usual cleanup some search and replace remove blanks trim leading and trailing etc. The usual TP stuff. From a deployment standpoint and a ETL perspective we would like to load the clean data into a database after TP has processed the file. How might we do that?

I have a file that has a 1MM rows (22 columns csv format )daily that needs to be cleaned extensively. How many rows can TP handle on a single cpu workstation or is that even an option. Whats the best way to utilize TP for a job this big.

i want to remove lines where the first field delimited contains the number of times the second field occurs. so I want to remove any line where the value is between 1-100. I have tried EP 1 to 3 digits and put a restriction filter above it so it only filters on the first delimited field. No luck the...

I figured it out. If you cut and paste into TP from excel or word, the CR is forced to the next line and thus creates the warning.

I am getting a warning that says search strings ends in whitespace. The Easy Pattern looks like this and I am looking for all instances where "DiRECT DEP" is preceeded or succeeded by letters, punctuation or spaces. [linestart( 1 or more letters or punctuation)] ["DIRECT DEP"][pi...

What is the largest text file size to work with in TP? I have a file of almost 1 mm records with three fields in it. The data is also in teradata so would datapipe be faster?

i need to find rows of data from a very large teradata table and am wondering if I can use text pipe to find those rows as it brings the data in. I have a list of company names that will be contained in one of the fields but they will not match perfectly as some company names are abbreviated etc. To...

I finally got it run much better all in one program but I am not see the results I expected in removing columns. I read in the help guide to remove columns from right to left but it is still leaving in columns that I wanted to remove. Do I have to shift the position by -1 every time I remove a colum...

The only way I can see to do it currently is break it up into two processes. the first step is remove the unwanted columns and output to a csv file. Step 2 is a separate fll that does the search and replace using EP and some other EP cleanups. It runs much faster this way.

The issue seems to be in the search and replace list. It is exact in nature so perhaps I am using the wrong filter? There are 190 search and replace rows that look like this? Sales & Service Taxonomy./Cashback,Cashback Sales & Service Taxonomy./Address Change,Addr_Chg Sales & Service Tax...

It is still running very slow even after converting the search replace list into a csv file.

There are approximately 190 entries in the replace list. I will try the csv format.

Does anyone have a suggestion for making this go faster. it is abysmally slow. It is about 400,000 records in a csv file and we have to remove a lot of colums individually. Filter List ----------- Filter options | [ ] Log to file | [X] Append to logfile | Log filename: textpipe.log | Threshold 500 |...

That example really helps. Thanks.