Hello
I'm currently using TextPipe to sort a csv-table numerically. Unfortunately the file is rather large (ca. 80 MB) and when I try to process the file, TextPipe usually stops at around 27MB with the error message "Invalid floating point operation". Can't TextPipe handle such big files? Is there a possible workaround?
Thx
johnny
Invalid Floating Point Operation
Moderators: DataMystic Support, Moderators, DataMystic Support, Moderators, DataMystic Support, Moderators
-
DataMystic Support
- Site Admin
- Posts: 2227
- Joined: Mon Jun 30, 2003 12:32 pm
- Location: Melbourne, Australia
- Contact:
Re: Invalid Floating Point Operation
Hi Johnny,
1) Sounds like there is an invalid numeric value in the file which is causing the error, although this should not happen. We tested it here with invalid numeric values and it doesn't give an error, so I wonder what data you have.
.....We were finally able to get it to error out on data like
1e9999
1e-9999
We've now added a check for this for the next version.
2) Set the Sort\Maximum memory to use to 100MB.
1) Sounds like there is an invalid numeric value in the file which is causing the error, although this should not happen. We tested it here with invalid numeric values and it doesn't give an error, so I wonder what data you have.
.....We were finally able to get it to error out on data like
1e9999
1e-9999
We've now added a check for this for the next version.
2) Set the Sort\Maximum memory to use to 100MB.