Page 1 of 1
Largest amount of data processed?
Posted: Fri Sep 07, 2012 7:35 am
by DataMystic Support
What's the largest amount of data you've processed in one hit with TextPipe?
The current record is 350GB, looking for new contenders!
Also helpful would be the time took, and the general data processing area (e.g. insurance, banking, mainframe, data extraction etc).
Re: Largest amount of data processed?
Posted: Mon Mar 27, 2017 3:32 am
by thelifeofapanca
Wow 350!
My record is 300
Re: Largest amount of data processed?
Posted: Tue Jan 30, 2018 10:36 pm
by twaterloo
In the past six months I've created 311,000 online listings in Amazon with TPP. So far I've been able to accomplish everything I can imagine using TPP with CSV files.
I've also parsed millions of xml records with TPP.
I keep thinking I should learn a real programming language but whenever I have a problem to solve I find a way to do it with TPP.
TPP + pearl regular expressions = everything possible
Re: Largest amount of data processed?
Posted: Wed Apr 15, 2020 5:39 pm
by DataMystic Support
Newest record is held by https://www.sciohealthanalytics.com/
9GB mainframe input file, generating an 11GB windows output file in 36 minutes