excel to cspro, a suggestion

Discussions about tools to complement CSPro data processing
Post Reply
AriSilva
Posts: 631
Joined: July 22nd, 2016, 3:55 pm

excel to cspro, a suggestion

Post by AriSilva »

Hi folks,
Show the name of the input file in the execution screen.
When you are converting several files at the same time it helps to know which ones are still executing.
And. if possible, to write the number of records in an output lst, it helps to verify if thngs went ok.
Best
Ari
Best
Ari
AriSilva
Posts: 631
Joined: July 22nd, 2016, 3:55 pm

Re: excel to cspro, a suggestion

Post by AriSilva »

Furthermore, the execution time is not proportional to the file size: for larger files it takes forever to convert it.
Apparently the strategy to do it might be changed (larger buffer size?).
This is very important to me because I´m converting the whole brazilian census (the sample part) from csv to csdb, which is split into states (27) and file type (household, family, person, and mortality).
For the bigger states like São Paulo, Rio de Janeiro, Minas Gerais, etc, just for the household part it is taking a day to process, and I did not start yet to convert the person files.
Best
Ari
Best
Ari
Post Reply