filtering csdbe with no record

[amari]

Hi everyone,

I’m dealing with a challenging issue and could really use your help. I have several thousand csdbe files that track the completion state of specific jobs. These files are generated when a user starts data entry, but they only contain data once the user completes their assignment.

I receive these files daily in thousands per users.
With thousands of users, analyzing this data has become a nightmare.
Most of these files contain no records, making concatenation and analysis incredibly time-consuming.

Is there a way to quickly filter out csdbe files that have no records, so I can focus only on the ones with data? This would significantly improve my processing efficiency.

I’d greatly appreciate any advice, tools, or scripts you could suggest to make this workflow faster and more manageable. Thanks for taking the time to read and help!

[Gregory Martin]

Are you talking about "records" or "cases"? I'm assuming that you mean that you are receiving files that have no cases. If so, you can use logic to determine if there are any cases:

setfile(DICT_NAME, "file1.csdbe|password=1234");

if countcases(DICT_NAME) > 0 then
    // do something with the data
endif;

If this doesn't help, you should explain your process in a little more detail so that we can understand where the pain points are in your process.