Page 1 of 2

CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: August 4th, 2017, 2:41 pm
by pleon
Our dictionary have a record of people/population with a maximimum of 30 person per home.

The data file (text), built with a custom non-CSPRO application, contained homes with more than 30 people.

When sorted the people above the 30 mark where omitted without warning.

We thinnk that there should be a warning in those cases.

regards
- Pablo

Re: CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: August 4th, 2017, 2:43 pm
by josh
Normally there should be a warning written to the listing file. Is this with version 6.3 or version 7.0?

Re: CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: August 4th, 2017, 3:00 pm
by pleon
Oh, sorry!

it's Version 7.0.2 (29 june 2017)


I've not seen a listingfile window, just a dialog box sayoing that sort was completed.


regards
- Pablo

Re: CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: August 4th, 2017, 3:04 pm
by pleon
The CSFreqRun do show a message like:

Process Messages

*** Case [XXXXXXXXXXX] has 5 messages (0 E / 5 W / 0U)
W 10006 Too many occurrences for Record or Group POP_R (Case:
'XXXXXXXXXXX)
W 10006 Too many occurrences for Record or Group POP_R (Case:
'XXXXXXXXXXX')
W 10006 Too many occurrences for Record or Group POP_R (Case:
'XXXXXXXXXXX')
W 10006 Too many occurrences for Record or Group POP_R (Case:
'XXXXXXXXXXX')
W 10006 Too many occurrences for Record or Group POP_R (Case:
'XXXXXXXXXXX')


- P

Re: CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: August 4th, 2017, 3:08 pm
by josh
You should see the same errors in the file CSSort.lst that is generated in the same folder as the dictionary. We should probably display this file if it has warnings in it like we do with Frequencies.

Re: CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: August 4th, 2017, 4:09 pm
by pleon
Yep, showing the file or at least advice to look the log file on closing dialog box.

regards
- Pablo

Re: CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: August 4th, 2017, 5:27 pm
by josh
Added to our todo list.

Re: CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: January 14th, 2021, 8:33 am
by josh
This has been fixed for version 7.6 which will be released soon.

Re: CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: January 20th, 2021, 3:28 pm
by tcroft
Hey Josh, I think we are seeing the same problem when we create recode files (special output files) and have more than one case at the second level in a 2-level dictionary. The output data file looks ok (not certain about this yet, but it looks ok), but we are getting many many warning messages like this, even using CSPro 7.5.1.

Do you have a date for release of 7.6? Otherwise we have to revert back to CSPro 6.3

Thanks. Trevor

Re: CSSOrt silently omit data when a record have more instances than the allowed maximum

Posted: January 20th, 2021, 4:27 pm
by josh
Trevor, I think this is a different issue. The fix for this in 7.6 is simply to show the message at the end of the cssort run if there were warnings. In this case the warnings are legit since the number of record occs in the data file is greater than the max in the dictionary. So the fix doesn't remove the warnings or anything - it just shows the message file so that they are more noticeable.

If you can create a test app/test data file that shows the issue you are having and send it to us we will take a look.