concatenation error
-
Omegachibwana
- Posts: 1
- Joined: October 16th, 2022, 11:12 am
concatenation error
Hello everyone, I'm having an issue with an overwritten file during concatenation. 3 files were added, but no extra dictionary was input in the dictionary section leading to one of the data files being overwritten. Is there any way I can retrieve this data? please assist
-
justinlakier
- Posts: 152
- Joined: November 21st, 2022, 4:41 pm
Re: concatenation error
Hello,
Without a dictionary, the concatenated result may contain invalid or duplicate cases. However it still contains all of the cases of the original data file. Associating a dictionary during concatenation will allow the validation of cases and removal of duplicates. You can open the file in an SQLite database manager such as DB Browser for SQLite and examine the metadata to see which cases belong to which files, removing unwanted cases if needed, although a correct concatenation with a dictionary will remove any invalid/duplicate cases anyways. If you have further errors with the format of the concatenated data file and want us to take a look at it without posting it publicly, you can email your problem and the file to cspro@lists.census.gov.
Hope that helps,
Justin
Without a dictionary, the concatenated result may contain invalid or duplicate cases. However it still contains all of the cases of the original data file. Associating a dictionary during concatenation will allow the validation of cases and removal of duplicates. You can open the file in an SQLite database manager such as DB Browser for SQLite and examine the metadata to see which cases belong to which files, removing unwanted cases if needed, although a correct concatenation with a dictionary will remove any invalid/duplicate cases anyways. If you have further errors with the format of the concatenated data file and want us to take a look at it without posting it publicly, you can email your problem and the file to cspro@lists.census.gov.
Hope that helps,
Justin