CSPro 3.3.003 04 Jun 2008 ============================================================================ Release Notes ============= This document contains the following sections: [0] Updates Since Initial Release [1] What's New in CSPro 3.3 [2] Migrating Previous Applications to 3.3 [3] CSPro 3.3 List of Modules [4] Hardware and Software Requirements [5] Example Files and Folders [6] What was New in CSPro 3.2 [7] What was New in CSPro 3.1 [8] What was New in CSPro 3.0 [9] What was New in CSPro 2.6 [10] What was New in CSPro 2.5 [11] What was New in CSPro 2.4 [12] What was New in CSPro 2.3 [13] What was New in CSPro 2.2 ============================================================================ [0] Updates Since Initial Release CSPro 3.3 Development Release History ------------------------------ 7 May 2006 - 3.3.001 Initial release 24 Oct 2007 - 3.3.002 Update release 04 Jun 2008 - 3.3.003 Update release Installation ============ 24 Oct 2007 - CSPro installer can be modified to install only data entry or only data dissemination components. Tabulation ========== 24 Oct 2007 - Hide rows in tables when zero now correctly works in print preview and when saving/copying tables. Setting hide rows when all zeros can now be set correctly when selecting multiple stubs. Tables with area and hidden columns now work correctly in preview. 04 Jun 2008 - User can now copy and paste table specifications within an application or between applications. User can now exlude individual tables within a tabulation application from being run. Area tabulations with tables set to different lowest break levels are now processed correctly. Tables in area tabulations with lowest break level set to TOTAL are now shown correctly. Tables and Frequencies now work correctly with items that are defined with decimal places but no decimal character. Print/Print Preview now correctly substitutes the area name text in all cases for area tabulations. Export Data =========== 24 Oct 2007 - The user is warned if the input and output files for export are the same. Problems in the paths in generated .sps files (SPSS) and .dct files (STATA) have been corrected. Export no longer crashes if the dictionary contains a variable named "f". Valid Stata files are generated even when CSPro value sets are empty or contain only ranges. When Launching the Export Data tool from within an external application, the window is now correctly sized. Data Entry Designer =================== 04 Jun 2008 - Item fields and corresponding text are now positioned better when the user drops a record on a form. Data Entry ========== 24 Oct 2007 - In CAPI applications, rosters on the first form no longer disappear when the application first starts. The error that was generated when joining columns in certain rosters has been fixed. Rosters now work correctly from right left when the language is set to Arabic. 04 Jun 2008 - In CAPI applications, bitmaps within value sets are now supported. There is now a 'FullScreenValueSet' command line parameter to display forms and rosters on the screen one field at a time. This is useful for CAPI applications on UMPC and other small tablet-like devices. In Verify mode when there is a mismatch on an alpha field and the user presses the up arrow, the system now responds properly. Batch Edit ========== 24 Oct 2007 - The application no longer exits without error if an external data file is read-only. The impute function no longer crashes when item labels in the dictionary are long. 04 Jun 2008 - Progress bar now displays correctly when the input data file is greater than 2 GB (gigabytes). TextViewer ========== 24 Oct 2007 - The next and previous buttons in the find dialog are no longer disabled even when there is text in the search field. Reformat Data ============= 24 Oct 2007 - Reformat now correctly handles subitems of items with multiple occurences that have decimals. Reformat no longer fails with very large dictionaries. Compare Data ============ 04 Jun 2008 - No longer gives error message when table viewer is open. Concatenate Data ================ 04 Jun 2008 - Now uses the listing file name given in the .PFF file. ============================================================================ [1] What's New in CSPro 3.3 Those of you who are already familiar with CSPro 3.2 should note the following significant changes and new features. Please refer to the CSPro documentation or on-line helps for more information. - Windows Vista ready - Improved on-line documentation using HTML Help - Enhancements to meet Section 508 requirements including export of tables in html that is designed to work with screen readers. - The advance statement in data entry applications can be used without a target in which case it advances to the end of the current level. - The reformat data tool works when a comma is used as a decimal character - Opening a CAPI application when running a non-CAPI application in data entry now works correctly. - The MapViewer example in the examples directory runs without error. - Using the SavePartial function in a data entry application in the postproc of a form now generates a compile error rather than failing to correctly save the case at run-time. - The reenter statement in a data entry application now works correctly when used with $ or the name of the current field as a target. ============================================================================ [2] Migrating Previous Applications to 3.3 All previous CSPro 3.x applications and tools will work in CSPro 3.3. You cannot use a CSPro 2.x Cross Tabulation application in CSPro 3.3. You must create a new CSPro 3.3 Tabulation application. However, you can use your previous dictionaries from CSPro 2.x for CSPro 3.2 Tabulation applications. All other previous CSPro 2.x applications and tools will work in CSPro 3.2. ============================================================================ [3] CSPro 3.3 List of Modules The following modules are located in the "\Program Files\CSPro 3.3" folder; module names are followed in parentheses by their Windows executable file name: Data Dictionary (CSPro.exe) Data Entry Designer (CSPro.exe) Batch Edit Designer (CSPro.exe) Tabulation Designer (CSPro.exe) Data Entry Run (CSEntry.exe) Batch Edit Run (CSBatch.exe) Tabulation Run (CSTab.exe) Text Viewer (TextView.exe) Table Viewer (TblView.exe) Map Viewer (MapView.exe) Table Retrieval (TRSWin.exe) Tabulate Frequencies (CSFreq.exe) Sort Data (CSSort.exe) Export Data (CSExport.exe) Reformat Data (CSRefmt.exe) Compare Data (CSDiff.exe) Concatenate Data (CSConcat.exe) Table Retrieval Setup (TRSSetup.exe) Data Dictionary Converter (DDConvrt.exe) Shape to Map Converter (ShpToMap.exe) Pack Application (CSPack.exe) ============================================================================ [4] Hardware and Software Requirements A minimum configuration 33MHz 486 processor 16MB of RAM VGA monitor Mouse 45 MB of free hard drive Microsoft Windows 98SE A recommended configuration Pentium processor 512MB of RAM SVGA monitor Mouse 100 MB of free hard drive space Microsoft Windows 98SE, Me, NT 4.0, 2000, XP, or Vista ============================================================================ [5] Example Files and Folders The "\Program Files\CSPro 3.3\Examples" folder contains the following CSPro example files: Census 2000 Dictionary.dcf -- Census Data Dictionary example Census 2000 Data Entry.ent -- Census Data Entry example application Census 2000 National Tabs.xtb -- Census Tabulations -- National level Census 2000 Prov-Dist Tabs.xtb -- Census Tabulations -- Subnational levels Popstan Census 2000.dat -- Census data file for above applications Popstan Census 2000.anm -- Area Names file (Province/District) Popstan Census 2000.map -- Popstan map polygon file (ASCII) Popstan Census 2000.mpc -- Popstan map polygon file (binary) Popstan Census 2000.mdf -- Map data file for Map Viewer (ASCII) Popstan.trs -- TRS file for Table Retrieval Within the "\Program Files\CSPro 3.3\Examples" folder are the following CSPro example folders, each containing a self-contained CSPro application: Adding Weights (Batch Edit application) CAPI (Data Entry application) Computer Assisted Coding (Data Entry application) Create PFF File (Data Entry application) Current Population Survey (CrossTab application) DateCheck (Data Entry application) HotDeck (Batch Edit application) Impute (Batch Edit application) ItemDrivenDE (Data Entry application) LogFile (Data Dictionary) Lookup (Data Entry application) Selcase (Data Entry applicaiton) Two Level Application (Data Entry application) Write External File (Data Entry application) ============================================================================ [6] What was New in CSPro 3.2 Those of you who are already familiar with CSPro 3.1 should note the following significant changes and new features. Please refer to the CSPro documentation or on-line helps for more information. Tabulation ========== - Many tabulations run almost twice as fast. - The tally attributes has been changed to allow more flexibility to tally statistics. You can now control the order of statistics and whether percents are separate or interleaved. - Proportion has been added as new tally statistic. - The median and n-tile statistics now allow specification of intervals for calculation and whether the statistics are for discrete or continuous variables. - Input Data with decimal characters can use either dot (.) or comma (,). - Syntax error messages are now provided for value tallied, weight, universe, tablogic, and postcalc logic. - You can now suppress table rows which contain all zeros. - Areanames in the stub of a one row table are now indented for different area levels. - You can now look for variable names while in the Universe dialog box. - Fix problem with totocc when both records and items occur. - There is additional documentation describing how to setup data entry applications in Arabic, export data to statistical packages, and use the SetValueSet command. ============================================================================ [7] What was New in CSPro 3.1 Those of you who are already familiar with CSPro 3.0 should note the following significant changes and new features. Please refer to the CSPro documentation or on-line helps for more information. Batch Edit ========== - You can now automatically load and save hotdeck arrays in a CSPro batch edit program in a manner similar to IMPS. Tabulation ========== - You can now run tabulations in parts both interatively in CSPro or a batch run. That is, you can run tabulation, consolidation, or fomating separately as you could in IMPS. - You can add special tabulation logic when producing CSPro table. This logic is specified in the Tally Attributes for the table. - You can now specify calculations to be performed on the tabulated data (*.TAB files) before the tables are formatted. These calculations involve the values of cells in the tables. - You can now enter line breaks in table text by using Ctrl+Enter when typing text. - The meaning of row and column percent has been reversed in the Tally Attributes Dialog Box for a variable. The meaning now agrees with the meaning in SPSS, SAS, STATA, and IMPS. Tables created in CSPro 3.0 are unchanged. - When creating percents only, you can now include a column or row containing totals. - You can now change make separate preference setting for row and column variables. - You can now apply a particular unit to all subtables within a given table. - The name and label of the tabulation application and tables can be changed in the tables tree by right clicking on the application or table name and selecting Properties. ============================================================================ [8] What was New in CSPro 3.0 CSPro ===== - On launch CSPro allows you to select a recently used application to open. - You can save a copy of an application under a different name. - The New wizard has been improved to make the creation of new applications easier. Tabulation ========== - You can add and cross variables in the rows and columns of a table. - You now have control over the presence of totals and their position. - You now have control over position of percents in tables. - You can produce statistics (min, max, mean, median, mode, std. dev., variance, n-tiles) for any variable in the table. - You can different units of tabulation in the same table. - a full arithemetic expression in the CSPro language can be used to define the tally value and/or weight used in tabulation - A full conditional expression in the CSPro language can be used to define the universe of a table. - You now have full formatting control over are the text in the tables. - You can draw borders around any element of your table. - You save and load you own standard formatting preferences to be used by default in all the table you design. - You can design tables which span facing pages in a printed publication. - Stubs are supported on both the left and right sides of a table. - Full area processing like that available in IMPS is now available. - Zero can be used as a valid area code value. Dictionary ========== - You can now generate value sets using specified ranges and a value set label template. - You can now define multiple items within multiple records in CSPro. CSPro Language ============== - Subscipting of multiple items within multiple records is supported. Tabulate Frequencies ==================== - Full conditional expression for universe - Weighted frequencies - Frequency by value set or by each value found - Statistics (Min, max, mean, std. dev., variance, mode, median) Table Viewer ============ - The Table Viewer allows you to change the formatting of saved tables. - You can hide rows or columns in tables you are viewing. ============================================================================ [9] What was New in CSPro 2.6 Those of you who are already familiar with CSPro 2.5 should note the following significant changes and new features. Please refer to the CSPro documentation or on-line helps for more information. Data Dictionary =============== - RELATIONS. Relations provide a way of linking one multiple record or item to one or more other multiple records or items. Relations are defined in the data dictionary and can be used in FOR and EXPORT statements. CSPro (language) ================ - FILE declaration statement. This new statement defines files, not associated with dictionaries, that are used by the application and whose physical names are not given until run time. - RELATION declaration statement. This new statements defines relations for a particular application in addition to those defined in the data dictionary. - FILECONCAT function. This function concatenates a list of files. The list may contain individual files or wildcard file specifications. - FILECOPY function. This new function copies one file to another file. - FILECREATE function. This new function creates a new file with the given file name. If the file already exists, it is truncated to zero length. - FILEDELETE function. This new function deletes an already existing file from your system. - FILEEXIST function. This new function determines whether a file exists on your system. - FILENAME function modified. This function now return the full qualified name of a file defined by a file statement as well as a dictionary. - FILEREAD function. This function reads a text line from a file into an item or variable. - FILERENAME function. This new function changes the name of a file. - FILESIZE function. This new function returns the size of a file in bytes. - FILEWRITE function. This new function writes a line of text to a file. - EXECSYSTEM function. This new function starts another windows application or process. - MAXOCC function. This new function returns the maximum number of multiply occurring records or the maximum number of multiply-occurring items defined for a group in the dictionary. - SETFILE function. This new function assigns a new physical file to a dictionary or declared file and opens the file. - OPEN function modified. This function now opens a file defined by a file statement as well as defined by a dictionary. For files defined by a file statement, the file can be created or extended when opened. - CLOSE function modified. This function now closes a file defined by a file statement as well as defined by a dictionary. - FOR statement modified. This statement now allows relations to be used for looping. - SET BEHAVIOR EXPORT statement. This new statement determines the format output type of any subsequent Export statements. - EXPORT statement. This new statement writes a record to an export file defined by a file statement. Data Entry ========== - Improved handling of Arabic font text when entered into an alphanumeric data field. Export Data =========== - NEW INTERFACE. There a new interface for this tool. - RELATIONS. Records and items connected through a relation can be exported to the same record. - UNIVERSE. Particular cases, records, or items can be selected for export. - SINGLE FILE/MULTIPLE FILES. Export can be done to a single file or to multiple files. - SINGLE RECORD/MULTIPLE RECORDS Export of multiple records can be done to a single record or as separate records. - JOIN SINGLE AND MULTIPLE RECORDS. During export of multiple records as separate records, single records can be joined to each occurrence of the separate multiple records. - EXPORT RECORD TYPE. The record type of a record can be exported. - EXPORT RECORD ITEMS OR SUBITEMS. When an entire record is selected for export and subitems are contained in the record, only items, only subitems, or both items and subitems can be specified for output. - CSPRO AND SEMI-COLON DELIMITED OUTPUT. New output formats of CSPro and semi- colon delimited files are available. Table Retrieval Setup ===================== - NEW. This new tools allows you to create and edit a Table Retrieval file for use by the Table Retrieval tool. You can load a tables file generated by IMPS and individual files such as word processing documents, spreadsheets, or pdf files. ============================================================================ [10] What was New in CSPro 2.5 Those of you who are already familiar with CSPro 2.4 should note the following significant changes and new features. Please refer to the CSPro documentation or on-line helps for more information. CSPro (Data Entry Designer) =========================== - CAPI (Computer Assisted Personal Interviewing). In CAPI, the enumerator is presented a question to ask and enters the answers directly into CSPro. CSPro provide a switch to turn on CAPI behavior and a CAPI question editor. - CONTROL ITEM for ROSTER or MULTIPLE FORMS. An data item can now be specified to control the maximum number of occurrences of a roster or multiple form. - ROSTERS WITH FREE MOVEMENT. Roster now can either have their current behavior or can be made to behave as a spreadsheet where there is free movement Behavior in Rosters CSPro (language) ================ - BREAK and NEXT statements. These new statements allow you exit early from a loop and either exit the loop entirely or continue with the next iteration of the loop. - REENTER, SKIP, and ADVANCE statements. The statements have been enhanced to allow the specification of the target field in an alpha variable or data item. - MOVE statement. This new statement allows you to move to a field in data regardless on whether it is before or after the current field in the data entry sequence. - SYSPARM function. This new function allows you to retrieve the system parameter specified in the .PFF file which launched your application. - GETOPERATORID function. This new function allows you to retrieve the operator id entered by the operator or specified in the .PFF file which launched your data entry application. - GETSYMBOL function. This new function allows to retrieve the name of the proc which currently being executed. - GETLABEL function. This new function allows you to retrieve the data dictionary label associated with a dictionary, record, item, valueset or value. - HIGHLIGHTED function. This new function allows you to determine whether a field is on path during data entry in system controlled mode on before the high water mark in operator controlled mode. - SAVEPARTIAL function. This new function allows you save the current case partially under program control and continue with data entry. - ONSTOP global function. This new global function allows you to control events after a stop case is requested or data entry is closed while a case is being entered. - ONKEY global function. This new global funtion allows you capture and process each key press of the operator. - SET BEHAVIOR statement. This new statement allows you switch whether blanks are allowed in numeric fields. - SET ATTRIBUTES statement. This statement has been enhanced to specify whether a responses for a field are to be given for selection. The responses display are from the first value set in the data dictionary. Export Data =========== - SEPARATE RECORD EXPORT IN SPSS, SAS, and STATA. You can now export different records types to different files where multiple records in the indput file produce multiple records in the output files. This was available for text and comma delimited file previously and is now available for SPSS, SAS, and STATA exports. Pack Application ================ - NEW. This new tools allows you to create a zip file containing all the files that belong to an application. This is useful to transfer an application to another computer or to another colleague. ============================================================================ [11] What was New in CSPro 2.4 Those of you who are already familiar with CSPro 2.3 should note the following significant changes and new features. Please refer to the CSPro documentation or on-line helps for more information. CSPro (Data Entry Designer) =========================== - DATA ENTRY OPTIONS. You can allow partial saves of cases and show the case tree by selecting these options under the data entry options dialog box (Ctrl+E). CSPro (language) ================ - GETNOTE, PUTNOTE, EDITNOTE functions. These functions allow you to read and write notes to the notes file and force the operator to enter or read a note. They can only be coded in data entry applications. - MAKETEXT function. This function allow you to create a formatted string within your logic. - ONFOCUS and KILLFOCUS procedures. These procedures are only executed in data entry applications. They allow you to define statements which are always executed prior to and following entry of a level, roster, or field. CSEntry (Data Entry Module) =========================== - You can now save notes which are associated with a particular field within a particular case. - A case can now be partially saved in Add, Modify, or Verify mode. When this feature is turned on, you can stop anytime during the entry of a case and come back to it later. You will have the choice of beginning at the position in the case where you left off, or at the first keyable field of the case. - A case tree has been added for navigation within a case. When this feature is turned on, a tree showing the names and values of data items within the case is displayed. It can be used for moving between data items or for examining what has been entered in the case. - The menus and keyboard shortcuts have been changed and augmented. In particular, the Functions menu item has been split into Edit and Navigation menus. Additional items have been added to the View menu. CSPro (all modules) =================== - BACKWARD COMPATIBILITY. You can open any application created in CSPro 2.2 or 2.3 in CSPro 2.4. ============================================================================ [12] What was New in CSPro 2.3 Those of you who are already familiar with CSPro 2.2 should note the following significant changes and new features. Please refer to the CSPro documentation or on-line helps for more information. CSPro (Data Entry Designer) =========================== - COLOR IN FORMS. You now have total control over the colors you use in your data entry applications. Each form can have its own color, and every text item can have its own color. - MORE ALIGNMENT FUNCTIONS FOR FORMS DESIGN. In addition to aligning things left, right, top and bottom, you can now center things and space them evenly. CONCATENATE DATA UTILITY ======================== - This utility allows you to concatenate (join together) as many data files (or text files) as you like. The data files can be from any folder and you can sort them in a variety of ways. You'll find it on CSPro's Tools menu. CSPro (language) ================ - INSERT/DELETE/SORT COMMANDS. These are new commands in the CSPro language, which provide you more power in manipulating your data files. - DECLARING VARIABLES IN YOUR LOGIC. Variables that are not declared in PROC GLOBAL will be flagged as errors to help you avoid unintentional errors in your logic. If you prefer, you can easily set the compiler not to flag these as errors, as in CSPro 2.2. See the CSPro documentation on "Declarations" for more details. - SUBSCRIPT CHECKING. The CSPro compiler now issues warnings for unusual or improper use of subscripts. This will help you find errors in your logic, avoid run-time errors, and help ensure that your applications work the way you want. - REENGINEERED EXECUTION MODULES. We've done a lot of work "under the hood" to improve the way CSPro runs your applications. Several small bugs have been fixed and unusual behaviors corrected. CSPro (all modules) =================== - MORE PRODUCTION SUPPORT. We've standardized the Run Information files (.PFF) and provided more options for you to control the way CSPro data applications run. You can now double click on any .PFF file and CSPro will execute it. - BACKWARD COMPATIBILITY. You can open any application created in CSPro 2.2 and run it in CSPro 2.3. However, there are some differences between 2.2 and 2.3 that might affect the way your applications run. You may need to make some small modifications to your applications to make then run properly in 2.3. See the next section on "Migrating applications from CSPro 2.2 to 2.3" for more details. ============================================================================ [13] What was New in CSPro 2.2 Installation ============ - Support for installing and changing language used for minimum language features. CSPro (all modules) =================== - Minimal language support. Default small words in Tables and Maps are available in Armenian, English, French, Spanish, Portuguese, Russian, and Ukrainian. The Armenian, Russian, and Ukrainian alphabets are supported. - Toggle (Ctrl+U) between full screen (no tree) or split screen (with tree). - Toolbar buttons to change between the dictionary, data entry forms, batch edit code, and cross tabulations. - Tool tips work thoughout CSPro. CSPro (Data Dictionary) ======================= - Save dictionary under a different file name (Save As). CSPro (Data Entry Designer) =========================== - Better reconcilation of CSPro data entry applications with changes in the data dictionary. - Cut, Copy, and Paste objects while designing forms. - Create operator directed skips under field properties. - Specify force out-of-range, upper case alpha, and verify at the individual field level. Specify verification of every nth case. CSPro (Edit Designer) ===================== - Better reconciliation of CSPro edit applications with changes in the data dictionary. Option to specify dictionary or custom order of edits. CSPro (Cross Tabulation) ======================== - Option to show or not show area tables where no tallies occurred. - Apply a universe definition to ALL tables by pressing the "Apply to All Tables" button in the universe dialog box. CSPro (Language) ================ - Tooltips displayed when entering function names in code. Data Entry ========== - Can change the order cases are listed between entry order and case id sort order. - Can use + key on numeric pad to perform operator directed skip. - Can set full screen mode and initialize persistent fields in .PFF file. - Can perform interactive edits in modify mode using F11. - Verification of only selected fields. - Verification of every nth case. Text Viewer =========== - Option to show DOS Line Draw characters (OEM) rather than Windows characters (ANSI). Tabulate Frequencies ==================== - Toggle (Ctrl+T) between labels and names in the dictionary tree. - Select a universe for frequencies. Sort Data ========= - Sort by records within questionnaires. - Sort by quesetionnaires using non-id items. Export Data =========== - Toggle (Ctrl+T) between labels and names in the dictionary tree. Whatever text (labels or names) that appears in the tree will be the header row in the file. - Export single as well as multiple output files. - Select a specific occurrence of a subitem of a multiply occurring data item. Reformat Data ============= - More information provided about differences between dictionaries. - Can move items from a single record to another single or a mulitiple record. Compare Data ============ - New Tool to compare two data files and list the differences. ============================================================================ Comments, questions, and suggestions should be addressed to: Methodology & Software Development Branch International Programs Center U.S. Census Bureau Washington, DC 20233-8860 USA Phone: 1 (301) 763-1451 Fax: 1 (301) 763-4282 E-mail: CSPro@lists.census.gov Web site: www.census.gov/ipc/www/cspro