Importing Data

Importing Data Using the Data Import Tool (DIT)

This article explains the steps involved in using the Data Import Tool.

For an overview of the Data Import Tool (DIT), see Accessing the Data Import Tool (DIT).

File Format

The Data Import Tool (DIT) accepts data in HMIS CSV or XML format. For file specifications, please see the Format Specifications . If you're importing HMIS XML files, the DIT allows the XML schema to be expanded to include fields outside of the standard HMIS XML schema. For more information see the "Custom Fields" section of Accessing the Data Import Tool (DIT). Users can import single files, a ZIP file containing one or more files, or an entire folder containing one or more files. When uploading a compressed ZIP file, the importer expects the ZIP only to contain CSV or XML files.  Any extraneous files, folders, or subfolders will cause an error suggesting to review the file structure within the compressed file before attempting another upload.

Note: Files should be imported from the agency in which they were created.

Uploading a File

Once a file has been added to the DIT queue, the file name, and file size will be displayed. Click START UPLOAD to begin the upload process or click CANCEL to remove the file from the queue.

File Validation

Once the file is uploaded from the queue, the next step is validation. During this step, the system ensures the file(s) adhere to data formatting specifications. To begin the validation process, click START VALIDATION.  

Once validation is complete, the page displays information about the file(s) and a section to map Program, Service, and Assessment data.

The Data Analysis section displays a total count of each type of record within the file(s). Unduplicated Programs, Services, and Assessments appear below. 

Mapping Programs, Services, and Assessments

The DIT allows users to map source records from the imported file(s) to existing destination records within Clarity Human Services. Establishing mapping relationships is key to ensuring data quality. You can filter results on the source Organization or Program, if applicable. The available options for mapping are based on your agency (or the agency you're switched into). Please note that if Programs, Services, and Assessments are not mapped here, the associated records will not be included in the import.

For each data type, choose the Clarity Human Services Program, Service, or Assessment to map the data to.


Click the SAVE for each section once you've associated the source data with a Clarity Human Services record.

Note: System Administrators are able to update private client records through the DIT. However, if a System Administrator does not have ‘edit’ access permission enabled, private client records will not be updated using the DIT. 

Mapping Coordinated Entry Events 

Coordinated Entry Events can be imported with the DIT within the Program Event Mapping interface. The program mapping for the imported event(s) should be selected first. After program mapping, select the Coordinated Entry Event within the applicable program where program_event_category will be imported.

A few caveats to note prior to importing and mapping the file(s) are listed below. 

  • Manual CE Event imports are supported.
  • CE Events must be set up at the program level prior to mapping/importing data with the DIT for the mapping options to display as intended. 
  • Imported data will appear as event transactions as opposed to services within Clarity Human Services. 

Importing the File(s)

Once the mapping is complete, the data can be imported into Clarity Human Services. Click IMPORT to start the import.

 

The number of processed records is displayed during the import. Click CANCEL to abort the import at any time.

 

When the import completes, the import will display as Imported.

Viewing the Import Results

Click SHOW RESULTS at the bottom of the page to see how the data was imported into Clarity Human Services.

The Message column informs you how the DIT handled each record. If an error occurs, details on the error will be displayed, allowing you to resolve the error on a subsequent import attempt.

 

Note: Because a value of 99 (“Data not collected”) cannot be stored in HMIS systems, a value of 99 for the following fields in a CSV file will be imported as NULL (empty):

  • NameDataQuality
  • SSNDataQuality
  • DOBDataQuality
  • CurrentLivingSituation
  • RelationshipToHoh
  • Destination

The following message will be displayed on the Results page: “Fields with 99 value were imported as null <field name>.”


Updated: 01/09/2024