To open the Data Loads tab, go to Management > Smart Insight Data Quality > Data Loads.
What is the Data Loads tab?
The Data Loads tab shows the status of your scheduled automatic loads and all your successful and unsuccessful contact, product and purchase file uploads for the last 30 days.
If the cumulative size of the files you upload in one occasion exceeds 10 GB, please notify Emarsys Support as these files need special attention from our side.
For the proper operation of Smart Insight you must upload on a daily basis the most recent contact, product and purchase data.
Please consider our file maintenance policy that came into effect in October 2021:
- For clients using the automatic daily load feature: files that are not loaded into Smart Insight and older than 7 days will be deleted.
- For clients not using the automatic daily load feature: files that are not loaded into Smart Insight and older than 30 days will be deleted.
No automatic data load set up
When your Smart Insight implementation is nearly ready, the Data Loads tab of your account shows a state when there is no automatic load set up and there is no file uploaded by you to the SFTP server.
Automatic load set up without a file
By the time your Smart Insight implementation has been finished, we have scheduled an automatic upload for you.
At this point your task is to upload the data of contacts, products and purchases to the SFTP server. See the Smart Insight FAQ for more information on their requirements.
Automatic load set up with a file
When all set, the screen shows a state when there is an upload scheduled and there is a file available on the SFTP server.
At this point you can click the Load Now button to start the upload immediately. The screen will show the status of your upload, with the messages indicating possible errors.
See the Validation Error Messages section for more information on possible errors.
Data Loads history states
The upload history elements are color-coded:
- Green denotes a successful upload.
- Yellow denotes a missing upload for the specified day.
- Red denotes one or more unsuccessful file uploads.
Click an entry to expand it and see details of why an upload failed. The Validation Error Messages section provides more information on the reasons.
Validation Error Messages
<Field> is an invalid date.
The format of a specific field can be defined during SI implementation. If this message is shown, the date format is invalid or it is not provided at all.
<Field> is an invalid float.
During the implementation process, the decimal separator is defined. If the field has another type of decimal separator, this error message is displayed. Please note here that thousand separators (i.e. 1,000) cannot be used.
<Field> is an invalid integer.
When a field is defined as an integer and it is a mandatory field, this message is shown when it contains a string or it is empty. If a field is not mandatory and is empty, it will be loaded to the database without an error. However, if it is a string, this will also generate this error.
<Field> is missing.
The value is missing for a field.
Missing or stray quote.
The escape character for the quote symbol (“) can be set. The default is a double quote: “, e.g. “”Hello!”” will be displayed as “Hello!”. If the proper escape characters are not used (e.g. /”Hello!/”), or these are not used at all (e.g. “Hello!”), this message is displayed.
Line breaks were inconsistent or incorrectly specified.
The file has line breaks which are different than the accepted style, or it consistently has different line breaks (e.g. it is defined as a Windows line break but the file contains Linux ones). Windows (CR LF), and Linux (LF) line breaks are accepted. Mac line break is not accepted (CR).
The quote symbol which encloses a value is not in its proper place, e.g. it is in the middle of a word.
Row contains an unclosed quote.
The number of quote symbols is not correct in a row, i.e. a value has only one or three or more enclosing quotes instead of two.
Encoding error when parsing row, e.g. because of invalid characters.
This message is shown when the file contains characters with invalid encoding. For example. if the file was defined as UTF-8, no characters with different encoding types are accepted.
More than 1000 errors were found.
The .csv file contains more than 1,000 errors, so the checking process was terminated. If you see this message, it means that your .csv file was heavily corrupted and there were too many errors to display. Please check that your upload files comply with our CSV Guidelines.
Sending email notifications
You can subscribe to email notifications that you will receive when there is a new Smart Insight data quality warning or a data load error occurs in your daily load.
For more information, see Sending email notifications.