If Smart Insight is already set up in your account and you would like to use our new Sales Data Batch Loads solution, please contact your Implementation Consultant.
You can find the most important pieces of information on onboarding and configuring Sales Data Batch Loads on this page.
For more information on onboarding and configuring Sales Data Batch Loads, watch the August 2024 Product Release video:
Onboarding Sales Data Batch Loads
The Sales Data Batch Loads feature needs to be enabled in your account. Please contact Emarsys Support for more information.
Here is what you need to do to onboard the Sales Data Batch Loads solution:
You need to perform this step only if Smart Insight is enabled in your account.
- Upload your CSV file to the Smart Insight SFTP.
-
Monitor the sales data load on the Sales Data Batch Loads screen:
- If the file failed to load, then check the corresponding error messages, fix the issues and try reloading the file again.
- If the file was partially loaded you can either:
- Truncate the database, fix the issue and reload your historical data again OR
- Extract the erroneous lines, fix the issues and reload them again as a new file.
- If you would like to fix data quality issues coming from the sales data, then you need to truncate the sales database, fix the issues and reload your historical data again.
- Trigger a sales data load to Smart Insight or wait for the next scheduled data load.
You need to perform this step only if Smart Insight is enabled in your account.
Configuring Sales Data Batch Loads
Before you start to upload sales data, you need to complete the sales data setup as follows:
- Go to Management > Sales Data Batch Loads.
- Set up your FTP account. You need to copy and paste the following information from the screen:
- Server URL,
- Username,
- Password
- Configure your sales data files - this process consists of the following steps:
-
File Setup - You need to provide the following information:
-
File Name Pattern - It is used for identifying the purchase files in your account’s FTP folder. For example:
sales_items*.csv
- Delimiter - The delimiter character used in the CSV file.
- Quote - The quote character used in the CSV file.
-
File Name Pattern - It is used for identifying the purchase files in your account’s FTP folder. For example:
-
File Setup - You need to provide the following information:
You can upload a copy or sample sales data file under Sample CSV. If you upload a copy or sample, then Emarsys tries to determine the correct delimiter and quote characters based on the sample.
When you are ready, click Next.
- Field Mapping - Emarsys tries to match the columns to the required fields automatically. Please check whether the suggested field mapping is correct and make modifications if necessary.
If you have uploaded a copy or sample sales data CSV file in the previous step, then the fields are automatically populated with the values taken from the header of your CSV file.
The following columns and options are displayed here:
- Position - The order of the column in the CSV file. To change the order, click the up and down arrows at the end of the row.
- Source Field Name - The name of the field in the header of the CSV file.
- Emarsys Field Name - The standard sales data property to which the CSV column is assigned. You have to match each core field. For custom fields, select the option Custom Field.
- Data Type - The type of the specific field. You can change this value for custom fields but cannot change it for core fields. The default value is String.
- Add Field - To add a new field, click this button.
- Delete a Field - To delete a field, click this icon.
When you are ready, click Save.
Configuring Smart Insight to use Sales Data Batch Loads
Here is what you need to do to configure Smart Insight to use Sales Data Batch Loads:
- If Smart Insight has not been set up in your account, then you need to set up your FTP account and select the Upload via Sales Data Batch Load option when configuring the Purchase Fields settings during the onboarding process.
- If Smart Insight has already been set up in your account, then you need to proceed as follows:
- Go to Management > Smart Insight Settings and click the Purchase Fields tab.
- Reset your Purchase Fields settings and select the Upload via Sales Data Batch Load option.
Modifying the Sales Data Batch Loads configuration
Here is what you need to do to modify your Sales Data Batch Loads configuration:
- Go to Management > Sales Data Batch Loads, click the cogwheel icon in the top-right corner, then click Go to Data Configuration.
- To modify your configuration, click Edit.
If you would like to add or remove fields from your data configuration retroactively, then you have to empty your sales database and reload your historical data including the changes.
- Here you can change the following:
- File Settings.
- Field Mapping.
Important:
- You cannot modify the type of custom fields that were uploaded previously without truncating your database.
- You cannot use reserved internal names for custom fields.
- When you are ready, click Save.
Monitoring your sales data loads
You can monitor your sales data loads on the Management > Sales Data Batch Loads page. Here you can check the following:
- Load Overview - You can check each sales data file upload in the last 60 days on this tab.
- Data Quality - You can check the quality of the sales data successfully uploaded to Emarsys on this tab.
After your sales data file is uploaded to the Smart Insight SFTP, the load process starts immediately and a new row appears under Sales Data Load History.
Please note that the load screen is not refreshed automatically.
First, the In Progress status appears next to the current load. For more information on load statuses, see File Load History.
FAQ
What shall I do if I want to change the data source to Upload custom CSV or Upload via Plugin in Smart Insight?
Here is what you need to do to change the data source to Upload custom CSV or Upload via Plugin in Smart Insight.
- If you have already uploaded sales data into Sales Data Batch Loads, then you need to empty your sales database.
If no sales data has been loaded into Sales Data Batch Loads, then you can skip this step.
- To turn off Sales Data Batch Loads, please contact Emarsys Support.
Turning off Sales Data Batch Loads will result in permanently removing your loaded sales data as well.
As a result, all the Sales Data Batch Loads related screens are removed and the Smart Insight Data Loads and Data Quality screens reappear as the primary place to set up sales data.
- Go to Management > Smart Insight Settings and select the required data source option (Upload custom CSV or Upload via Plugin) during the Smart Insight setup.
Good-to-know and limitations
- The sales data upload options Upload via Sales Data Batch Load and Upload via CSV or Upload via Plugin are mutually exclusive. The available data upload options depend on whether Batch Sales Data Loads is enabled in your account:
- If Batch Sales Data Loads is enabled in your account, then only the Upload via Sales Data Batch Load option is available in Smart Insight as the data source and the supported use cases will use this data by default.
- If Batch Sales Data Loads is not enabled in your account, then you can choose between the options Upload via CSV and Upload via Plugin when configuring Smart Insight. In this case, related Emarsys features will use the Smart Insight, Plugin or Web Extend data sources accordingly.
- When Batch Sales Data Loads is enabled in your account, you will receive a notification that you need to configure your sales data AND set up Smart Insight to use it. If you switch back to the data load option Upload via CSV or Upload via Plugin, you will receive a notification to set up Smart Insight to use the selected data source.
- The Sales Data Batch Loads solution uses the same SFTP as Smart Insight (to upload product and store data), so regenerating the password in either of the screens has the same impact.