Creating a Text Folder Data Source

Creating a Text Folder Data Source

1. From the left side options column navigate to Data Sources > Bulk Sources > Folder.

2. On the File Data Sources window click on the Create Bulk Folder button.

‍3. Select the Text Folder Data Source Icon.

4. This will open the Text Folder Data Source Setup window.

  1. Enter a Description.
  2. File Selection – Select where the files will be loaded from, options include:
  • Select files at runtime
  • Load from FTP connection
  • Load from OneDrive connection
  • Load from Outlook connection
  • Load from SharePoint connection

Note: Each option has different settings, and those will be explained below.

  1. Column Separator – Select the column separator for the text file, options include:
  • Csv Delimited
  • Tab Delimited
  • Pipe Delimited
  • Custom Delimited (Enter the delimiter in the text box to the right if using a custom delimited text file.
  1. Character Set – Either ANSI or OEM.
  2. Has Column Headers – Mark this checkbox if the source file has column headers.
  3. Template File – Click on the Select files button to select the template file that will be uploaded. (Note: the uploaded file will be used as a template to define the columns and no data from it will be processed).
  4. Source Schema – If the source file does not have column headers, then the columns will be named Column0, Column1, etc. If “Has Column Headers” is checked, then the column headers from the file will be used. The Column Name, Type, and Length of each column can be edited in the Source Schema window.

Select files at runtime
  1. There are no further steps you need to take when using “Select files at runtime”. When you run an integration using this source, you will be asked to select the source file to run from your local machine. The source file columns must match the columns from the template file, otherwise it will not run the source file.

Load from FTP connection
  1. Go to the FTP Details tab.

  1. FTP Connection – The drop-down list will contain FTP Connection(s) created under the Connections option.
  2. Source Directory – Location where the files used for the integration are stored.
  3. Success Directory – Files that are processed successfully are moved to this location.
  4. Fail Directory – Files that fail during processing are moved to this location.
  5. Empty File Action – Drop-down list which indicates the action that should be taken on empty files.
  • Leave File – Leaves empty files in the Source Directory.
  • Move File to Failure – Moves empty files to the Fail Directory.
  • Move File to Success – Moves empty files to the Success Directory.
  1. Overwrite Files – Mark this checkbox if the files in the Fail and Success Directories should be overwritten.
  2. Append Date Time – Mark this checkbox to append the Date and Time to the files moved to the Fail and Success Directories.
  3. Click Validate to verify the connection to the spreadsheet. (Note: validation must be successful for the Save and Preview buttons to become active).
  4. Click Preview to display a pop-up window with a sample of the data from the spreadsheet.
  5. Save the Data Source.

Load from OneDrive connection
  1. Go to the OneDrive Details tab.

  1. raph Connection – The drop-down list will contain Graph Connection(s) created under the Connections option.
  2. Source Directory – Location where the files used for the integration are stored.
  3. Success Directory – Files that are processed successfully are moved to this location.
  4. Fail Directory – Files that fail during processing are moved to this location.
  5. Empty File Action – Drop-down list which indicates the action that should be taken on empty files.
  • Leave File – Leaves empty files in the Source Directory.
  • Move File to Failure – Moves empty files to the Fail Directory.
  • Move File to Success – Moves empty files to the Success Directory.
  1. Overwrite Files – Mark this checkbox if the files in the Fail and Success Directories should be overwritten.
  2. Append Date Time – Mark this checkbox to append the Date and Time to the files moved to the Fail and Success Directories.
  3. Click Validate to verify the connection to the spreadsheet. (Note: validation must be successful for the Save and Preview buttons to become active).
  4. Click Preview to display a pop-up window with a sample of the data from the spreadsheet.
  5. Save the Data Source.

Load from Outlook connection
  1. Go to the Outlook Details tab.

  1. Outlook Connection – The drop-down list will contain Graph Connection(s) created under the Connections option.
  2. Source Directory – Location where the files used for the integration are stored.

Load from SharePoint connection
  1. Go to the SharePoint Details tab.

  1. SharePoint Connection – The drop-down list will contain Graph Connection(s) created under the Connections option.
  2. Source Directory – Location where the files used for the integration are stored.
  3. Success Directory – Files that are processed successfully are moved to this location.
  4. Fail Directory – Files that fail during processing are moved to this location.
  5. Empty File Action – Drop-down list which indicates the action that should be taken on empty files.
  • Leave File – Leaves empty files in the Source Directory.
  • Move File to Failure – Moves empty files to the Fail Directory.
  • Move File to Success – Moves empty files to the Success Directory.
  1. Overwrite Files – Mark this checkbox if the files in the Fail and Success Directories should be overwritten.
  2. Append Date Time – Mark this checkbox to append the Date and Time to the files moved to the Fail and Success Directories.
  3. Click Validate to verify the connection to the spreadsheet. (Note: validation must be successful for the Save and Preview buttons to become active).
  4. Click Preview to display a pop-up window with a sample of the data from the spreadsheet.
  5. Save the Data Source.

Feeling stuck? Get the support and guidance you need to help you power through any data challenge

Reset Filters