Creating a Text Folder Data Source

Published: Mar 14, 2023

Creating a Text Folder Data Source

Published: Mar 14, 2023

1. From the left side options column navigate to Data Sources > Bulk Sources > Folder.

63c85b7e9b9e821ecb765457 FolderDataSourceLocation

2. On the File Data Sources window click on the Create Bulk Folder button.

63c85b999ee35082d34e3a13 CreateBulkFolderButton

‍3. Select the Text Folder Data Source Icon.

4. This will open the Text Folder Data Source Setup window.

  1. Enter a Description.
  2. File Selection – Select where the files will be loaded from, options include:
  • Select files at runtime
  • Load from FTP connection
  • Load from OneDrive connection
  • Load from Outlook connection
  • Load from SharePoint connection

Note: Each option has different settings, and those will be explained below.

  1. Column Separator – Select the column separator for the text file, options include:
  • Csv Delimited
  • Tab Delimited
  • Pipe Delimited
  • Custom Delimited (Enter the delimiter in the text box to the right if using a custom delimited text file.
  1. Character Set – Either ANSI or OEM.
  2. Has Column Headers – Mark this checkbox if the source file has column headers.
  3. Template File – Click on the Select files button to select the template file that will be uploaded. (Note: the uploaded file will be used as a template to define the columns and no data from it will be processed).
  4. Source Schema – If the source file does not have column headers, then the columns will be named Column0, Column1, etc. If “Has Column Headers” is checked, then the column headers from the file will be used. The Column Name, Type, and Length of each column can be edited in the Source Schema window.

Select files at runtime
  1. There are no further steps you need to take when using “Select files at runtime”. When you run an integration using this source, you will be asked to select the source file to run from your local machine. The source file columns must match the columns from the template file, otherwise it will not run the source file.

Load from FTP connection
  1. Go to the FTP Details tab.
63c85bd9eb99f31d35fb4ce4 FTPDetailsTab

  1. FTP Connection – The drop-down list will contain FTP Connection(s) created under the Connections option.
  2. Source Directory – Location where the files used for the integration are stored.
  3. Success Directory – Files that are processed successfully are moved to this location.
  4. Fail Directory – Files that fail during processing are moved to this location.
  5. Empty File Action – Drop-down list which indicates the action that should be taken on empty files.
  • Leave File – Leaves empty files in the Source Directory.
  • Move File to Failure – Moves empty files to the Fail Directory.
  • Move File to Success – Moves empty files to the Success Directory.
  1. Overwrite Files – Mark this checkbox if the files in the Fail and Success Directories should be overwritten.
  2. Append Date Time – Mark this checkbox to append the Date and Time to the files moved to the Fail and Success Directories.
  3. Click Validate to verify the connection to the spreadsheet. (Note: validation must be successful for the Save and Preview buttons to become active).
  4. Click Preview to display a pop-up window with a sample of the data from the spreadsheet.
  5. Save the Data Source.

Load from OneDrive connection
  1. Go to the OneDrive Details tab.
63c85c96ad423c2fa4dce570 OneDriveDetailsTab

  1. raph Connection – The drop-down list will contain Graph Connection(s) created under the Connections option.
  2. Source Directory – Location where the files used for the integration are stored.
  3. Success Directory – Files that are processed successfully are moved to this location.
  4. Fail Directory – Files that fail during processing are moved to this location.
  5. Empty File Action – Drop-down list which indicates the action that should be taken on empty files.
  • Leave File – Leaves empty files in the Source Directory.
  • Move File to Failure – Moves empty files to the Fail Directory.
  • Move File to Success – Moves empty files to the Success Directory.
  1. Overwrite Files – Mark this checkbox if the files in the Fail and Success Directories should be overwritten.
  2. Append Date Time – Mark this checkbox to append the Date and Time to the files moved to the Fail and Success Directories.
  3. Click Validate to verify the connection to the spreadsheet. (Note: validation must be successful for the Save and Preview buttons to become active).
  4. Click Preview to display a pop-up window with a sample of the data from the spreadsheet.
  5. Save the Data Source.

Load from Outlook connection
  1. Go to the Outlook Details tab.
63c85cdeeb99f30c73fc7241 OutlookDetailsTab

  1. Outlook Connection – The drop-down list will contain Graph Connection(s) created under the Connections option.
  2. Source Directory – Location where the files used for the integration are stored.

Load from SharePoint connection
  1. Go to the SharePoint Details tab.
63c85d1774c5c90d5307d17a SharepointDetailsTab

  1. SharePoint Connection – The drop-down list will contain Graph Connection(s) created under the Connections option.
  2. Source Directory – Location where the files used for the integration are stored.
  3. Success Directory – Files that are processed successfully are moved to this location.
  4. Fail Directory – Files that fail during processing are moved to this location.
  5. Empty File Action – Drop-down list which indicates the action that should be taken on empty files.
  • Leave File – Leaves empty files in the Source Directory.
  • Move File to Failure – Moves empty files to the Fail Directory.
  • Move File to Success – Moves empty files to the Success Directory.
  1. Overwrite Files – Mark this checkbox if the files in the Fail and Success Directories should be overwritten.
  2. Append Date Time – Mark this checkbox to append the Date and Time to the files moved to the Fail and Success Directories.
  3. Click Validate to verify the connection to the spreadsheet. (Note: validation must be successful for the Save and Preview buttons to become active).
  4. Click Preview to display a pop-up window with a sample of the data from the spreadsheet.
  5. Save the Data Source.

Feeling stuck? Get the support and guidance you need to help you power through any data challenge

Reset Filters