We are working hard to make updates to the Shop and Account Management portal.

Please note that many of these changes will roll out this Saturday, June 1st and will require downtime. We are working to ensure minimal disruption for our eOne community and really appreciate your patience as we push out these changes. Please reach out to sales@eonesolutions.com with any questions.

Setting Up Azure Data Lake Connectors for Upload Tool Migrations

Setting Up Azure Data Lake Connectors for Upload Tool Migrations

How to add an Azure Data Lake Connector for Popdock Data Lake Upload Tool Migrations

When you add an Azure Data Lake connector, you can connect to data stored in Azure cloud storage, and access it through your business applications. An Azure Data Lake connector does require an existing Azure Data Lake to be set up.  

Before you add an Azure Data Lake Connector, setup an Azure Data Lake.

As part of your Azure Data Lake setup, we recommend you create two separate Azure Data Lake storage containers; one to store tables and the other for lists. Then, create two separate data lake connectors; one for tables and the other for lists. Point them to each of these storage containers.  

In this article, you will learn how to add an Azure Data Lake Connector.

Create a Popdock Azure Data Lake Connector for tables

1. Select Connectors from the left navigation to open the Connectors page.

Main menu in Popdock with Connectors highlighted.

2. Select Add connector.

3. From the list of connectors, select Azure Data Lake.  

A picture containing shapeDescription automatically generated

4. At the Add connector screen, enter connection information for your Azure Data Lake. To find your Azure data lake connection information, see how to connect to Azure Data Lake.

5. Under Connection type, leave the default connection type as Data Lake Storage Gen2.

6. Enter the name of your Microsoft Azure Storage Account.

7. Enter the Microsoft Azure storage Container name. This will store your tables.

8. Go to your Azure console and copy the Shared key for the Microsoft Azure Storage Account entered in Step 5. Paste it into the Shared Key box.

9. Use the Format dropdown to select the format of the files that are stored within your Azure Storage Container. You will notice that Popdock can read both CSV and Parquet files from the Azure Data Lake.

10. Select Validate, from the left menu, to test the data lake connection.

11. If the validation was successful, select Connect. If the validation fails, check and re-enter your connection information and then select Validate again.

12. Select Connect to finish setting up the connector.

13. The new Azure Data Lake connector appears in the connectors list.

Graphical user interface, text, applicationDescription automatically generated

14. Select the Edit icon next to the Azure Data Lake connector to customize the settings.

15. By default, this connector type is named Azure Data Lake. Modify the connector name so it describes the type of data it will contain.  

16. This connector will be used for tables, so rename the connector to Azure Data Lake – Tables.

17. Select Go back to Connectors.

18. Confirm that the connector has been renamed to Azure Data Lake – Tables. The connector is ready to use.  

Create a Popdock Azure Data Lake Connector for lists

‍Repeat steps 1 – 6 to create a second Azure Data Lake connector.

1. For the Microsoft Azure storage Container name, enter the name of the container which will store your lists.

2. Go to your Azure console and copy the Shared key for the Microsoft Azure Storage Account entered in Step 6. Paste it into the Shared Key textbox.

3. Select Validate, from the left menu, to test the data lake connection.

4. If the validation was successful, select Connect. If the validation fails, check and re-enter your connection information and then select Validate again.

5. Select Connect to finish setting up the connector.

6. The new Azure Data Lake connector appears in the connectors list.

7. Select the Edit icon next to the Azure Data Lake connector to customize the settings.

8. By default, this connector type is named Azure Data Lake. Modify the connector name so it describes the type of data it will contain.  

Graphical user interface, applicationDescription automatically generated

9. This connector will be used for lists, so rename the connector to Azure Data Lake – Lists.

10. Select Go back to Connectors.

11. Confirm that the connector has been renamed to Azure Data Lake – Lists. You will now have two connectors ready to use; one for lists and another for tables.

Having trouble adding with your Azure Data Lake Connector? Email support at support@eonesolutions.com.

Content
How to add an Azure Data Lake Connector for Popdock Data Lake Upload Tool Migrations Create a Popdock Azure Data Lake Connector for tables Create a Popdock Azure Data Lake Connector for lists

Feeling stuck? Get the support and guidance you need to help you power through any data challenge

Reset Filters