Azure Data Factory
Azure Data Factory
This page outlines the steps to connect Azure Data Factory to CData Connect Cloud. You can use either CData Connect Cloud Virtual SQL Server API or the CData Connect Cloud OData endpoint to connect. Note that the Virtual SQL Server API performs better for large datasets, while OData performs well with smaller datasets.
Prerequisites for Connecting via Virtual SQL Server API
Before you connect via Virtual SQL Server API, you must first do the following:
- Connect a data source to your CData Connect Cloud account. See Connections for more information.
- Generate a Personal Access Token (PAT) on the Settings page. Copy this down, as it acts as your password during authentication.
Connecting to CData Connect Cloud via Virtual SQL Server API
To establish a connection from Azure Data Factory to the CData Connect Cloud Virtual SQL Server API, follow these steps.
-
Login to Azure Data Factory.
-
If you have not yet created a Data Factory:
-
Click Create and enter your configuration information in each tab.
-
When you are finished entering information, click Review + create and then Create to save the Data Factory.
-
-
Open Azure Data Factory Studio and select your Data Factory.
-
In the Factory Resources section, highlight the Datasets option.
-
Click the three dots to open the Dataset actions and select New Dataset.
-
In the search bar, enter SQL Server and select it when it appears.
-
Enter a name for the server. In the Linked service field, select New.
-
Enter the connection settings.
- Name—enter a name of your choice.
- Server name—enter the Virtual SQL Server endpoint and port separated by a comma: tds.cdata.com,14333
- Database name—enter the Connection Name of the CData Connect Cloud data source you want to connect to (for example, Salesforce1).
- User Name—enter your CData Connect Cloud username. This is displayed in the top-right corner of the CData Connect Cloud interface. For example, test@cdata.com.
- Password—select Password (not Azure Key Vault) and enter the PAT you generated on the Settings page.
-
Click Create.
-
Select your new connection in the Linked service field.
-
Select your desired table and click OK.
You can now use this Dataset when creating Data flows in Azure Data Factory.
Prerequisites for Connecting via OData Endpoint
Before you connect to CData Connect Cloud via the OData endpoint, you must first do the following:
- Connect a data source to your CData Connect Cloud account. See Connections for more information.
- Create a virtual dataset Workspace. Later, you will use the OData Service URL on that page (https://cloud.cdata.com/api/odata/{workspace_name}) with the relevant workspace name to establish the connection.
- Generate a Personal Access Token (PAT) on the Settings page. Copy this down, as it acts as your password during authentication.
Connecting to CData Connect Cloud via OData Endpoint
To connect to CData Connect Cloud using the OData protocol, follow these steps.
-
Login to Azure Data Factory.
-
Click New > Dataset.
A New dataset dialog appears.
-
In the search bar, enter OData.
Select OData and click Continue.
-
In the Set properties dialog, name your OData Resource and for Linked service, click New. A New linked service dialog appears.
-
Enter the following settings for OData:
-
Name—enter a name of your choice.
-
Service URL—enter https://cloud.cdata.com/api/odata/{workspace_name}.
-
Authentication type—select Basic Authentication.
-
User name—enter your CData Connect Cloud username. This is displayed in the top-right corner of the CData Connect Cloud interface. For example, test@cdata.com.
-
Password—select Password (not Azure Key Vault) and enter the PAT you generated on the Settings page.
-
-
Click Create. This loads the details for your specific table or dataset that you want to query.
-
In the tab for your new dataset, select the path for the data you want to view.
-
Click Preview data to view the data.