Photo by Campaign Creators on Unsplash

How to export Dynamics 365 data to Azure Data Lake Gen2

Last Updated: 2023 September 14By

Case

There are numerous scenarios where exporting your Microsoft Dynamics 365 data to external systems becomes necessary. For instance, you might seek a more advanced reporting solution beyond what the built-in D365 offers, opting for Power BI reports instead. Alternatively, you might need to export data to a different data warehouse. In such situations, Azure Synapse Link presents itself as a valuable solution. This article will walk you through the entire process.

Solution

Utilizing Azure Synapse Link, you can seamlessly transfer data from D365 to an Azure Data Lake Gen2 and subsequently employ or forward that data as needed.

Prerequisites

  • Microsoft Dynamics 365
  • Azure Power Apps
  • Azure Data Lake Gen2 (Be aware that you need to have owner rights for it and hierarchical namespace enabled)

Steps

  1. Go to the Power Platform portal at https://make.powerapps.com.
  2. Click on “More” in the left-hand menu.
  3. Select “Discover all.”
  4. In the list of available connectors and services, find and select “Azure Synapse Link.”
    PowerApp Azure Synapse Link
  5. Click on “New link.”
    Azure Synapse Link New Link
  6. Choose your Azure subscription, specify the desired resource group, and select the appropriate Azure Storage Account where you want to store the exported data.
    Azure Synapse Link New Link
  7. Next, select the tables or entities from the Power Platform Common Data Service that you want to export to Azure Data Lake Storage Gen2.
    Azure Synapse Link Tables
  8. Click “Save” to initiate the setup process. If you encounter a permission error, ensure that you have owner or contributor rights for the Azure Data Lake Storage Gen2 resource, as you correctly mentioned.
  9. Once the link has been successfully created, you will have the option to configure the data export settings, including whether you want to partition the data on a monthly or yearly basis.
    Azure Synapse Link
  10. Choose your desired partitioning strategy based on your data retention and management requirements.
  11. Save your settings to finalize the Azure Synapse Link configuration.

Conclusion

The CSV files are generated approximately every 15 minutes, making them readily available for your use. There is a model.json where you can find the schema of the tables. You can leverage them for your reporting needs or process them using Azure Data Factory and route them to any destination of your choice.
Azure Data Lake

The header image has been provided by Campaign Creators on Unsplash

editor's pick

latest video

news via inbox

Nulla turp dis cursus. Integer liberos  euismod pretium faucibua

Leave A Comment

you might also like